-- Logs begin at Tue 2022-08-02 08:08:12 UTC, end at Tue 2022-08-02 09:30:29 UTC. -- Aug 02 08:47:15.730707 dv-cinder-845990-6-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 02 08:47:15.743480 dv-cinder-845990-6-iscsi devstack@keystone.service[80397]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 02 08:47:15.746316 dv-cinder-845990-6-iscsi devstack@keystone.service[80397]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 2 08:47:15 2022] *** Aug 02 08:47:15.746316 dv-cinder-845990-6-iscsi devstack@keystone.service[80397]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 02 08:47:15.746316 dv-cinder-845990-6-iscsi devstack@keystone.service[80397]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 02 08:47:15.746316 dv-cinder-845990-6-iscsi devstack@keystone.service[80397]: nodename: dv-cinder-845990-6-iscsi Aug 02 08:47:15.746316 dv-cinder-845990-6-iscsi devstack@keystone.service[80397]: machine: x86_64 Aug 02 08:47:15.746316 dv-cinder-845990-6-iscsi devstack@keystone.service[80397]: clock source: unix Aug 02 08:47:15.746316 dv-cinder-845990-6-iscsi devstack@keystone.service[80397]: pcre jit disabled Aug 02 08:47:15.746316 dv-cinder-845990-6-iscsi devstack@keystone.service[80397]: detected number of CPU cores: 4 Aug 02 08:47:15.746316 dv-cinder-845990-6-iscsi devstack@keystone.service[80397]: current working directory: / Aug 02 08:47:15.746969 dv-cinder-845990-6-iscsi devstack@keystone.service[80397]: detected binary path: /usr/bin/uwsgi-core Aug 02 08:47:15.746969 dv-cinder-845990-6-iscsi devstack@keystone.service[80397]: your processes number limit is 47680 Aug 02 08:47:15.746969 dv-cinder-845990-6-iscsi devstack@keystone.service[80397]: your memory page size is 4096 bytes Aug 02 08:47:15.746969 dv-cinder-845990-6-iscsi devstack@keystone.service[80397]: detected max file descriptor number: 2048 Aug 02 08:47:15.746969 dv-cinder-845990-6-iscsi devstack@keystone.service[80397]: lock engine: pthread robust mutexes Aug 02 08:47:15.746969 dv-cinder-845990-6-iscsi devstack@keystone.service[80397]: thunder lock: enabled Aug 02 08:47:15.746969 dv-cinder-845990-6-iscsi devstack@keystone.service[80397]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 02 08:47:15.746969 dv-cinder-845990-6-iscsi devstack@keystone.service[80397]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 02 08:47:15.793418 dv-cinder-845990-6-iscsi devstack@keystone.service[80397]: Python main interpreter initialized at 0x5646496ac9c0 Aug 02 08:47:15.793418 dv-cinder-845990-6-iscsi devstack@keystone.service[80397]: python threads support enabled Aug 02 08:47:15.793418 dv-cinder-845990-6-iscsi devstack@keystone.service[80397]: your server socket listen backlog is limited to 100 connections Aug 02 08:47:15.793418 dv-cinder-845990-6-iscsi devstack@keystone.service[80397]: your mercy for graceful operations on workers is 90 seconds Aug 02 08:47:15.793858 dv-cinder-845990-6-iscsi devstack@keystone.service[80397]: mapped 403077 bytes (393 KB) for 2 cores Aug 02 08:47:15.793858 dv-cinder-845990-6-iscsi devstack@keystone.service[80397]: *** Operational MODE: preforking *** Aug 02 08:47:15.794158 dv-cinder-845990-6-iscsi devstack@keystone.service[80397]: *** uWSGI is running in multiple interpreter mode *** Aug 02 08:47:15.794158 dv-cinder-845990-6-iscsi devstack@keystone.service[80397]: spawned uWSGI master process (pid: 80397) Aug 02 08:47:15.794383 dv-cinder-845990-6-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 02 08:47:15.795564 dv-cinder-845990-6-iscsi devstack@keystone.service[80397]: spawned uWSGI worker 1 (pid: 80406, cores: 1) Aug 02 08:47:15.795564 dv-cinder-845990-6-iscsi devstack@keystone.service[80397]: spawned uWSGI worker 2 (pid: 80407, cores: 1) Aug 02 08:47:15.795564 dv-cinder-845990-6-iscsi devstack@keystone.service[80397]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 02 08:47:21.963579 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 08:47:21.963579 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: from cryptography.utils import int_from_bytes Aug 02 08:47:21.964802 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 08:47:21.964802 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: from cryptography.utils import int_from_bytes Aug 02 08:47:21.964918 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 08:47:21.964918 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: from cryptography.utils import int_from_bytes Aug 02 08:47:21.964918 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 08:47:21.964918 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: from cryptography.utils import int_from_bytes Aug 02 08:47:22.017592 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 08:47:22.017883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 08:47:22.018021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 08:47:22.018176 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] command line args: [] {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 08:47:22.018311 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 08:47:22.018453 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 08:47:22.018591 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] command line args: [] {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 08:47:22.018713 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ================================================================================ {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 08:47:22.018713 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] admin_token = **** {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.018943 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 08:47:22.018943 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ================================================================================ {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 08:47:22.019197 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] config_dir = [] {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.019334 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] admin_token = **** {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.019470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.019470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] config_source = [] {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.019707 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] config_dir = [] {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.019891 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] debug = True {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.020073 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.020285 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.020600 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] config_source = [] {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.020600 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] debug = True {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.020838 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.020971 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.021177 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.021421 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.021597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.021769 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.021945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.022134 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.022308 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] list_limit = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.022469 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.022641 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] log_config_append = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.022813 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] list_limit = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.022998 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.023168 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] log_config_append = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.023312 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] log_dir = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.023439 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.023564 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] log_file = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.023695 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] log_dir = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.023837 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.023972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] log_file = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.024109 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.024223 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.024339 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.024408 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.024585 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.024729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.024863 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.024863 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.025158 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.025158 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.025478 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.025618 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.025744 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.025872 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.025960 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.026148 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.026279 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.026412 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.026547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.026674 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.026795 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.026991 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.027127 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.027262 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.027409 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.027543 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.027669 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.027866 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.027866 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.028125 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.028125 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] publish_errors = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.028477 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.028615 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.028749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] publish_errors = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.028882 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.028882 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.029188 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.029323 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.029459 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.029594 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.029748 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.029887 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] standard_threads = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.030516 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.030641 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.030763 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.030902 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.031029 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] standard_threads = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.031160 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.031251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.031383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] use_journal = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.031464 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.031631 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] use_json = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.031770 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.031898 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] use_stderr = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.032032 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] use_journal = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.032178 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] use_syslog = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.032306 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] use_json = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.032547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.032679 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] use_stderr = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.032805 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.032934 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] use_syslog = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.033097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.033227 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:47:22.033372 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.033508 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.033631 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.033755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.033879 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.034003 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.034145 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.034280 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.034415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.034552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.034678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.034811 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.034811 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.035055 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.035191 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.035320 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.035402 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.035598 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.035741 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.035869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.036004 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.036140 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.036289 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.036414 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.036577 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.036719 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.036824 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.036977 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.037056 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.037179 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.037306 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.037430 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.037508 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.037619 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.037719 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.037801 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.037873 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.037992 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.038067 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.038180 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.038277 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.038457 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.038571 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.038692 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.038805 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.038909 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.039032 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.039161 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.039296 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.039424 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.039548 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.039682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.039806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.039943 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.040070 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.040216 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.040354 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.040477 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.040612 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.040758 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.040885 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.041009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.041193 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.041321 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.041443 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.041578 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.041702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.041828 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.041951 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.042081 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.042208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.042338 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.042508 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.042669 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.042834 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.043053 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.043231 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.043408 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.043577 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.043738 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.043913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.044097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.044328 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.044469 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.044601 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.044732 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.044874 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.045000 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.045129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.045274 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.045460 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.045734 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.046029 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.046172 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.046257 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.046318 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.046397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.046459 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.046517 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.046575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.046646 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.046755 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.047139 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.047267 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.047379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.047508 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.047508 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.047735 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.047876 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.048015 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.048140 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.048302 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.048422 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.048534 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.048674 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.048785 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.048920 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.049048 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.049171 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.049308 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.049456 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.049584 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.049727 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.049866 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.049993 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.050128 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.050268 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.050405 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.050532 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.050660 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.050774 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.050899 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.051026 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.051140 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.051253 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.051363 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.051473 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.051592 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.051592 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.051916 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.052019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.052098 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.052177 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.052242 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.052346 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.052458 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.052571 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.052693 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.052818 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.052948 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.053096 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.053246 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.053376 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.053505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.053633 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.053763 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.053862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.053980 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.054111 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.054237 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.054366 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.054493 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.054493 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.054737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.054870 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.054998 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.055119 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.055247 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.055375 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.055526 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.055662 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.055787 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.055915 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.056039 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.056250 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.056393 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.056523 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.056654 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.056781 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.056911 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.057038 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.057180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.057307 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.057434 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.057575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.057704 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.057844 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.057982 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.058062 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.058136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.058207 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.058207 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.058349 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.058489 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.058616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.058744 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.058873 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.058998 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.059136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.059136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.059384 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.059515 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.059613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.059613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] auth.external = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.059843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.059976 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.060106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.060106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.060377 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.060507 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] auth.external = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.060632 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.060811 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.060953 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] auth.password = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.060953 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] auth.token = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.061751 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.061883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.062023 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.062023 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] auth.password = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.062277 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.062379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] auth.token = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.062505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.062635 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.062764 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.062895 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.063026 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.063169 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.063297 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.063427 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.063559 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.063682 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.063804 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] credential.caching = True {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.063940 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.064069 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.064343 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.064488 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.064615 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] credential.caching = True {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.064743 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.064883 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.065007 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.065137 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.065271 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.065400 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.065527 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.065677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.065804 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.065929 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.066064 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.066178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.066291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.066431 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.066559 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.066682 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.066810 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.066937 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.067064 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.067309 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.067441 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.067569 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.067679 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.067820 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.067956 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.068084 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.068212 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] federation.caching = True {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.068341 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.068341 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.068341 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] federation.caching = True {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.068341 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.068897 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.069023 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.069023 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.069234 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.069352 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.069352 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.069568 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.069681 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.069681 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.069878 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.069987 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.069987 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.070196 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.070309 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.070435 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.070562 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.070562 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] identity.caching = True {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.070786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.070918 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.071033 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.071033 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.071252 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.071360 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.071481 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.071481 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.071816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.071950 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.072083 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] identity.caching = True {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.072306 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.072461 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.072581 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.072695 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.072812 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.072922 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.073046 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.073170 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.073278 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.073386 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.073493 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.073605 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.073711 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.073835 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.073941 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.074046 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.074155 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.074264 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.074373 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.074512 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.074641 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.074770 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.074897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.075023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.075153 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.075307 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.075441 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.075581 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.075709 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.075838 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.075969 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.076115 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.076272 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.076386 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.076517 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.076646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.076770 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.077039 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.077165 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.077291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.077418 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.077546 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.077689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.077819 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.077947 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.078072 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.078193 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.078315 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.078451 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.078577 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.078702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.078830 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.078952 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.079075 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.079210 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.079341 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.079477 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.079603 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.079714 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.079714 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.079923 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.080040 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.080340 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.080474 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.080603 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.080733 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.080881 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.081013 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.081144 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.081273 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.081413 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.081545 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.081691 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.081815 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.081895 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.081956 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.082016 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.082074 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.082142 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.082216 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.082277 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.082335 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.082394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.082451 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.082518 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.082579 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.082638 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.082697 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.082758 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.082866 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.user = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.083005 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.083135 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.083135 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.083369 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.083498 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.083625 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.083765 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.083894 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.084021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.084279 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.084413 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.084542 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.084689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.084818 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.user = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.084947 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.085080 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.085207 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.085335 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.085476 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.085632 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.085763 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.085888 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.086012 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.086140 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.086283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.086461 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.086591 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.086718 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.086846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.086982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.087122 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.087250 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.087377 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.087505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.087634 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.087759 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.087898 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.088025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.088155 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.088377 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.088507 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.088636 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.088785 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.088911 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.089029 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.089147 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.089269 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.089407 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.089529 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.089637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.089744 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.089867 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.089993 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.090121 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.090262 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.090390 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.090514 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.090640 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.090768 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.090898 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.091142 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.091273 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.091400 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.091400 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.091632 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.091758 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.091970 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.092102 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.092250 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.092374 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.093006 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.093135 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] resource.caching = True {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.093276 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.093406 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.093536 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.093665 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.093796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.093925 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.094073 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.094208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.094338 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.094466 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.094594 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.094740 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.094878 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.095008 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.095136 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.095259 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.095381 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] resource.caching = True {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.095522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.095651 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.095778 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] role.caching = True {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.095778 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] role.driver = sql {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.096000 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.096127 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.096355 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.096486 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.096616 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.096745 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.096877 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.096969 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.097042 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.097105 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.097193 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.097292 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.097420 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.097549 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.097689 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.097818 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.097947 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] role.caching = True {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.098074 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.098205 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] role.driver = sql {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.098205 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.098447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.098447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.098689 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.098819 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.098946 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.099076 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.099219 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.099219 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.099455 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.099552 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.099552 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.099702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.099845 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.099973 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.100101 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.100319 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.100451 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.100581 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.100726 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.100840 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.100954 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.101086 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.101208 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.101338 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.101480 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.101606 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.101606 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.101825 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.101937 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.102065 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.102181 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.102297 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.102414 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.102530 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.102530 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.102748 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.102861 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.102972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.103084 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.103195 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.103308 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.103433 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.103541 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.103631 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.103745 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.103857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.103969 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.104097 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.104237 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.104350 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] token.caching = True {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.104463 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.104572 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.104708 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.104866 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.104866 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.105050 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.105120 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.105180 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.105240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.105358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.105358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.105539 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.105656 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.105763 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.105841 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] token.caching = True {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.105913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.105974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.106047 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.106118 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.106189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.106260 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.106339 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.106401 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.106493 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.106624 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.106733 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.106821 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.106950 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.107062 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.107174 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.107304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.107434 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.107563 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.107705 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.107836 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.107968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] database.connection = **** {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.108200 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.108407 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.108548 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.108548 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.108790 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.108917 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.109134 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.109403 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.109534 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.109662 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.109774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.109774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.109996 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.110124 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.110255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] database.connection = **** {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.110397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.110538 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.110670 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.110908 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.111044 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.111150 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.111215 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.111275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.111342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.111466 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.111598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.111725 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.111855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.111984 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.112115 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.112351 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.112481 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.112609 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.112609 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.112841 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.112968 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.113111 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.113111 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 08:47:22.113347 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.113347 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.113347 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.113347 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.113347 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.113347 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.113347 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:47:22.113347 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 08:47:22.139177 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.139504 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.139645 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.139767 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.140108 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.140108 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.149204 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.149454 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.181301 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.181562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.181742 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.181979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.239632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.245352 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.295445 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.296266 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.296442 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.296573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.366142 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.366370 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.366522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.366684 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.366802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.366931 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.367057 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.367259 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.367389 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.367512 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.367639 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.367639 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.392728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.392950 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.393108 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.393232 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.393360 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.393484 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.393608 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.393742 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.393856 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.393982 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.394099 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.394215 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.394345 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.394345 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.406212 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.406484 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.421600 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.421942 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.422132 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.422276 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.422416 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.422555 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.422690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.422846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.422983 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.423118 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.423252 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.423386 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.423534 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.423744 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:47:22.443026 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.443279 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.443395 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 02 08:47:22.443515 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 02 08:47:22.443664 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.443775 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.443775 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 02 08:47:22.443967 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 02 08:47:22.444075 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.444219 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.444331 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.444438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.444571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.444686 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.444857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.444983 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.456809 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.457076 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.457228 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.457484 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.457666 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.457806 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.457944 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.458083 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.465255 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.465570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.471439 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.471726 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.471840 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.472037 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.472140 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.472345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.472510 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.472621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.472704 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.472889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.472998 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.473158 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.473257 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.473435 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.473532 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.473704 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.473858 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.473979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.474139 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.474235 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.474420 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.474815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.498724 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.500328 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.500619 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.501490 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.503100 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.503387 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.505467 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.505762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.506052 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.508926 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.509263 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.509606 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.513354 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.513653 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.517336 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.517638 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.518570 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.518874 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.519170 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.519457 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.519745 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.520047 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.520363 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.520637 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.522275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.522577 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.522873 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.523155 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.523431 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.523723 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.524021 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.524339 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.538082 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.538456 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.542201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.542567 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.542887 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.546419 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.546863 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.547035 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.550326 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.550637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.552110 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.555471 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.556218 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.559071 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.559848 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.560114 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.560523 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.560891 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.562193 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.562593 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.563138 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.563464 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.563755 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.564051 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.564362 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.564653 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.581154 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.581475 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.581748 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.582015 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.582443 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.582750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.583023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.583383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.589604 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.590533 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.591381 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.591732 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.592129 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.592559 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.595179 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.595373 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.595578 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.595721 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.595935 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.596097 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.596256 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.596509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.600575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.600719 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.608490 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.608787 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.608934 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.609077 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.609467 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.609625 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.609625 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.609878 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.610020 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.610158 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.610304 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.610598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.610967 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.611343 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.626796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.628562 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.630067 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.632152 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.633564 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.635957 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.636371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.637994 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.638309 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.638595 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.640338 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.642005 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.642392 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.642788 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.646885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.648618 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.650406 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.651761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.652141 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.652334 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.652479 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.652622 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.656009 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.656342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.656638 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.656915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.662379 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.662680 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.662968 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.665309 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.665613 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.665897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.670115 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.670405 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.671519 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.671701 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.671989 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.672295 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.672601 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.672850 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.673240 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.673525 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.673951 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:47:22.674655 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.674655 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.674917 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.674917 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.675171 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.675310 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.675463 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.675600 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.675600 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.675600 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.675961 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.676111 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.676378 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.676708 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.676986 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.677255 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.677514 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:47:22.709971 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5646496ac9c0 pid: 80406 (default app) Aug 02 08:47:22.711832 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5646496ac9c0 pid: 80407 (default app) Aug 02 08:47:22.713620 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b64bba-653c-4c79-868a-103145e970de None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:22.713912 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b64bba-653c-4c79-868a-103145e970de None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:22.714190 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b64bba-653c-4c79-868a-103145e970de None None] PATH_INFO: `/v3` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:22.719269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Tue Aug 2 08:47:22 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:47:33.964676 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2083c-f02d-499f-bfad-1afd2e3ca7fe None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:33.965333 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2083c-f02d-499f-bfad-1afd2e3ca7fe None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:33.965333 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2083c-f02d-499f-bfad-1afd2e3ca7fe None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:33.970636 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:47:33 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:47:33.978249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aabef-1507-4a1b-8c97-4d44ac130a26 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:33.978249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aabef-1507-4a1b-8c97-4d44ac130a26 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:33.978249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aabef-1507-4a1b-8c97-4d44ac130a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:34.054747 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: INFO dbcounter [None req-9e1aabef-1507-4a1b-8c97-4d44ac130a26 None None] Registered counter for database keystone Aug 02 08:47:34.079334 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG oslo_db.sqlalchemy.engines [None req-9e1aabef-1507-4a1b-8c97-4d44ac130a26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80406) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 08:47:34.086236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writer thread running {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 08:47:34.286988 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG passlib.handlers.bcrypt [None req-9e1aabef-1507-4a1b-8c97-4d44ac130a26 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80406) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 02 08:47:34.287717 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG passlib.handlers.bcrypt [None req-9e1aabef-1507-4a1b-8c97-4d44ac130a26 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80406) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 02 08:47:34.345783 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-9e1aabef-1507-4a1b-8c97-4d44ac130a26 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:34.347471 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-9e1aabef-1507-4a1b-8c97-4d44ac130a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:34.514655 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:47:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 538 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 02 08:47:34.610887 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2083c-f02d-499f-bfad-1afd2e3ca7fe None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:34.684312 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: INFO dbcounter [None req-67d2083c-f02d-499f-bfad-1afd2e3ca7fe None None] Registered counter for database keystone Aug 02 08:47:34.706076 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG oslo_db.sqlalchemy.engines [None req-67d2083c-f02d-499f-bfad-1afd2e3ca7fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 08:47:34.712797 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writer thread running {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 08:47:34.839327 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2083c-f02d-499f-bfad-1afd2e3ca7fe None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:34.844973 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435761d-9f4d-488e-a774-d1cde34bd31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:34.845641 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435761d-9f4d-488e-a774-d1cde34bd31f admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:34.845919 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435761d-9f4d-488e-a774-d1cde34bd31f admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:34.846191 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435761d-9f4d-488e-a774-d1cde34bd31f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:34.855489 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435761d-9f4d-488e-a774-d1cde34bd31f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:34.911396 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4435761d-9f4d-488e-a774-d1cde34bd31f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 02 08:47:34.911738 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435761d-9f4d-488e-a774-d1cde34bd31f admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:34.923496 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Tue Aug 2 08:47:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 02 08:47:34.929813 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1aabef-1507-4a1b-8c97-4d44ac130a26 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:34.945751 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1aabef-1507-4a1b-8c97-4d44ac130a26 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:34.950253 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d146b-b42f-45b0-92c3-5ed1aeb02d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:34.951537 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d146b-b42f-45b0-92c3-5ed1aeb02d88 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:34.951885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d146b-b42f-45b0-92c3-5ed1aeb02d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:34.952179 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d146b-b42f-45b0-92c3-5ed1aeb02d88 admin admin] PATH_INFO: `/v3/projects/4075c06a81874f9ca4b42e16828b98cd` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:34.953774 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d146b-b42f-45b0-92c3-5ed1aeb02d88 admin admin] RBAC: Authorizing `identity:get_project(project_id=4075c06a81874f9ca4b42e16828b98cd)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:35.006423 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3e4d146b-b42f-45b0-92c3-5ed1aeb02d88 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 02 08:47:35.007151 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d146b-b42f-45b0-92c3-5ed1aeb02d88 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:35.012306 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Tue Aug 2 08:47:34 2022] GET /identity/v3/projects/4075c06a81874f9ca4b42e16828b98cd => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:47:37.431374 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5009071-edb9-4247-8531-e0742df66945 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:37.432063 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5009071-edb9-4247-8531-e0742df66945 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:37.432063 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5009071-edb9-4247-8531-e0742df66945 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:37.436502 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:47:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:47:37.444836 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdd59e-625b-4e7d-b496-82cd2f6d283e None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:37.445626 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdd59e-625b-4e7d-b496-82cd2f6d283e None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:37.445799 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdd59e-625b-4e7d-b496-82cd2f6d283e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:37.471418 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-90cdd59e-625b-4e7d-b496-82cd2f6d283e None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:37.473073 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-90cdd59e-625b-4e7d-b496-82cd2f6d283e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:37.481812 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:47:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 02 08:47:37.504833 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5009071-edb9-4247-8531-e0742df66945 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:37.518634 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5009071-edb9-4247-8531-e0742df66945 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:37.523072 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e8656-8892-4ba4-a542-42c31028b081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:37.523740 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e8656-8892-4ba4-a542-42c31028b081 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:37.524064 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e8656-8892-4ba4-a542-42c31028b081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:37.524420 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e8656-8892-4ba4-a542-42c31028b081 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:37.535002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e8656-8892-4ba4-a542-42c31028b081 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:37.536765 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e8656-8892-4ba4-a542-42c31028b081 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:37.547733 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Tue Aug 2 08:47:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 08:47:37.553770 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdd59e-625b-4e7d-b496-82cd2f6d283e None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:37.564691 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdd59e-625b-4e7d-b496-82cd2f6d283e None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:37.569699 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef836d00-3159-4586-8f5d-a030d05feff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:37.570390 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef836d00-3159-4586-8f5d-a030d05feff0 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:37.570678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef836d00-3159-4586-8f5d-a030d05feff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:37.570960 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef836d00-3159-4586-8f5d-a030d05feff0 admin admin] PATH_INFO: `/v3/users/c124f3deb85b49f5a9becf0360ac8d93` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:37.572626 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef836d00-3159-4586-8f5d-a030d05feff0 admin admin] RBAC: Authorizing `identity:get_user(user_id=c124f3deb85b49f5a9becf0360ac8d93)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:37.574593 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef836d00-3159-4586-8f5d-a030d05feff0 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:37.577187 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Tue Aug 2 08:47:37 2022] GET /identity/v3/users/c124f3deb85b49f5a9becf0360ac8d93 => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:47:39.999142 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5715fce-d784-4762-9df4-42da2390e802 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:39.999740 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5715fce-d784-4762-9df4-42da2390e802 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:39.999740 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5715fce-d784-4762-9df4-42da2390e802 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:40.001221 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:47:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:47:40.008397 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b5879-df37-4795-a87e-197c42bd5dcf None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:40.008939 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b5879-df37-4795-a87e-197c42bd5dcf None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:40.009400 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b5879-df37-4795-a87e-197c42bd5dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:40.026278 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c247851-3773-4533-baec-6d322e49bd41 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:40.026567 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c247851-3773-4533-baec-6d322e49bd41 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:40.026859 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c247851-3773-4533-baec-6d322e49bd41 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:40.028503 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:47:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:47:40.035681 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8b677-49ab-4e77-9926-0371bdd237fc None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:40.036021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8b677-49ab-4e77-9926-0371bdd237fc None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:40.036274 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8b677-49ab-4e77-9926-0371bdd237fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:40.041700 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-6c5b5879-df37-4795-a87e-197c42bd5dcf None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:40.043488 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-6c5b5879-df37-4795-a87e-197c42bd5dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:40.085651 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG passlib.handlers.bcrypt [None req-a3e8b677-49ab-4e77-9926-0371bdd237fc None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80407) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 02 08:47:40.086071 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG passlib.handlers.bcrypt [None req-a3e8b677-49ab-4e77-9926-0371bdd237fc None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80407) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 02 08:47:40.134671 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-a3e8b677-49ab-4e77-9926-0371bdd237fc None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:40.136391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-a3e8b677-49ab-4e77-9926-0371bdd237fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:40.157731 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:47:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:47:40.198121 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b5879-df37-4795-a87e-197c42bd5dcf None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:40.244039 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:40.272144 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:47:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:47:40.293161 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8b677-49ab-4e77-9926-0371bdd237fc None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:40.372230 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b5879-df37-4795-a87e-197c42bd5dcf None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:40.421538 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8b677-49ab-4e77-9926-0371bdd237fc None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:40.424914 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:40.448695 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eaa3c8-d96b-4f01-88ef-9d63a580f91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:40.449692 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eaa3c8-d96b-4f01-88ef-9d63a580f91d None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:40.450105 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eaa3c8-d96b-4f01-88ef-9d63a580f91d None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:40.450598 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eaa3c8-d96b-4f01-88ef-9d63a580f91d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:40.488794 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ef428-0b96-49f1-8a32-6e60def5a8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:40.490824 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ef428-0b96-49f1-8a32-6e60def5a8f5 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:40.491337 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ef428-0b96-49f1-8a32-6e60def5a8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:40.491819 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ef428-0b96-49f1-8a32-6e60def5a8f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:40.517945 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7ef428-0b96-49f1-8a32-6e60def5a8f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:47:40.535373 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-bc7ef428-0b96-49f1-8a32-6e60def5a8f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:47:40.535373 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:47:40.535373 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:47:40.535373 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:47:40.535373 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:47:40.535373 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:47:40.535373 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:47:40.535373 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:47:40.535373 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:47:40.535373 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:47:40.535373 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:47:40.535373 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:47:40.535373 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:47:40.535373 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:47:40.535373 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:47:40.535373 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:47:40.536796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:47:40.536796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:47:40.536796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:47:40.536796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:47:40.536796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:47:40.536796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:47:40.536796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:47:40.536796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:47:40.536796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:47:40.536796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:47:40.536796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:47:40.536796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:47:40.536796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:47:40.536796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:47:40.536796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:47:40.536796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:47:40.538078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:47:40.538078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:47:40.538078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:47:40.538078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:47:40.538078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:47:40.538078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:47:40.538078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:47:40.538078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:47:40.538078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:47:40.538078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:47:40.538078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:47:40.538078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:47:40.538078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 8/14] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:47:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:47:40.547611 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eaa3c8-d96b-4f01-88ef-9d63a580f91d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:40.547874 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ef428-0b96-49f1-8a32-6e60def5a8f5 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:40.548914 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eaa3c8-d96b-4f01-88ef-9d63a580f91d None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:40.579423 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:40.698897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ef428-0b96-49f1-8a32-6e60def5a8f5 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:40.702045 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 7/15] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:47:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:47:40.708699 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eaa3c8-d96b-4f01-88ef-9d63a580f91d None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:40.752905 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0dc7b7-9ebc-4c46-8019-7f30380fdec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:40.754000 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dc7b7-9ebc-4c46-8019-7f30380fdec7 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:40.754491 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dc7b7-9ebc-4c46-8019-7f30380fdec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:40.754973 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dc7b7-9ebc-4c46-8019-7f30380fdec7 None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:40.756367 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0dc7b7-9ebc-4c46-8019-7f30380fdec7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:47:40.756874 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0dc7b7-9ebc-4c46-8019-7f30380fdec7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:40.759887 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0dc7b7-9ebc-4c46-8019-7f30380fdec7 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:40.790009 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 9/16] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:47:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:47:40.797267 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0dc7b7-9ebc-4c46-8019-7f30380fdec7 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:40.836837 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:40.850872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eaa3c8-d96b-4f01-88ef-9d63a580f91d None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:40.896046 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:40.915637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed342d40-bc30-4adf-ae15-a002d49b735d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:40.916723 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed342d40-bc30-4adf-ae15-a002d49b735d None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:40.917182 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed342d40-bc30-4adf-ae15-a002d49b735d None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:40.917638 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed342d40-bc30-4adf-ae15-a002d49b735d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:40.932680 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed342d40-bc30-4adf-ae15-a002d49b735d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:40.934232 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed342d40-bc30-4adf-ae15-a002d49b735d None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:40.945277 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0dc7b7-9ebc-4c46-8019-7f30380fdec7 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:40.957652 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-ed342d40-bc30-4adf-ae15-a002d49b735d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:47:40.957652 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:47:40.957652 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:47:40.957652 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:47:40.957652 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:47:40.957652 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:47:40.957652 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:47:40.957652 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:47:40.957652 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:47:40.957652 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:47:40.957652 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:47:40.957652 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:47:40.957652 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:47:40.957652 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:47:40.957652 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:47:40.959465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:47:40.959465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:47:40.959465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:47:40.959465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:47:40.959465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:47:40.959465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:47:40.959465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:47:40.959465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:47:40.959465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:47:40.959465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:47:40.959465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:47:40.959465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:47:40.959465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:47:40.959465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:47:40.959465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:47:40.959465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:47:40.959465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:47:40.960878 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:47:40.960878 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:47:40.960878 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:47:40.960878 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:47:40.960878 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 8/17] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:47:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:47:40.965664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed342d40-bc30-4adf-ae15-a002d49b735d None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:41.001168 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc0849-aeff-45c5-af27-e9a0fe0247cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:41.001984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc0849-aeff-45c5-af27-e9a0fe0247cc None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:41.002279 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc0849-aeff-45c5-af27-e9a0fe0247cc None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:41.002559 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc0849-aeff-45c5-af27-e9a0fe0247cc None admin] PATH_INFO: `/v3/users/c124f3deb85b49f5a9becf0360ac8d93` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:41.004505 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc0849-aeff-45c5-af27-e9a0fe0247cc None admin] RBAC: Authorizing `identity:get_user(user_id=c124f3deb85b49f5a9becf0360ac8d93)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:41.006164 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc0849-aeff-45c5-af27-e9a0fe0247cc None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:41.008840 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 10/18] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:47:40 2022] GET /identity/v3/users/c124f3deb85b49f5a9becf0360ac8d93 => generated 247 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:47:41.015086 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc0849-aeff-45c5-af27-e9a0fe0247cc None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:41.144903 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:41.156091 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc0849-aeff-45c5-af27-e9a0fe0247cc None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:41.219650 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e6196-6c0a-410a-96be-a8279a193c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:41.220776 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e6196-6c0a-410a-96be-a8279a193c88 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:41.221187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e6196-6c0a-410a-96be-a8279a193c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:41.221610 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e6196-6c0a-410a-96be-a8279a193c88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:41.223636 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e6196-6c0a-410a-96be-a8279a193c88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:41.226489 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e6196-6c0a-410a-96be-a8279a193c88 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:41.234822 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 11/19] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:47:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:47:41.236853 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e6196-6c0a-410a-96be-a8279a193c88 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:41.240596 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed342d40-bc30-4adf-ae15-a002d49b735d None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:41.293450 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f127a25-5edf-404b-967e-059883f1c3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:41.294168 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f127a25-5edf-404b-967e-059883f1c3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:41.294495 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f127a25-5edf-404b-967e-059883f1c3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:41.294866 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f127a25-5edf-404b-967e-059883f1c3f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:41.295916 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f127a25-5edf-404b-967e-059883f1c3f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:47:41.296250 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f127a25-5edf-404b-967e-059883f1c3f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:41.297691 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f127a25-5edf-404b-967e-059883f1c3f8 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:41.319395 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 9/20] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:47:41.412093 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e6196-6c0a-410a-96be-a8279a193c88 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:41.458859 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bef1ee-c526-4419-b0f0-99bb70f21ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:41.459503 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bef1ee-c526-4419-b0f0-99bb70f21ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:41.459783 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bef1ee-c526-4419-b0f0-99bb70f21ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:41.460065 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bef1ee-c526-4419-b0f0-99bb70f21ba2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:41.461111 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bef1ee-c526-4419-b0f0-99bb70f21ba2 None admin] RBAC: Adding query filter params (role.id=b5477d3c4e5a4514b64211ec2452d1d8, scope.domain.id=default, user.id=c124f3deb85b49f5a9becf0360ac8d93) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:47:41.461579 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bef1ee-c526-4419-b0f0-99bb70f21ba2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:41.462924 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bef1ee-c526-4419-b0f0-99bb70f21ba2 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:41.474039 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 12/21] 10.222.0.20 () {56 vars in 1322 bytes} [Tue Aug 2 08:47:41 2022] GET /identity/v3/role_assignments?user.id=c124f3deb85b49f5a9becf0360ac8d93&scope.domain.id=default&role.id=b5477d3c4e5a4514b64211ec2452d1d8 => generated 233 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:47:44.448569 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752c3a6-9d87-4c98-a03c-b3364995aaff None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:44.449641 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752c3a6-9d87-4c98-a03c-b3364995aaff None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:44.450153 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752c3a6-9d87-4c98-a03c-b3364995aaff None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:44.452753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 10/22] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:47:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:47:44.458616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e50cd-c06d-4c47-aab6-20d0f0737a4f None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:44.459564 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e50cd-c06d-4c47-aab6-20d0f0737a4f None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:44.460042 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e50cd-c06d-4c47-aab6-20d0f0737a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:44.497018 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-887e50cd-c06d-4c47-aab6-20d0f0737a4f None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:44.499203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-887e50cd-c06d-4c47-aab6-20d0f0737a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:44.542824 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:44.611749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 13/23] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:47:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:47:44.630123 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d1e98-8fec-4b1a-9ddb-3928e9c8f7a7 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:44.630797 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d1e98-8fec-4b1a-9ddb-3928e9c8f7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:44.631403 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d1e98-8fec-4b1a-9ddb-3928e9c8f7a7 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:44.633909 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 11/24] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:47:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:47:44.640585 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6be335-a59b-4778-900b-28d1659fd6ca None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:44.640921 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6be335-a59b-4778-900b-28d1659fd6ca None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:44.641144 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6be335-a59b-4778-900b-28d1659fd6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:44.644552 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d1e98-8fec-4b1a-9ddb-3928e9c8f7a7 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:44.666363 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-4d6be335-a59b-4778-900b-28d1659fd6ca None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:44.667666 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-4d6be335-a59b-4778-900b-28d1659fd6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:44.749548 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:44.818843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 14/25] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:47:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:47:44.861686 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6be335-a59b-4778-900b-28d1659fd6ca None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:44.922025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d1e98-8fec-4b1a-9ddb-3928e9c8f7a7 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:44.994366 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8edac8-2288-49aa-b9e3-6aaf4acfc6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:44.995506 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8edac8-2288-49aa-b9e3-6aaf4acfc6b9 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:44.997347 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8edac8-2288-49aa-b9e3-6aaf4acfc6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:44.998377 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8edac8-2288-49aa-b9e3-6aaf4acfc6b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:45.029896 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8edac8-2288-49aa-b9e3-6aaf4acfc6b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:47:45.037547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-5a8edac8-2288-49aa-b9e3-6aaf4acfc6b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:47:45.037547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:47:45.037547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:47:45.037547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:47:45.037547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:47:45.037547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:47:45.037547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:47:45.037547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:47:45.037547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:47:45.037547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:47:45.037547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:47:45.037547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:47:45.037547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:47:45.037547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:47:45.037547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:47:45.037547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:47:45.038698 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:47:45.038698 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:47:45.038698 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:47:45.038698 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:47:45.038698 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:47:45.038698 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:47:45.038698 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:47:45.038698 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:47:45.038698 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:47:45.038698 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:47:45.038698 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:47:45.038698 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:47:45.038698 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:47:45.038698 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:47:45.038698 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:47:45.038698 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:47:45.039585 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:47:45.039585 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:47:45.039585 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:47:45.039585 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:47:45.039585 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:47:45.039585 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:47:45.039585 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:47:45.039585 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:47:45.039585 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:47:45.039585 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:47:45.039585 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:47:45.039585 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:47:45.039585 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 12/26] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:47:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:47:45.048420 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8edac8-2288-49aa-b9e3-6aaf4acfc6b9 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:45.061980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:45.102414 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6be335-a59b-4778-900b-28d1659fd6ca None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:45.220918 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:45.224529 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8edac8-2288-49aa-b9e3-6aaf4acfc6b9 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:45.268075 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f00c2-aec8-48b3-b790-1ac00d3fcef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:45.269423 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f00c2-aec8-48b3-b790-1ac00d3fcef3 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:45.269951 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f00c2-aec8-48b3-b790-1ac00d3fcef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:45.270479 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f00c2-aec8-48b3-b790-1ac00d3fcef3 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:45.273786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f00c2-aec8-48b3-b790-1ac00d3fcef3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:47:45.273786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f00c2-aec8-48b3-b790-1ac00d3fcef3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:45.274545 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f00c2-aec8-48b3-b790-1ac00d3fcef3 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:45.282983 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa395e-cf2f-4dad-89af-01e885cc6b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:45.284018 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa395e-cf2f-4dad-89af-01e885cc6b92 None admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:45.284582 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa395e-cf2f-4dad-89af-01e885cc6b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:45.285078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa395e-cf2f-4dad-89af-01e885cc6b92 None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:45.286131 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa395e-cf2f-4dad-89af-01e885cc6b92 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:45.287879 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa395e-cf2f-4dad-89af-01e885cc6b92 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:45.301735 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 13/27] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:47:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:47:45.304657 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c11a88-b73a-4509-8607-2fd7ea1140aa None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:45.310775 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c11a88-b73a-4509-8607-2fd7ea1140aa None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:45.310775 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c11a88-b73a-4509-8607-2fd7ea1140aa None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:45.310775 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 14/28] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:47:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:47:45.311729 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a05fc9-803e-42cb-bae3-931f39da04d2 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:45.312529 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a05fc9-803e-42cb-bae3-931f39da04d2 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:45.313254 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a05fc9-803e-42cb-bae3-931f39da04d2 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:45.316234 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 15/29] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:47:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:47:45.317704 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a05fc9-803e-42cb-bae3-931f39da04d2 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:45.461837 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a05fc9-803e-42cb-bae3-931f39da04d2 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:45.544220 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f351ace-c121-4aac-9125-b67a0a921277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:45.545492 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f351ace-c121-4aac-9125-b67a0a921277 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:45.546065 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f351ace-c121-4aac-9125-b67a0a921277 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:45.546483 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f351ace-c121-4aac-9125-b67a0a921277 None admin] PATH_INFO: `/v3/users/c124f3deb85b49f5a9becf0360ac8d93` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:45.548119 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f351ace-c121-4aac-9125-b67a0a921277 None admin] RBAC: Authorizing `identity:get_user(user_id=c124f3deb85b49f5a9becf0360ac8d93)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:45.549864 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f351ace-c121-4aac-9125-b67a0a921277 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:45.550044 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 15/30] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Aug 2 08:47:44 2022] POST /identity/v3/roles => generated 219 bytes in 689 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:47:45.551773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3585a-3f5c-4081-9b21-d2f7eec0bddd None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:45.552073 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3585a-3f5c-4081-9b21-d2f7eec0bddd None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:45.552405 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3585a-3f5c-4081-9b21-d2f7eec0bddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:45.553203 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 16/31] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:47:45 2022] GET /identity/v3/users/c124f3deb85b49f5a9becf0360ac8d93 => generated 247 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:47:45.555119 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28c776-8409-4f69-827c-8937fc60675b None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:45.555859 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28c776-8409-4f69-827c-8937fc60675b None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:45.556479 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28c776-8409-4f69-827c-8937fc60675b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:45.576109 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-08d3585a-3f5c-4081-9b21-d2f7eec0bddd None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:45.578279 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-08d3585a-3f5c-4081-9b21-d2f7eec0bddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:45.583905 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-be28c776-8409-4f69-827c-8937fc60675b None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:45.585523 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-be28c776-8409-4f69-827c-8937fc60675b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:45.615402 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:45.680187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 16/32] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:47:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:47:45.681715 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3585a-3f5c-4081-9b21-d2f7eec0bddd None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:45.717807 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 17/33] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:47:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:47:45.723117 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28c776-8409-4f69-827c-8937fc60675b None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:45.808514 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:45.846650 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3585a-3f5c-4081-9b21-d2f7eec0bddd None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:45.886138 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28c776-8409-4f69-827c-8937fc60675b None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:45.890859 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3451d-251f-4bd4-bc1d-297b9655c1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:45.891615 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3451d-251f-4bd4-bc1d-297b9655c1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:45.891904 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3451d-251f-4bd4-bc1d-297b9655c1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:45.892216 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3451d-251f-4bd4-bc1d-297b9655c1d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:45.893521 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3451d-251f-4bd4-bc1d-297b9655c1d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:45.895363 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3451d-251f-4bd4-bc1d-297b9655c1d9 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:45.897565 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 17/34] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:47:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:47:45.898674 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3451d-251f-4bd4-bc1d-297b9655c1d9 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:45.945485 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab356b7f-82d2-4eda-8fe4-58fc5b7bf352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:45.946287 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab356b7f-82d2-4eda-8fe4-58fc5b7bf352 None admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:45.946460 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab356b7f-82d2-4eda-8fe4-58fc5b7bf352 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:45.946698 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab356b7f-82d2-4eda-8fe4-58fc5b7bf352 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:45.947487 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab356b7f-82d2-4eda-8fe4-58fc5b7bf352 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:45.949020 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab356b7f-82d2-4eda-8fe4-58fc5b7bf352 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:46.054235 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3451d-251f-4bd4-bc1d-297b9655c1d9 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:46.110447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac30735-38e3-4fdf-b8b6-328adfdfa402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:46.111625 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac30735-38e3-4fdf-b8b6-328adfdfa402 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:46.112328 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac30735-38e3-4fdf-b8b6-328adfdfa402 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:46.112826 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac30735-38e3-4fdf-b8b6-328adfdfa402 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:46.143168 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac30735-38e3-4fdf-b8b6-328adfdfa402 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:46.145251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac30735-38e3-4fdf-b8b6-328adfdfa402 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:46.149637 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:46.171520 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-7ac30735-38e3-4fdf-b8b6-328adfdfa402 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:47:46.171520 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:47:46.171520 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:47:46.171520 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:47:46.171520 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:47:46.171520 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:47:46.171520 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:47:46.171520 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:47:46.171520 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:47:46.171520 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:47:46.171520 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:47:46.171520 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:47:46.171520 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:47:46.171520 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:47:46.171520 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:47:46.172439 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:47:46.172439 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:47:46.172439 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:47:46.172439 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:47:46.172439 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:47:46.172439 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:47:46.172439 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:47:46.172439 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:47:46.172439 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:47:46.172439 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:47:46.172439 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:47:46.172439 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:47:46.172439 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:47:46.172439 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:47:46.172439 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:47:46.172439 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:47:46.172439 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:47:46.173442 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:47:46.173442 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:47:46.173442 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:47:46.173442 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:47:46.174313 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 18/35] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:47:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:47:46.175096 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac30735-38e3-4fdf-b8b6-328adfdfa402 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:46.181253 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 18/36] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Aug 2 08:47:45 2022] POST /identity/v3/roles => generated 225 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:47:46.186460 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab356b7f-82d2-4eda-8fe4-58fc5b7bf352 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:46.209926 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:46.369853 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab356b7f-82d2-4eda-8fe4-58fc5b7bf352 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:46.373791 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac30735-38e3-4fdf-b8b6-328adfdfa402 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:46.416899 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179820c6-81a2-449c-859e-f6abcaf4e260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:46.420064 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179820c6-81a2-449c-859e-f6abcaf4e260 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:46.420721 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179820c6-81a2-449c-859e-f6abcaf4e260 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:46.421209 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179820c6-81a2-449c-859e-f6abcaf4e260 None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:46.422234 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179820c6-81a2-449c-859e-f6abcaf4e260 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:47:46.422780 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179820c6-81a2-449c-859e-f6abcaf4e260 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:46.424769 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179820c6-81a2-449c-859e-f6abcaf4e260 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:46.427612 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68380a1-9379-4625-a5bc-44fba7392492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:46.428367 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68380a1-9379-4625-a5bc-44fba7392492 None admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:46.428653 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68380a1-9379-4625-a5bc-44fba7392492 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:46.428937 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68380a1-9379-4625-a5bc-44fba7392492 None admin] PATH_INFO: `/v3/domains/default/users/c124f3deb85b49f5a9becf0360ac8d93/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:46.432043 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68380a1-9379-4625-a5bc-44fba7392492 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c124f3deb85b49f5a9becf0360ac8d93, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:46.433698 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68380a1-9379-4625-a5bc-44fba7392492 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:46.448100 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 19/37] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:47:46.448100 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83e37b-759a-4985-8a2c-705b0567d9b1 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:46.448100 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83e37b-759a-4985-8a2c-705b0567d9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:46.448100 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83e37b-759a-4985-8a2c-705b0567d9b1 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:46.452394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 20/38] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:47:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:47:46.452394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa83e37b-759a-4985-8a2c-705b0567d9b1 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:46.542488 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 19/39] 10.222.0.20 () {58 vars in 1361 bytes} [Tue Aug 2 08:47:46 2022] PUT /identity/v3/domains/default/users/c124f3deb85b49f5a9becf0360ac8d93/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:47:46.543740 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65596d5e-5624-47b0-9409-93361575d75a None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:46.544686 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65596d5e-5624-47b0-9409-93361575d75a None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:46.544865 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65596d5e-5624-47b0-9409-93361575d75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:46.572542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-65596d5e-5624-47b0-9409-93361575d75a None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:46.577943 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-65596d5e-5624-47b0-9409-93361575d75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:46.599067 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:46.644691 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa83e37b-759a-4985-8a2c-705b0567d9b1 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:46.668311 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:46.700729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 20/40] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:47:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:47:46.705249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf89a2a-ba63-4806-903a-bdee6c7316a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:46.706289 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf89a2a-ba63-4806-903a-bdee6c7316a5 None admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:46.706717 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf89a2a-ba63-4806-903a-bdee6c7316a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:46.707136 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf89a2a-ba63-4806-903a-bdee6c7316a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:46.708576 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf89a2a-ba63-4806-903a-bdee6c7316a5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:46.710409 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf89a2a-ba63-4806-903a-bdee6c7316a5 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:46.743336 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65596d5e-5624-47b0-9409-93361575d75a None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:46.846112 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 21/41] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Aug 2 08:47:46 2022] POST /identity/v3/projects => generated 301 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:47:46.940749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65596d5e-5624-47b0-9409-93361575d75a None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:47.003475 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b69163-1461-487a-b38d-609ce8871dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:47.004968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b69163-1461-487a-b38d-609ce8871dd9 None admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:47.005708 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b69163-1461-487a-b38d-609ce8871dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:47.006383 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b69163-1461-487a-b38d-609ce8871dd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:47.008241 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b69163-1461-487a-b38d-609ce8871dd9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:47.010867 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b69163-1461-487a-b38d-609ce8871dd9 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:47.054190 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df235e6c-2d2a-4cf0-ade1-e915da92e9eb None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:47.054634 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df235e6c-2d2a-4cf0-ade1-e915da92e9eb None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:47.055044 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df235e6c-2d2a-4cf0-ade1-e915da92e9eb None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:47.057412 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 22/42] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:47:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:47:47.066575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbef44-e0a6-4190-a53e-cdaecda961cb None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:47.067024 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbef44-e0a6-4190-a53e-cdaecda961cb None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:47.070992 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbef44-e0a6-4190-a53e-cdaecda961cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:47.098819 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-30dbef44-e0a6-4190-a53e-cdaecda961cb None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:47.101579 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-30dbef44-e0a6-4190-a53e-cdaecda961cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:47.115955 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 21/43] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Aug 2 08:47:46 2022] POST /identity/v3/roles => generated 223 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:47:47.231937 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 23/44] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:47:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:47:47.270894 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b69163-1461-487a-b38d-609ce8871dd9 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:47.344867 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:47.439967 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b69163-1461-487a-b38d-609ce8871dd9 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:47.501457 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f5f36-042d-4dde-876f-2593e30c3aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:47.501457 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f5f36-042d-4dde-876f-2593e30c3aca None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:47.501457 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f5f36-042d-4dde-876f-2593e30c3aca None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:47.501457 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f5f36-042d-4dde-876f-2593e30c3aca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:47.502991 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f5f36-042d-4dde-876f-2593e30c3aca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:47.504630 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f5f36-042d-4dde-876f-2593e30c3aca None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:47.507142 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 22/45] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:47:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:47:47.516909 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dbef44-e0a6-4190-a53e-cdaecda961cb None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:47.596229 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:47.684355 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dbef44-e0a6-4190-a53e-cdaecda961cb None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:47.752911 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c383392-c2de-441b-9e41-cb2b49852b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:47.753926 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c383392-c2de-441b-9e41-cb2b49852b35 None admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:47.754439 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c383392-c2de-441b-9e41-cb2b49852b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:47.754947 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c383392-c2de-441b-9e41-cb2b49852b35 None admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:47.756275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c383392-c2de-441b-9e41-cb2b49852b35 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:47.759363 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c383392-c2de-441b-9e41-cb2b49852b35 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:47.878480 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Aug 2 08:47:47 2022] POST /identity/v3/projects => generated 312 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:47:48.868283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0082f8-4c46-432b-ad20-954cddbe0697 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:48.869127 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0082f8-4c46-432b-ad20-954cddbe0697 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:48.869274 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0082f8-4c46-432b-ad20-954cddbe0697 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:48.871649 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 23/47] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:47:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:47:48.881295 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd19258-2f07-4d7e-b74c-ce79227cfba5 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:48.882090 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd19258-2f07-4d7e-b74c-ce79227cfba5 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:48.882643 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd19258-2f07-4d7e-b74c-ce79227cfba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:48.913536 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-1bd19258-2f07-4d7e-b74c-ce79227cfba5 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:48.915593 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-1bd19258-2f07-4d7e-b74c-ce79227cfba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:49.020230 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 25/48] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:47:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:47:49.047274 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0082f8-4c46-432b-ad20-954cddbe0697 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:49.245734 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0082f8-4c46-432b-ad20-954cddbe0697 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:49.267297 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:49.297939 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479fd06-31ee-4c56-a0c9-ed0862f7c0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:49.298616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479fd06-31ee-4c56-a0c9-ed0862f7c0c3 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:49.298909 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479fd06-31ee-4c56-a0c9-ed0862f7c0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:49.299189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479fd06-31ee-4c56-a0c9-ed0862f7c0c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:49.314731 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1479fd06-31ee-4c56-a0c9-ed0862f7c0c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:47:49.320374 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-1479fd06-31ee-4c56-a0c9-ed0862f7c0c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:47:49.320374 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:47:49.320374 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:47:49.320374 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:47:49.320374 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:47:49.320374 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:47:49.320374 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:47:49.320374 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:47:49.320374 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:47:49.320374 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:47:49.320374 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:47:49.320374 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:47:49.320374 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:47:49.320374 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:47:49.320374 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:47:49.320374 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:47:49.322027 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:47:49.322027 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:47:49.322027 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:47:49.322027 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:47:49.322027 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:47:49.322027 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:47:49.322027 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:47:49.322027 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:47:49.322027 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:47:49.322027 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:47:49.322027 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:47:49.322027 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:47:49.322027 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:47:49.322027 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:47:49.322027 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:47:49.322027 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:47:49.323984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:47:49.323984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:47:49.323984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:47:49.323984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:47:49.323984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:47:49.323984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:47:49.323984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:47:49.323984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:47:49.323984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:47:49.323984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:47:49.323984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:47:49.323984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:47:49.323984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 24/49] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:47:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:47:49.329164 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd19258-2f07-4d7e-b74c-ce79227cfba5 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:49.389987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:49.471889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd19258-2f07-4d7e-b74c-ce79227cfba5 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:49.515794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bcfba-e9f2-4cea-8dfe-184759bbc7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:49.516390 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bcfba-e9f2-4cea-8dfe-184759bbc7d6 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:49.516731 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bcfba-e9f2-4cea-8dfe-184759bbc7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:49.516955 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bcfba-e9f2-4cea-8dfe-184759bbc7d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:49.517805 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bcfba-e9f2-4cea-8dfe-184759bbc7d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:47:49.518124 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bcfba-e9f2-4cea-8dfe-184759bbc7d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:49.519585 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bcfba-e9f2-4cea-8dfe-184759bbc7d6 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:49.530051 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 26/50] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:47:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:47:49.535932 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479fd06-31ee-4c56-a0c9-ed0862f7c0c3 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:49.658319 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479fd06-31ee-4c56-a0c9-ed0862f7c0c3 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:49.701792 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7416cfc-d92a-4381-abfd-a0c2654333e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:49.702563 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7416cfc-d92a-4381-abfd-a0c2654333e1 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:49.702914 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7416cfc-d92a-4381-abfd-a0c2654333e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:49.703192 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7416cfc-d92a-4381-abfd-a0c2654333e1 None admin] PATH_INFO: `/v3/users/c124f3deb85b49f5a9becf0360ac8d93` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:49.704820 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7416cfc-d92a-4381-abfd-a0c2654333e1 None admin] RBAC: Authorizing `identity:get_user(user_id=c124f3deb85b49f5a9becf0360ac8d93)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:49.706567 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7416cfc-d92a-4381-abfd-a0c2654333e1 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:49.708399 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 25/51] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:47:49 2022] GET /identity/v3/users/c124f3deb85b49f5a9becf0360ac8d93 => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:47:49.714616 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bcfba-e9f2-4cea-8dfe-184759bbc7d6 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:49.852421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:49.857422 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bcfba-e9f2-4cea-8dfe-184759bbc7d6 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:49.904554 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322926ea-fc76-482a-86ac-3b08d053fa8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:49.905332 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322926ea-fc76-482a-86ac-3b08d053fa8e None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:49.905622 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322926ea-fc76-482a-86ac-3b08d053fa8e None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:49.905903 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322926ea-fc76-482a-86ac-3b08d053fa8e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:49.907199 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322926ea-fc76-482a-86ac-3b08d053fa8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:49.908862 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322926ea-fc76-482a-86ac-3b08d053fa8e None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:49.910653 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 27/52] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:47:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:47:49.917422 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7416cfc-d92a-4381-abfd-a0c2654333e1 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:49.973799 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:50.041200 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7416cfc-d92a-4381-abfd-a0c2654333e1 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:50.085361 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831c2fa-1392-4b43-a662-4bdaf77a5fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:50.086002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831c2fa-1392-4b43-a662-4bdaf77a5fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:50.086368 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831c2fa-1392-4b43-a662-4bdaf77a5fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:50.086760 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831c2fa-1392-4b43-a662-4bdaf77a5fe0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:50.087805 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831c2fa-1392-4b43-a662-4bdaf77a5fe0 None admin] RBAC: Adding query filter params (role.id=b5477d3c4e5a4514b64211ec2452d1d8, scope.domain.id=default, user.id=c124f3deb85b49f5a9becf0360ac8d93) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:47:50.088115 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831c2fa-1392-4b43-a662-4bdaf77a5fe0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:50.089657 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831c2fa-1392-4b43-a662-4bdaf77a5fe0 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:50.098376 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1322 bytes} [Tue Aug 2 08:47:49 2022] GET /identity/v3/role_assignments?user.id=c124f3deb85b49f5a9becf0360ac8d93&scope.domain.id=default&role.id=b5477d3c4e5a4514b64211ec2452d1d8 => generated 530 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:47:50.223651 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7b8ce-6ac7-4b5e-9c67-b7e9d4798e6c None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:50.224274 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7b8ce-6ac7-4b5e-9c67-b7e9d4798e6c None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:50.224818 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7b8ce-6ac7-4b5e-9c67-b7e9d4798e6c None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:50.227627 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 28/54] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:47:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:47:50.235014 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0b9b6-dae5-45f8-8372-95e4a44b8e0b None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:50.235519 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0b9b6-dae5-45f8-8372-95e4a44b8e0b None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:50.235954 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0b9b6-dae5-45f8-8372-95e4a44b8e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:50.258813 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-6dd0b9b6-dae5-45f8-8372-95e4a44b8e0b None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:50.260200 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-6dd0b9b6-dae5-45f8-8372-95e4a44b8e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:50.368912 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 27/55] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:47:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:47:50.393864 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7b8ce-6ac7-4b5e-9c67-b7e9d4798e6c None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:50.545513 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7b8ce-6ac7-4b5e-9c67-b7e9d4798e6c None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:50.589967 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820092c-c698-4c26-970b-364c3fe1421e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:50.590689 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820092c-c698-4c26-970b-364c3fe1421e None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:50.591071 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820092c-c698-4c26-970b-364c3fe1421e None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:50.591393 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820092c-c698-4c26-970b-364c3fe1421e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:50.592785 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820092c-c698-4c26-970b-364c3fe1421e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:50.594496 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820092c-c698-4c26-970b-364c3fe1421e None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:50.596236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 29/56] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:47:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:47:50.602352 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0b9b6-dae5-45f8-8372-95e4a44b8e0b None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:50.642671 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:50.724387 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0b9b6-dae5-45f8-8372-95e4a44b8e0b None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:50.763906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4e16e-b824-4d10-87b8-6ce26a8f0c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:50.764722 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4e16e-b824-4d10-87b8-6ce26a8f0c3f None admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:50.765087 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4e16e-b824-4d10-87b8-6ce26a8f0c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:50.765449 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4e16e-b824-4d10-87b8-6ce26a8f0c3f None admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:50.766254 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4e16e-b824-4d10-87b8-6ce26a8f0c3f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:50.767855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4e16e-b824-4d10-87b8-6ce26a8f0c3f None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:50.899452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 28/57] 10.222.0.20 () {60 vars in 1140 bytes} [Tue Aug 2 08:47:50 2022] POST /identity/v3/projects => generated 298 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:47:53.052540 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7968e8-484c-4e8b-b6b1-a778fa43038b None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:53.053319 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7968e8-484c-4e8b-b6b1-a778fa43038b None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:53.053319 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7968e8-484c-4e8b-b6b1-a778fa43038b None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:53.054646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 30/58] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:47:53.061389 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5eb6a2-24e7-475d-bb21-b9a75b459e60 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:53.062142 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5eb6a2-24e7-475d-bb21-b9a75b459e60 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:53.062312 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5eb6a2-24e7-475d-bb21-b9a75b459e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:53.082657 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-0b5eb6a2-24e7-475d-bb21-b9a75b459e60 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:53.083868 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-0b5eb6a2-24e7-475d-bb21-b9a75b459e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:53.166826 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 29/59] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:47:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:47:53.192976 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7968e8-484c-4e8b-b6b1-a778fa43038b None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:53.243688 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:53.328552 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7968e8-484c-4e8b-b6b1-a778fa43038b None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:53.366216 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894fd31-d4a4-482a-8f15-fdf5f843140d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:53.366864 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894fd31-d4a4-482a-8f15-fdf5f843140d None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:53.367147 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894fd31-d4a4-482a-8f15-fdf5f843140d None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:53.367457 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894fd31-d4a4-482a-8f15-fdf5f843140d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:53.369032 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894fd31-d4a4-482a-8f15-fdf5f843140d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:53.370850 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894fd31-d4a4-482a-8f15-fdf5f843140d None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:53.373659 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 31/60] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:47:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:47:53.379457 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5eb6a2-24e7-475d-bb21-b9a75b459e60 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:53.402343 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:53.511226 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5eb6a2-24e7-475d-bb21-b9a75b459e60 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:53.554370 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b20f6b-22d1-4549-878d-6ad3f701f664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:53.555006 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b20f6b-22d1-4549-878d-6ad3f701f664 None admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:53.555321 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b20f6b-22d1-4549-878d-6ad3f701f664 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:53.555575 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b20f6b-22d1-4549-878d-6ad3f701f664 None admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:53.556320 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b20f6b-22d1-4549-878d-6ad3f701f664 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:53.557956 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b20f6b-22d1-4549-878d-6ad3f701f664 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:53.652715 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 30/61] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Aug 2 08:47:53 2022] POST /identity/v3/users => generated 275 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:47:57.679096 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8f824-765a-4db2-9074-b0209c7d5eb0 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:57.679840 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8f824-765a-4db2-9074-b0209c7d5eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:57.680103 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8f824-765a-4db2-9074-b0209c7d5eb0 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:57.683213 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 32/62] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:47:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:47:57.690949 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8a79b-7f2c-4bec-9a00-4de196881636 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:57.692559 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8a79b-7f2c-4bec-9a00-4de196881636 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:57.693340 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8a79b-7f2c-4bec-9a00-4de196881636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:57.739152 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-10d8a79b-7f2c-4bec-9a00-4de196881636 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:57.741819 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-10d8a79b-7f2c-4bec-9a00-4de196881636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:57.881006 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 31/63] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:47:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:47:57.942619 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8f824-765a-4db2-9074-b0209c7d5eb0 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:58.121471 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8f824-765a-4db2-9074-b0209c7d5eb0 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:58.128619 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:58.214449 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e37963-8228-4d09-bcde-519d50faa36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:58.215500 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e37963-8228-4d09-bcde-519d50faa36c None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:58.216044 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e37963-8228-4d09-bcde-519d50faa36c None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:58.216598 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e37963-8228-4d09-bcde-519d50faa36c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:58.238363 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e37963-8228-4d09-bcde-519d50faa36c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:47:58.249760 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-60e37963-8228-4d09-bcde-519d50faa36c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:47:58.249760 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:47:58.249760 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:47:58.249760 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:47:58.249760 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:47:58.249760 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:47:58.249760 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:47:58.249760 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:47:58.249760 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:47:58.249760 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:47:58.249760 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:47:58.249760 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:47:58.249760 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:47:58.249760 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:47:58.249760 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:47:58.249760 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:47:58.250682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:47:58.250682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:47:58.250682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:47:58.250682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:47:58.250682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:47:58.250682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:47:58.250682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:47:58.250682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:47:58.250682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:47:58.250682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:47:58.250682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:47:58.250682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:47:58.250682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:47:58.250682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:47:58.250682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:47:58.250682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:47:58.251464 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:47:58.251464 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:47:58.251464 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:47:58.251464 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:47:58.251464 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:47:58.251464 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:47:58.251464 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:47:58.251464 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:47:58.251464 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:47:58.251464 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:47:58.251464 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:47:58.251464 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:47:58.252043 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 33/64] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Aug 2 08:47:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:47:58.261916 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8a79b-7f2c-4bec-9a00-4de196881636 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:58.286696 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:58.423216 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236af77-1ce3-4c25-9396-1919647bdae6 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:58.423784 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236af77-1ce3-4c25-9396-1919647bdae6 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:58.424328 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236af77-1ce3-4c25-9396-1919647bdae6 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:58.426970 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 34/65] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:47:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:47:58.433234 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6671783-cf9a-4a34-9360-c5030c61f4ba None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:58.433958 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6671783-cf9a-4a34-9360-c5030c61f4ba None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:58.435067 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6671783-cf9a-4a34-9360-c5030c61f4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:58.464858 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-b6671783-cf9a-4a34-9360-c5030c61f4ba None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:58.468544 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-b6671783-cf9a-4a34-9360-c5030c61f4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:58.553437 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8a79b-7f2c-4bec-9a00-4de196881636 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:58.596728 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 35/66] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:47:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:47:58.598066 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e839646-9ae3-4776-b906-08680bdddd71 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:58.598355 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e839646-9ae3-4776-b906-08680bdddd71 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:58.598637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e839646-9ae3-4776-b906-08680bdddd71 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:58.600022 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 36/67] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:47:58.605006 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b004a7-b29d-4de7-ace7-e43dfb815572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:58.605262 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dc788-0733-4252-b6c4-12f9f5108b5a None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:58.605717 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dc788-0733-4252-b6c4-12f9f5108b5a None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:58.606149 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dc788-0733-4252-b6c4-12f9f5108b5a None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:58.606607 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b004a7-b29d-4de7-ace7-e43dfb815572 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:58.607432 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b004a7-b29d-4de7-ace7-e43dfb815572 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:58.608222 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b004a7-b29d-4de7-ace7-e43dfb815572 None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:58.608447 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 37/68] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:47:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:47:58.609462 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b004a7-b29d-4de7-ace7-e43dfb815572 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:47:58.609923 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b033b-0072-4ef8-83b6-48a0d8766b18 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:58.610215 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b033b-0072-4ef8-83b6-48a0d8766b18 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:58.610494 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b033b-0072-4ef8-83b6-48a0d8766b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:58.610808 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b004a7-b29d-4de7-ace7-e43dfb815572 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:58.613103 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b004a7-b29d-4de7-ace7-e43dfb815572 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:58.629471 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 32/69] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:47:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:47:58.634449 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-ad2b033b-0072-4ef8-83b6-48a0d8766b18 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:58.634449 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-ad2b033b-0072-4ef8-83b6-48a0d8766b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:58.640915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffbd68-5b97-42e0-a5bb-32f13f06dc2f None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:58.640915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffbd68-5b97-42e0-a5bb-32f13f06dc2f None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:58.640915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffbd68-5b97-42e0-a5bb-32f13f06dc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:58.672590 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-ebffbd68-5b97-42e0-a5bb-32f13f06dc2f None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:58.674742 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-ebffbd68-5b97-42e0-a5bb-32f13f06dc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:58.768090 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 38/70] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:47:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:47:58.769051 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b033b-0072-4ef8-83b6-48a0d8766b18 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:58.798569 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:58.811841 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:58.813872 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 33/71] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:47:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:47:58.814798 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebffbd68-5b97-42e0-a5bb-32f13f06dc2f None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:58.931553 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b033b-0072-4ef8-83b6-48a0d8766b18 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:58.975007 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5452820-15b8-43aa-b27a-8ac47b007308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:58.975694 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5452820-15b8-43aa-b27a-8ac47b007308 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:58.975977 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5452820-15b8-43aa-b27a-8ac47b007308 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:58.976297 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5452820-15b8-43aa-b27a-8ac47b007308 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:58.985842 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebffbd68-5b97-42e0-a5bb-32f13f06dc2f None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:58.991844 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5452820-15b8-43aa-b27a-8ac47b007308 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:47:59.001846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-a5452820-15b8-43aa-b27a-8ac47b007308 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:47:59.001846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:47:59.001846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:47:59.001846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:47:59.001846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:47:59.001846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:47:59.001846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:47:59.001846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:47:59.001846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:47:59.001846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:47:59.001846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:47:59.001846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:47:59.001846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:47:59.001846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:47:59.001846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:47:59.001846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:47:59.003011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:47:59.003011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:47:59.003011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:47:59.003011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:47:59.003011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:47:59.003011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:47:59.003011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:47:59.003011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:47:59.003011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:47:59.003011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:47:59.003011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:47:59.003011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:47:59.003011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:47:59.003011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:47:59.003011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:47:59.003011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:47:59.003765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:47:59.003765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:47:59.003765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:47:59.003765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:47:59.003765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:47:59.003765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:47:59.003765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:47:59.003765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:47:59.003765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:47:59.003765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:47:59.003765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:47:59.003765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:47:59.003765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 39/72] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:47:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:47:59.004870 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5452820-15b8-43aa-b27a-8ac47b007308 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:59.040680 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ad048-9578-4972-8f4b-e5eb6852403a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:59.041579 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ad048-9578-4972-8f4b-e5eb6852403a None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:59.041948 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ad048-9578-4972-8f4b-e5eb6852403a None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:59.042388 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ad048-9578-4972-8f4b-e5eb6852403a None admin] PATH_INFO: `/v3/users/e7f2a812f0a7455abe8064344eabe693` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:59.063022 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ad048-9578-4972-8f4b-e5eb6852403a None admin] RBAC: Authorizing `identity:get_user(user_id=e7f2a812f0a7455abe8064344eabe693)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:59.065114 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ad048-9578-4972-8f4b-e5eb6852403a None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:59.066975 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 34/73] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:47:58 2022] GET /identity/v3/users/e7f2a812f0a7455abe8064344eabe693 => generated 275 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:47:59.075459 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ad048-9578-4972-8f4b-e5eb6852403a None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:59.121895 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:59.145278 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5452820-15b8-43aa-b27a-8ac47b007308 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:59.160347 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:59.206272 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ca71b-9596-4b04-bd68-b988175eddf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:59.207378 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ca71b-9596-4b04-bd68-b988175eddf1 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:59.207810 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ca71b-9596-4b04-bd68-b988175eddf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:59.208262 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ca71b-9596-4b04-bd68-b988175eddf1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:59.217453 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ad048-9578-4972-8f4b-e5eb6852403a None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:59.227132 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ca71b-9596-4b04-bd68-b988175eddf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:47:59.237885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-b69ca71b-9596-4b04-bd68-b988175eddf1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:47:59.237885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:47:59.237885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:47:59.237885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:47:59.237885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:47:59.237885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:47:59.237885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:47:59.237885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:47:59.237885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:47:59.237885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:47:59.237885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:47:59.237885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:47:59.237885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:47:59.237885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:47:59.237885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:47:59.237885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:47:59.239097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:47:59.239097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:47:59.239097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:47:59.239097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:47:59.239097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:47:59.239097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:47:59.239097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:47:59.239097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:47:59.239097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:47:59.239097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:47:59.239097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:47:59.239097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:47:59.239097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:47:59.239097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:47:59.239097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:47:59.239097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:47:59.240138 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:47:59.240138 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:47:59.240138 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:47:59.240138 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:47:59.240138 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:47:59.240138 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:47:59.240138 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:47:59.240138 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:47:59.240138 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:47:59.240138 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:47:59.240138 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:47:59.240138 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:47:59.240835 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 40/74] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:47:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:47:59.242699 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099d45e-6bef-41b9-8dd6-5bf22a69ce69 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:59.243248 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099d45e-6bef-41b9-8dd6-5bf22a69ce69 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:59.243713 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099d45e-6bef-41b9-8dd6-5bf22a69ce69 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:59.251653 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 41/75] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:47:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:47:59.251653 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099d45e-6bef-41b9-8dd6-5bf22a69ce69 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:59.270220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ee9bc-1f9c-4337-a9f7-079c5be3076c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:59.270914 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ee9bc-1f9c-4337-a9f7-079c5be3076c None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:59.273803 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ee9bc-1f9c-4337-a9f7-079c5be3076c None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:59.273803 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ee9bc-1f9c-4337-a9f7-079c5be3076c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:59.295920 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ee9bc-1f9c-4337-a9f7-079c5be3076c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:47:59.306737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-3a4ee9bc-1f9c-4337-a9f7-079c5be3076c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:47:59.306737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:47:59.306737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:47:59.306737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:47:59.306737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:47:59.306737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:47:59.306737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:47:59.306737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:47:59.306737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:47:59.306737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:47:59.306737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:47:59.306737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:47:59.306737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:47:59.306737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:47:59.306737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:47:59.306737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:47:59.308452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:47:59.308452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:47:59.308452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:47:59.308452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:47:59.308452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:47:59.308452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:47:59.308452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:47:59.308452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:47:59.308452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:47:59.308452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:47:59.308452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:47:59.308452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:47:59.308452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:47:59.308452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:47:59.308452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:47:59.308452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:47:59.310440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:47:59.310440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:47:59.310440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:47:59.310440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:47:59.310440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:47:59.310440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:47:59.310440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:47:59.310440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:47:59.310440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:47:59.310440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:47:59.310440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:47:59.310440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:47:59.310440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 35/76] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:47:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:47:59.311698 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ee9bc-1f9c-4337-a9f7-079c5be3076c None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:59.413269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099d45e-6bef-41b9-8dd6-5bf22a69ce69 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:59.458758 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65426a3-ecd5-4615-9433-47d789b2b0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:59.459460 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65426a3-ecd5-4615-9433-47d789b2b0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:59.459741 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65426a3-ecd5-4615-9433-47d789b2b0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:59.460021 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65426a3-ecd5-4615-9433-47d789b2b0e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:59.460791 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65426a3-ecd5-4615-9433-47d789b2b0e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:47:59.460976 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ee9bc-1f9c-4337-a9f7-079c5be3076c None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:59.461131 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65426a3-ecd5-4615-9433-47d789b2b0e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:59.462567 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65426a3-ecd5-4615-9433-47d789b2b0e1 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:59.474273 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 42/77] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:47:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:47:59.475178 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65426a3-ecd5-4615-9433-47d789b2b0e1 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:59.488891 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:59.489780 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:59.517123 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102bda49-dbfd-4b52-bfcf-97a8e8509e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:59.517785 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bda49-dbfd-4b52-bfcf-97a8e8509e51 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:59.518072 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bda49-dbfd-4b52-bfcf-97a8e8509e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:59.518354 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bda49-dbfd-4b52-bfcf-97a8e8509e51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:59.601598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102bda49-dbfd-4b52-bfcf-97a8e8509e51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:59.603117 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102bda49-dbfd-4b52-bfcf-97a8e8509e51 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:59.617368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65426a3-ecd5-4615-9433-47d789b2b0e1 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:59.669145 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2c58c-7646-44e3-a95c-ec5726874c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:59.670359 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2c58c-7646-44e3-a95c-ec5726874c9e None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:59.670759 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2c58c-7646-44e3-a95c-ec5726874c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:59.671138 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2c58c-7646-44e3-a95c-ec5726874c9e None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:59.672027 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2c58c-7646-44e3-a95c-ec5726874c9e None admin] RBAC: Adding query filter params (name=member) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:47:59.672485 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2c58c-7646-44e3-a95c-ec5726874c9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:59.674315 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2c58c-7646-44e3-a95c-ec5726874c9e None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:59.685815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 43/78] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Aug 2 08:47:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:47:59.688044 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5e112-344b-46ef-91f2-4847a5aba79d None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:59.688629 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5e112-344b-46ef-91f2-4847a5aba79d None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:59.689129 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5e112-344b-46ef-91f2-4847a5aba79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:59.713204 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-7ef5e112-344b-46ef-91f2-4847a5aba79d None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:47:59.714603 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-7ef5e112-344b-46ef-91f2-4847a5aba79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:47:59.739003 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 36/79] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:47:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:47:59.739881 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102bda49-dbfd-4b52-bfcf-97a8e8509e51 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:59.759837 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:59.828271 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:59.848201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 44/80] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:47:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:47:59.848201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5e112-344b-46ef-91f2-4847a5aba79d None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:59.885158 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102bda49-dbfd-4b52-bfcf-97a8e8509e51 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:47:59.940895 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab481df-85f0-4d61-86f3-21aca7d7f463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:47:59.941923 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab481df-85f0-4d61-86f3-21aca7d7f463 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:47:59.942364 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab481df-85f0-4d61-86f3-21aca7d7f463 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:47:59.942820 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab481df-85f0-4d61-86f3-21aca7d7f463 None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:47:59.944136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab481df-85f0-4d61-86f3-21aca7d7f463 None admin] RBAC: Adding query filter params (name=member) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:47:59.944700 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab481df-85f0-4d61-86f3-21aca7d7f463 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:47:59.947332 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab481df-85f0-4d61-86f3-21aca7d7f463 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:47:59.964137 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 37/81] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Aug 2 08:47:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:47:59.969204 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab481df-85f0-4d61-86f3-21aca7d7f463 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:47:59.992929 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5e112-344b-46ef-91f2-4847a5aba79d None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:00.037725 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e39915-7878-4f74-bdf4-8634c305230d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:00.038403 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e39915-7878-4f74-bdf4-8634c305230d None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:00.038685 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e39915-7878-4f74-bdf4-8634c305230d None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:00.038971 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e39915-7878-4f74-bdf4-8634c305230d None admin] PATH_INFO: `/v3/users/c124f3deb85b49f5a9becf0360ac8d93` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:00.040388 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e39915-7878-4f74-bdf4-8634c305230d None admin] RBAC: Authorizing `identity:get_user(user_id=c124f3deb85b49f5a9becf0360ac8d93)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:00.041988 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e39915-7878-4f74-bdf4-8634c305230d None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:00.044339 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 45/82] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:47:59 2022] GET /identity/v3/users/c124f3deb85b49f5a9becf0360ac8d93 => generated 247 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:00.045256 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e39915-7878-4f74-bdf4-8634c305230d None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:00.084865 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:00.115593 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab481df-85f0-4d61-86f3-21aca7d7f463 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:00.137364 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:00.168722 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b701c-63b5-44f2-8483-6861b171c4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:00.170053 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b701c-63b5-44f2-8483-6861b171c4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:00.170337 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b701c-63b5-44f2-8483-6861b171c4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:00.170624 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b701c-63b5-44f2-8483-6861b171c4c7 None admin] PATH_INFO: `/v3/users/e7f2a812f0a7455abe8064344eabe693` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:00.174059 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b701c-63b5-44f2-8483-6861b171c4c7 None admin] RBAC: Authorizing `identity:get_user(user_id=e7f2a812f0a7455abe8064344eabe693)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:00.175593 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b701c-63b5-44f2-8483-6861b171c4c7 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:00.177774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 38/83] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:47:59 2022] GET /identity/v3/users/e7f2a812f0a7455abe8064344eabe693 => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:00.178612 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b701c-63b5-44f2-8483-6861b171c4c7 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:00.191068 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e39915-7878-4f74-bdf4-8634c305230d None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:00.247250 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40436e01-a8b4-4e61-9aa3-9b0993d38876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:00.248338 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40436e01-a8b4-4e61-9aa3-9b0993d38876 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:00.248846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40436e01-a8b4-4e61-9aa3-9b0993d38876 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:00.249272 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40436e01-a8b4-4e61-9aa3-9b0993d38876 None admin] PATH_INFO: `/v3/projects/c8576b87aecf403699be87362271685d` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:00.251151 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40436e01-a8b4-4e61-9aa3-9b0993d38876 None admin] RBAC: Authorizing `identity:get_project(project_id=c8576b87aecf403699be87362271685d)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:00.253738 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40436e01-a8b4-4e61-9aa3-9b0993d38876 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:00.257290 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 46/84] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:00 2022] GET /identity/v3/projects/c8576b87aecf403699be87362271685d => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:00.258473 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40436e01-a8b4-4e61-9aa3-9b0993d38876 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:00.347650 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b701c-63b5-44f2-8483-6861b171c4c7 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:00.406484 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bae93-ffdc-45a0-9e0a-fc930190986d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:00.407444 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bae93-ffdc-45a0-9e0a-fc930190986d None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:00.407911 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bae93-ffdc-45a0-9e0a-fc930190986d None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:00.408805 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bae93-ffdc-45a0-9e0a-fc930190986d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:00.410331 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328bae93-ffdc-45a0-9e0a-fc930190986d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:00.413284 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328bae93-ffdc-45a0-9e0a-fc930190986d None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:00.415881 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 39/85] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:48:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:00.417539 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bae93-ffdc-45a0-9e0a-fc930190986d None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:00.437796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40436e01-a8b4-4e61-9aa3-9b0993d38876 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:00.445510 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:00.491604 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f37e8-d958-48eb-9be5-d22af141cecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:00.492621 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f37e8-d958-48eb-9be5-d22af141cecf None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:00.492976 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f37e8-d958-48eb-9be5-d22af141cecf None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:00.493435 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f37e8-d958-48eb-9be5-d22af141cecf None admin] PATH_INFO: `/v3/users/e7f2a812f0a7455abe8064344eabe693` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:00.495111 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f37e8-d958-48eb-9be5-d22af141cecf None admin] RBAC: Authorizing `identity:get_user(user_id=e7f2a812f0a7455abe8064344eabe693)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:00.496954 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f37e8-d958-48eb-9be5-d22af141cecf None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:00.499225 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 47/86] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:48:00 2022] GET /identity/v3/users/e7f2a812f0a7455abe8064344eabe693 => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:00.499225 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f37e8-d958-48eb-9be5-d22af141cecf None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:00.499225 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:00.581314 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bae93-ffdc-45a0-9e0a-fc930190986d None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:00.636833 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be80dd-83c9-42e7-96ed-50ab639454a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:00.638794 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be80dd-83c9-42e7-96ed-50ab639454a7 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:00.639152 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be80dd-83c9-42e7-96ed-50ab639454a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:00.639482 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be80dd-83c9-42e7-96ed-50ab639454a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:00.646089 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f37e8-d958-48eb-9be5-d22af141cecf None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:00.705611 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ea923-e207-40a7-9392-968212d23baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:00.706537 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ea923-e207-40a7-9392-968212d23baf None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:00.707032 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ea923-e207-40a7-9392-968212d23baf None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:00.707492 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ea923-e207-40a7-9392-968212d23baf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:00.726968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be80dd-83c9-42e7-96ed-50ab639454a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:00.729350 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be80dd-83c9-42e7-96ed-50ab639454a7 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:00.749420 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:00.822920 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ea923-e207-40a7-9392-968212d23baf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:00.826581 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ea923-e207-40a7-9392-968212d23baf None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:00.830316 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:00.870985 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 40/87] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:48:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:48:00.870985 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be80dd-83c9-42e7-96ed-50ab639454a7 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:00.985812 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 48/88] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:48:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:48:00.987131 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ea923-e207-40a7-9392-968212d23baf None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:01.015973 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be80dd-83c9-42e7-96ed-50ab639454a7 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:01.036724 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:01.072969 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d3ab1-a98a-49ad-9fe0-34289c6f1c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:01.073779 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d3ab1-a98a-49ad-9fe0-34289c6f1c62 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:01.074127 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d3ab1-a98a-49ad-9fe0-34289c6f1c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:01.074719 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d3ab1-a98a-49ad-9fe0-34289c6f1c62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:01.077484 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d3ab1-a98a-49ad-9fe0-34289c6f1c62 None admin] RBAC: Adding query filter params (role.id=923eb688fccc4e79b6c3df28d754b6c4, scope.project.id=c8576b87aecf403699be87362271685d, user.id=e7f2a812f0a7455abe8064344eabe693) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:01.077889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d3ab1-a98a-49ad-9fe0-34289c6f1c62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:01.079542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d3ab1-a98a-49ad-9fe0-34289c6f1c62 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:01.087825 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 41/89] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:48:00 2022] GET /identity/v3/role_assignments?user.id=e7f2a812f0a7455abe8064344eabe693&scope.project.id=c8576b87aecf403699be87362271685d&role.id=923eb688fccc4e79b6c3df28d754b6c4 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:01.088724 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d3ab1-a98a-49ad-9fe0-34289c6f1c62 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:01.151615 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ea923-e207-40a7-9392-968212d23baf None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:01.154269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:01.210355 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110cfaa8-0913-4527-8a71-a156f5835f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:01.211313 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cfaa8-0913-4527-8a71-a156f5835f14 None admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:01.211760 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cfaa8-0913-4527-8a71-a156f5835f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:01.212226 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cfaa8-0913-4527-8a71-a156f5835f14 None admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:01.213136 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110cfaa8-0913-4527-8a71-a156f5835f14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:01.214769 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110cfaa8-0913-4527-8a71-a156f5835f14 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:01.286161 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d3ab1-a98a-49ad-9fe0-34289c6f1c62 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:01.353010 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9863fd-dd46-4d87-ace3-d520e421e5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:01.353728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9863fd-dd46-4d87-ace3-d520e421e5b9 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:01.354074 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9863fd-dd46-4d87-ace3-d520e421e5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:01.354455 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9863fd-dd46-4d87-ace3-d520e421e5b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:01.373281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 49/90] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Aug 2 08:48:00 2022] POST /identity/v3/users => generated 289 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:48:01.374740 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110cfaa8-0913-4527-8a71-a156f5835f14 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:01.435261 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:01.473222 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9863fd-dd46-4d87-ace3-d520e421e5b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:01.474930 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9863fd-dd46-4d87-ace3-d520e421e5b9 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:01.579413 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110cfaa8-0913-4527-8a71-a156f5835f14 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:01.627006 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad01d6-1355-40c2-b57a-fddf214b5e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:01.627723 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad01d6-1355-40c2-b57a-fddf214b5e9b None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:01.628083 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad01d6-1355-40c2-b57a-fddf214b5e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:01.628444 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad01d6-1355-40c2-b57a-fddf214b5e9b None admin] PATH_INFO: `/v3/projects/c8576b87aecf403699be87362271685d` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:01.629730 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad01d6-1355-40c2-b57a-fddf214b5e9b None admin] RBAC: Authorizing `identity:get_project(project_id=c8576b87aecf403699be87362271685d)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:01.631515 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad01d6-1355-40c2-b57a-fddf214b5e9b None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:01.633681 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 50/91] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:01 2022] GET /identity/v3/projects/c8576b87aecf403699be87362271685d => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:01.634537 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad01d6-1355-40c2-b57a-fddf214b5e9b None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:01.672038 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:01.678397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 42/92] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:48:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:48:01.680338 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9863fd-dd46-4d87-ace3-d520e421e5b9 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:01.807520 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad01d6-1355-40c2-b57a-fddf214b5e9b None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:01.811753 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:01.856151 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9863fd-dd46-4d87-ace3-d520e421e5b9 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:01.885893 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7710a-7952-423f-b3c3-566e42508468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:01.886880 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7710a-7952-423f-b3c3-566e42508468 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:01.887423 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7710a-7952-423f-b3c3-566e42508468 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:01.888438 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7710a-7952-423f-b3c3-566e42508468 None admin] PATH_INFO: `/v3/projects/24217f09fa8b48ac99bcb1a2a3e306aa` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:01.890675 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7710a-7952-423f-b3c3-566e42508468 None admin] RBAC: Authorizing `identity:get_project(project_id=24217f09fa8b48ac99bcb1a2a3e306aa)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:01.893420 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7710a-7952-423f-b3c3-566e42508468 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:01.896782 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 51/93] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:01 2022] GET /identity/v3/projects/24217f09fa8b48ac99bcb1a2a3e306aa => generated 312 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:01.898300 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7710a-7952-423f-b3c3-566e42508468 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:01.906625 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60edeb-2674-49cc-9a68-b909df9d9da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:01.907668 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60edeb-2674-49cc-9a68-b909df9d9da6 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:01.908219 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60edeb-2674-49cc-9a68-b909df9d9da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:01.908719 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60edeb-2674-49cc-9a68-b909df9d9da6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:01.909828 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e60edeb-2674-49cc-9a68-b909df9d9da6 None admin] RBAC: Adding query filter params (role.id=b5477d3c4e5a4514b64211ec2452d1d8, scope.project.id=c8576b87aecf403699be87362271685d, user.id=c124f3deb85b49f5a9becf0360ac8d93) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:01.910418 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e60edeb-2674-49cc-9a68-b909df9d9da6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:01.912139 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e60edeb-2674-49cc-9a68-b909df9d9da6 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:01.920596 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 43/94] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:48:01 2022] GET /identity/v3/role_assignments?user.id=c124f3deb85b49f5a9becf0360ac8d93&scope.project.id=c8576b87aecf403699be87362271685d&role.id=b5477d3c4e5a4514b64211ec2452d1d8 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:01.928681 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60edeb-2674-49cc-9a68-b909df9d9da6 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:02.191081 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7710a-7952-423f-b3c3-566e42508468 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:02.227227 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:02.243539 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de66385-eb1f-4878-ad07-b8e55b3dffaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:02.244761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de66385-eb1f-4878-ad07-b8e55b3dffaf None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:02.245293 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de66385-eb1f-4878-ad07-b8e55b3dffaf None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:02.245861 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de66385-eb1f-4878-ad07-b8e55b3dffaf None admin] PATH_INFO: `/v3/projects/c8576b87aecf403699be87362271685d` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:02.248308 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de66385-eb1f-4878-ad07-b8e55b3dffaf None admin] RBAC: Authorizing `identity:get_project(project_id=c8576b87aecf403699be87362271685d)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:02.250406 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de66385-eb1f-4878-ad07-b8e55b3dffaf None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:02.251591 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60edeb-2674-49cc-9a68-b909df9d9da6 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:02.253284 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 52/95] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:01 2022] GET /identity/v3/projects/c8576b87aecf403699be87362271685d => generated 298 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:02.266539 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de66385-eb1f-4878-ad07-b8e55b3dffaf None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:02.446402 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d2aa7-310f-49be-b678-1d691bdd4c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:02.447334 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d2aa7-310f-49be-b678-1d691bdd4c6b None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:02.447829 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d2aa7-310f-49be-b678-1d691bdd4c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:02.448328 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d2aa7-310f-49be-b678-1d691bdd4c6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:02.449978 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d2aa7-310f-49be-b678-1d691bdd4c6b None admin] RBAC: Adding query filter params (role.id=5fd593d076084fbaa9208dd505b58150, scope.project.id=24217f09fa8b48ac99bcb1a2a3e306aa, user.id=e7f2a812f0a7455abe8064344eabe693) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:02.450548 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d2aa7-310f-49be-b678-1d691bdd4c6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:02.461885 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d2aa7-310f-49be-b678-1d691bdd4c6b None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:02.479539 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 44/96] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:48:01 2022] GET /identity/v3/role_assignments?user.id=e7f2a812f0a7455abe8064344eabe693&scope.project.id=24217f09fa8b48ac99bcb1a2a3e306aa&role.id=5fd593d076084fbaa9208dd505b58150 => generated 259 bytes in 551 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:48:02.491650 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de66385-eb1f-4878-ad07-b8e55b3dffaf None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:02.557109 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca24964-750c-4250-92aa-a1eb9c8031d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:02.557910 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca24964-750c-4250-92aa-a1eb9c8031d2 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:02.558244 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca24964-750c-4250-92aa-a1eb9c8031d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:02.558527 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca24964-750c-4250-92aa-a1eb9c8031d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:02.559940 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca24964-750c-4250-92aa-a1eb9c8031d2 None admin] RBAC: Adding query filter params (role.id=5fd593d076084fbaa9208dd505b58150, scope.project.id=c8576b87aecf403699be87362271685d, user.id=e7f2a812f0a7455abe8064344eabe693) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:02.560505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca24964-750c-4250-92aa-a1eb9c8031d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:02.562187 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca24964-750c-4250-92aa-a1eb9c8031d2 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:02.570539 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 53/97] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:48:02 2022] GET /identity/v3/role_assignments?user.id=e7f2a812f0a7455abe8064344eabe693&scope.project.id=c8576b87aecf403699be87362271685d&role.id=5fd593d076084fbaa9208dd505b58150 => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:04.061695 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056326c5-8fd1-4446-bb7e-69bb041dd91c None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:04.062222 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056326c5-8fd1-4446-bb7e-69bb041dd91c None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:04.062222 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056326c5-8fd1-4446-bb7e-69bb041dd91c None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:04.063631 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 45/98] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:48:04.073487 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd03e28-585b-49b3-ac46-9c587cefc6dc None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:04.074008 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd03e28-585b-49b3-ac46-9c587cefc6dc None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:04.074081 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd03e28-585b-49b3-ac46-9c587cefc6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:04.109357 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-2fd03e28-585b-49b3-ac46-9c587cefc6dc None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:04.110637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-2fd03e28-585b-49b3-ac46-9c587cefc6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:04.148769 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:04.235060 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 54/99] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:04.277463 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056326c5-8fd1-4446-bb7e-69bb041dd91c None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:04.283633 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:04.598497 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056326c5-8fd1-4446-bb7e-69bb041dd91c None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:04.706189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af402d38-eff8-4b2a-8245-72db46218f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:04.707534 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af402d38-eff8-4b2a-8245-72db46218f6a None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:04.708055 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af402d38-eff8-4b2a-8245-72db46218f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:04.708605 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af402d38-eff8-4b2a-8245-72db46218f6a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:04.740837 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af402d38-eff8-4b2a-8245-72db46218f6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:04.752230 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-af402d38-eff8-4b2a-8245-72db46218f6a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:48:04.752230 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:04.752230 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:04.752230 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:04.752230 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:04.752230 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:04.752230 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:04.752230 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:04.752230 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:04.752230 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:04.752230 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:04.752230 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:04.752230 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:04.752230 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:04.752230 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:04.752230 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:04.753286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:04.753286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:04.753286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:04.753286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:04.753286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:04.753286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:04.753286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:04.753286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:04.753286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:04.753286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:04.753286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:04.753286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:04.753286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:04.753286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:04.753286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:04.753286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:04.754078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:04.754078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:04.754078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:04.754078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:04.754078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:04.754078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:04.754078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:04.754078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:04.754078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:04.754078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:04.754078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:48:04.754078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:48:04.754708 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 46/100] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Aug 2 08:48:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 478 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:04.765017 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd03e28-585b-49b3-ac46-9c587cefc6dc None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:04.982974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd03e28-585b-49b3-ac46-9c587cefc6dc None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:05.051901 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af898d5a-8a8e-431a-a6cd-01def3aa8815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:05.053167 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af898d5a-8a8e-431a-a6cd-01def3aa8815 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:05.053655 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af898d5a-8a8e-431a-a6cd-01def3aa8815 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:05.054142 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af898d5a-8a8e-431a-a6cd-01def3aa8815 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:05.055443 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af898d5a-8a8e-431a-a6cd-01def3aa8815 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:05.056001 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af898d5a-8a8e-431a-a6cd-01def3aa8815 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:05.058609 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af898d5a-8a8e-431a-a6cd-01def3aa8815 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:05.080739 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 55/101] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:48:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:05.090943 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af402d38-eff8-4b2a-8245-72db46218f6a None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:05.263164 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:05.377750 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af402d38-eff8-4b2a-8245-72db46218f6a None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:05.443553 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a4977-f4d2-4202-8ae4-f52e558909dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:05.444709 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a4977-f4d2-4202-8ae4-f52e558909dd None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:05.445214 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a4977-f4d2-4202-8ae4-f52e558909dd None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:05.445709 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a4977-f4d2-4202-8ae4-f52e558909dd None admin] PATH_INFO: `/v3/users/e7f2a812f0a7455abe8064344eabe693` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:05.447943 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a4977-f4d2-4202-8ae4-f52e558909dd None admin] RBAC: Authorizing `identity:get_user(user_id=e7f2a812f0a7455abe8064344eabe693)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:05.451573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a4977-f4d2-4202-8ae4-f52e558909dd None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:05.454960 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 47/102] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:48:05 2022] GET /identity/v3/users/e7f2a812f0a7455abe8064344eabe693 => generated 275 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:05.470230 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af898d5a-8a8e-431a-a6cd-01def3aa8815 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:05.519750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:05.699229 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af898d5a-8a8e-431a-a6cd-01def3aa8815 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:05.773770 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c657a-e93e-450b-89a5-8517b2d0790c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:05.774870 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c657a-e93e-450b-89a5-8517b2d0790c None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:05.775381 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c657a-e93e-450b-89a5-8517b2d0790c None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:05.775928 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c657a-e93e-450b-89a5-8517b2d0790c None admin] PATH_INFO: `/v3/projects/c8576b87aecf403699be87362271685d` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:05.778916 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c657a-e93e-450b-89a5-8517b2d0790c None admin] RBAC: Authorizing `identity:get_project(project_id=c8576b87aecf403699be87362271685d)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:05.781852 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c657a-e93e-450b-89a5-8517b2d0790c None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:05.785814 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 56/103] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:05 2022] GET /identity/v3/projects/c8576b87aecf403699be87362271685d => generated 298 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:05.796483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a4977-f4d2-4202-8ae4-f52e558909dd None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:05.983136 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0d971-7090-4e2e-b79a-d72ace377be7 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:05.984367 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0d971-7090-4e2e-b79a-d72ace377be7 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:05.985332 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0d971-7090-4e2e-b79a-d72ace377be7 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:05.987956 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 57/104] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:05.995901 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153bb96c-ac2b-41d2-a111-a7a697ee20b2 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:05.998263 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153bb96c-ac2b-41d2-a111-a7a697ee20b2 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:05.999057 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153bb96c-ac2b-41d2-a111-a7a697ee20b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:06.056802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-153bb96c-ac2b-41d2-a111-a7a697ee20b2 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:06.060114 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-153bb96c-ac2b-41d2-a111-a7a697ee20b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:06.068998 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a4977-f4d2-4202-8ae4-f52e558909dd None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:06.162804 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:06.178677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e57d7-ed09-4035-ad66-bd3760132f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:06.179400 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e57d7-ed09-4035-ad66-bd3760132f5e None admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:06.179688 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e57d7-ed09-4035-ad66-bd3760132f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:06.179972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e57d7-ed09-4035-ad66-bd3760132f5e None admin] PATH_INFO: `/v3/projects/c8576b87aecf403699be87362271685d/users/e7f2a812f0a7455abe8064344eabe693/roles/923eb688fccc4e79b6c3df28d754b6c4` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:06.189888 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e57d7-ed09-4035-ad66-bd3760132f5e None admin] RBAC: Authorizing `identity:create_grant(project_id=c8576b87aecf403699be87362271685d, user_id=e7f2a812f0a7455abe8064344eabe693, role_id=923eb688fccc4e79b6c3df28d754b6c4)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:06.191479 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e57d7-ed09-4035-ad66-bd3760132f5e None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:06.281216 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 58/105] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:06.285238 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c3dc1-4dcb-49fe-a370-8dba3f25f126 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:06.286345 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c3dc1-4dcb-49fe-a370-8dba3f25f126 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:06.287118 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c3dc1-4dcb-49fe-a370-8dba3f25f126 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:06.290168 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 59/106] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:06.300142 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c29e2-91b9-4ece-9260-17d69ebdc0db None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:06.301159 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c29e2-91b9-4ece-9260-17d69ebdc0db None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:06.302488 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c29e2-91b9-4ece-9260-17d69ebdc0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:06.321980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 48/107] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Aug 2 08:48:05 2022] PUT /identity/v3/projects/c8576b87aecf403699be87362271685d/users/e7f2a812f0a7455abe8064344eabe693/roles/923eb688fccc4e79b6c3df28d754b6c4 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:48:06.323145 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e57d7-ed09-4035-ad66-bd3760132f5e None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:06.346364 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-3d4c29e2-91b9-4ece-9260-17d69ebdc0db None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:06.347824 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-3d4c29e2-91b9-4ece-9260-17d69ebdc0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:06.368661 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:06.585392 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 60/108] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:06.586704 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30073e2f-6a5a-4e59-9499-aaa1803654d0 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:06.587044 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30073e2f-6a5a-4e59-9499-aaa1803654d0 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:06.587353 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30073e2f-6a5a-4e59-9499-aaa1803654d0 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:06.589096 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 61/109] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:06.616553 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30073e2f-6a5a-4e59-9499-aaa1803654d0 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:06.624373 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e57d7-ed09-4035-ad66-bd3760132f5e None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:06.703614 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98615820-3413-4c26-aa5d-63f026027060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:06.705595 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98615820-3413-4c26-aa5d-63f026027060 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:06.706401 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98615820-3413-4c26-aa5d-63f026027060 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:06.707256 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98615820-3413-4c26-aa5d-63f026027060 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:06.734819 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98615820-3413-4c26-aa5d-63f026027060 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:06.745356 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30073e2f-6a5a-4e59-9499-aaa1803654d0 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:06.747633 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-98615820-3413-4c26-aa5d-63f026027060 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:48:06.747633 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:06.747633 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:06.747633 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:06.747633 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:06.747633 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:06.747633 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:06.747633 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:06.747633 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:06.747633 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:06.747633 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:06.747633 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:06.747633 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:06.747633 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:06.747633 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:06.747633 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:06.749301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:06.749301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:06.749301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:06.749301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:06.749301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:06.749301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:06.749301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:06.749301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:06.749301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:06.749301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:06.749301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:06.749301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:06.749301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:06.749301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:06.749301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:06.749301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:06.750793 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:06.750793 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:06.750793 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:06.750793 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:06.750793 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:06.750793 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:06.750793 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:06.750793 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:06.750793 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:06.750793 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:06.750793 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:48:06.750793 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:48:06.755185 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 49/110] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:48:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 433 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:06.758275 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246a033-82b2-4612-9214-b951defd77b3 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:06.759139 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246a033-82b2-4612-9214-b951defd77b3 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:06.759846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246a033-82b2-4612-9214-b951defd77b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:06.795498 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c93aec-25de-43bc-987d-d77ff41f67d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:06.796242 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c93aec-25de-43bc-987d-d77ff41f67d5 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:06.796603 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c93aec-25de-43bc-987d-d77ff41f67d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:06.796926 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-3246a033-82b2-4612-9214-b951defd77b3 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:06.797081 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c93aec-25de-43bc-987d-d77ff41f67d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:06.798347 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c93aec-25de-43bc-987d-d77ff41f67d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:06.799866 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c93aec-25de-43bc-987d-d77ff41f67d5 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:06.800615 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-3246a033-82b2-4612-9214-b951defd77b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:06.801934 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 62/111] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:48:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:06.803421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad406a8-3958-49c6-824d-f89ecaadeb0b None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:06.803716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad406a8-3958-49c6-824d-f89ecaadeb0b None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:06.804029 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad406a8-3958-49c6-824d-f89ecaadeb0b None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:06.811764 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 63/112] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:06.813118 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad406a8-3958-49c6-824d-f89ecaadeb0b None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:06.833892 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:06.914396 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:06.944917 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad406a8-3958-49c6-824d-f89ecaadeb0b None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:06.958342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 50/113] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:06.966284 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246a033-82b2-4612-9214-b951defd77b3 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:06.996899 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c3f41-3ba9-40c1-8fa6-e12a40c4fbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:06.998802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c3f41-3ba9-40c1-8fa6-e12a40c4fbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:07.000750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c3f41-3ba9-40c1-8fa6-e12a40c4fbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:07.001046 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c3f41-3ba9-40c1-8fa6-e12a40c4fbc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:07.001909 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c3f41-3ba9-40c1-8fa6-e12a40c4fbc8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:07.003060 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c3f41-3ba9-40c1-8fa6-e12a40c4fbc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:07.005648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c3f41-3ba9-40c1-8fa6-e12a40c4fbc8 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:07.027262 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 64/114] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Aug 2 08:48:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:07.034415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e99eaa-e98c-4b11-94e7-e80d4033ff2d None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:07.034689 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e99eaa-e98c-4b11-94e7-e80d4033ff2d None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:07.035009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e99eaa-e98c-4b11-94e7-e80d4033ff2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:07.056292 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-66e99eaa-e98c-4b11-94e7-e80d4033ff2d None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:07.057832 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-66e99eaa-e98c-4b11-94e7-e80d4033ff2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:07.158966 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 65/115] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:07.159889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e99eaa-e98c-4b11-94e7-e80d4033ff2d None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:07.172980 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:07.187053 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246a033-82b2-4612-9214-b951defd77b3 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:07.255803 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e018ab-f394-402b-8fdf-199625ea74c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:07.257177 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e018ab-f394-402b-8fdf-199625ea74c5 None admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:07.257675 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e018ab-f394-402b-8fdf-199625ea74c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:07.258158 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e018ab-f394-402b-8fdf-199625ea74c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:07.259449 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e018ab-f394-402b-8fdf-199625ea74c5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:07.262846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e018ab-f394-402b-8fdf-199625ea74c5 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:07.331181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e99eaa-e98c-4b11-94e7-e80d4033ff2d None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:07.378319 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 51/116] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Aug 2 08:48:06 2022] POST /identity/v3/projects => generated 302 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:48:07.381373 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e018ab-f394-402b-8fdf-199625ea74c5 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:07.389686 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce02162-3f64-4eba-99fa-88061159c330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:07.391270 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce02162-3f64-4eba-99fa-88061159c330 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:07.392061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce02162-3f64-4eba-99fa-88061159c330 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:07.392790 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce02162-3f64-4eba-99fa-88061159c330 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:07.416095 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce02162-3f64-4eba-99fa-88061159c330 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:07.425575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-0ce02162-3f64-4eba-99fa-88061159c330 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:48:07.425575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:07.425575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:07.425575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:07.425575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:07.425575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:07.425575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:07.425575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:07.425575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:07.425575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:07.425575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:07.425575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:07.425575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:07.425575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:07.425575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:07.425575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:07.427517 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:07.427517 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:07.427517 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:07.427517 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:07.427517 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:07.427517 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:07.427517 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:07.427517 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:07.427517 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:07.427517 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:07.427517 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:07.427517 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:07.427517 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:07.427517 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:07.427517 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:07.427517 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:07.429121 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:07.429121 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:07.429121 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:07.429121 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:07.429121 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:07.429121 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:07.429121 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:07.429121 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:07.429121 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:07.429121 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:07.429121 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:48:07.429121 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:48:07.433258 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 66/117] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:48:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:07.436260 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f0b1a-c982-4975-9a1e-73ad7908c77e None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:07.436936 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f0b1a-c982-4975-9a1e-73ad7908c77e None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:07.437424 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f0b1a-c982-4975-9a1e-73ad7908c77e None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:07.440196 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 67/118] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:07.442031 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f0b1a-c982-4975-9a1e-73ad7908c77e None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:07.471567 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:07.546546 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:07.602794 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e018ab-f394-402b-8fdf-199625ea74c5 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:07.602997 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f0b1a-c982-4975-9a1e-73ad7908c77e None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:07.647564 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed8d25-6f84-4dbe-8d87-887ac1708d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:07.648721 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed8d25-6f84-4dbe-8d87-887ac1708d6c None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:07.649199 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed8d25-6f84-4dbe-8d87-887ac1708d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:07.649649 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed8d25-6f84-4dbe-8d87-887ac1708d6c None admin] PATH_INFO: `/v3/users/9c0673c9ff77438792cce1f2fac6eb41` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:07.668956 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e3325-5caf-480e-926b-175795beefa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:07.670371 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed8d25-6f84-4dbe-8d87-887ac1708d6c None admin] RBAC: Authorizing `identity:get_user(user_id=9c0673c9ff77438792cce1f2fac6eb41)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:07.670531 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e3325-5caf-480e-926b-175795beefa8 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:07.671071 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e3325-5caf-480e-926b-175795beefa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:07.671662 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e3325-5caf-480e-926b-175795beefa8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:07.672838 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed8d25-6f84-4dbe-8d87-887ac1708d6c None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:07.675868 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 52/119] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:48:07 2022] GET /identity/v3/users/9c0673c9ff77438792cce1f2fac6eb41 => generated 289 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:07.678299 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e1c59-c89d-4ae1-b331-90b531f85fc7 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:07.678991 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e1c59-c89d-4ae1-b331-90b531f85fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:07.679713 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e1c59-c89d-4ae1-b331-90b531f85fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:07.693292 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e3325-5caf-480e-926b-175795beefa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:07.702986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-4f8e3325-5caf-480e-926b-175795beefa8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:48:07.702986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:07.702986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:07.702986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:07.702986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:07.702986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:07.702986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:07.702986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:07.702986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:07.702986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:07.702986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:07.702986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:07.702986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:07.702986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:07.702986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:07.702986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:07.704803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:07.704803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:07.704803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:07.704803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:07.704803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:07.704803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:07.704803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:07.704803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:07.704803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:07.704803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:07.704803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:07.704803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:07.704803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:07.704803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:07.704803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:07.704803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:07.705776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:07.705776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:07.705776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:07.705776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:07.705776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:07.705776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:07.705776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:07.705776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:07.705776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:07.705776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:07.705776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:48:07.705776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:48:07.705776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 68/120] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:48:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:07.709129 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e3325-5caf-480e-926b-175795beefa8 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:07.714817 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-693e1c59-c89d-4ae1-b331-90b531f85fc7 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:07.717339 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-693e1c59-c89d-4ae1-b331-90b531f85fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:07.830673 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 53/121] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:07.833462 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e1c59-c89d-4ae1-b331-90b531f85fc7 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:07.895121 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:07.898209 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e3325-5caf-480e-926b-175795beefa8 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:07.937794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:07.950983 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152dfe0-b7ae-44e0-a847-71726e980a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:07.954559 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152dfe0-b7ae-44e0-a847-71726e980a10 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:07.954559 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152dfe0-b7ae-44e0-a847-71726e980a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:07.954559 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152dfe0-b7ae-44e0-a847-71726e980a10 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:07.954559 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152dfe0-b7ae-44e0-a847-71726e980a10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:07.954559 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152dfe0-b7ae-44e0-a847-71726e980a10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:07.955820 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152dfe0-b7ae-44e0-a847-71726e980a10 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:07.967673 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 69/122] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:48:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:07.975311 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152dfe0-b7ae-44e0-a847-71726e980a10 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:08.059617 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e1c59-c89d-4ae1-b331-90b531f85fc7 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:08.111187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21f713-7615-42b9-89dc-2fb5867787e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:08.113553 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21f713-7615-42b9-89dc-2fb5867787e5 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:08.114573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21f713-7615-42b9-89dc-2fb5867787e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:08.115265 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21f713-7615-42b9-89dc-2fb5867787e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:08.191331 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152dfe0-b7ae-44e0-a847-71726e980a10 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:08.218862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21f713-7615-42b9-89dc-2fb5867787e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:08.220130 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21f713-7615-42b9-89dc-2fb5867787e5 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:08.257959 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2dc32-9a19-48e6-acc0-6a5b261f7a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:08.258951 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2dc32-9a19-48e6-acc0-6a5b261f7a4f None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:08.259497 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2dc32-9a19-48e6-acc0-6a5b261f7a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:08.259885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2dc32-9a19-48e6-acc0-6a5b261f7a4f None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:08.261508 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2dc32-9a19-48e6-acc0-6a5b261f7a4f None admin] RBAC: Adding query filter params (name=member) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:08.261767 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2dc32-9a19-48e6-acc0-6a5b261f7a4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:08.264951 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2dc32-9a19-48e6-acc0-6a5b261f7a4f None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:08.270254 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:08.281351 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 70/123] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Aug 2 08:48:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:08.286611 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2dc32-9a19-48e6-acc0-6a5b261f7a4f None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:08.399906 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:08.400622 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 54/124] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:48:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:48:08.402248 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21f713-7615-42b9-89dc-2fb5867787e5 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:08.471394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2dc32-9a19-48e6-acc0-6a5b261f7a4f None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:08.525058 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcff05-3536-4262-b7dd-2860f17c2fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:08.526103 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcff05-3536-4262-b7dd-2860f17c2fad None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:08.526572 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcff05-3536-4262-b7dd-2860f17c2fad None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:08.527020 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcff05-3536-4262-b7dd-2860f17c2fad None admin] PATH_INFO: `/v3/roles/member` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:08.547549 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dcff05-3536-4262-b7dd-2860f17c2fad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:08.558044 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-c8dcff05-3536-4262-b7dd-2860f17c2fad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:48:08.558044 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:08.558044 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:08.558044 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:08.558044 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:08.558044 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:08.558044 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:08.558044 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:08.558044 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:08.558044 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:08.558044 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:08.558044 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:08.558044 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:08.558044 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:08.558044 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:08.558044 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:08.559661 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:08.559661 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:08.559661 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:08.559661 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:08.559661 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:08.559661 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:08.559661 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:08.559661 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:08.559661 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:08.559661 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:08.559661 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:08.559661 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:08.559661 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:08.559661 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:08.559661 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:08.559661 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:08.560487 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:08.560487 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:08.560487 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:08.560487 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:08.560487 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:08.560487 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:08.560487 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:08.560487 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:08.560487 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:08.560487 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:08.560487 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:48:08.560487 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:48:08.561076 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 71/125] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:48:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:08.568191 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcff05-3536-4262-b7dd-2860f17c2fad None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:08.594324 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21f713-7615-42b9-89dc-2fb5867787e5 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:08.639777 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:08.661091 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354636e-d43e-42fa-86a5-5327a3448e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:08.668898 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354636e-d43e-42fa-86a5-5327a3448e46 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:08.668898 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354636e-d43e-42fa-86a5-5327a3448e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:08.668898 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354636e-d43e-42fa-86a5-5327a3448e46 None admin] PATH_INFO: `/v3/users/c124f3deb85b49f5a9becf0360ac8d93` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:08.668898 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354636e-d43e-42fa-86a5-5327a3448e46 None admin] RBAC: Authorizing `identity:get_user(user_id=c124f3deb85b49f5a9becf0360ac8d93)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:08.668898 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354636e-d43e-42fa-86a5-5327a3448e46 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:08.670996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 55/126] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:48:08 2022] GET /identity/v3/users/c124f3deb85b49f5a9becf0360ac8d93 => generated 247 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:08.672601 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354636e-d43e-42fa-86a5-5327a3448e46 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:08.753578 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcff05-3536-4262-b7dd-2860f17c2fad None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:08.774069 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:08.815883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1b163-c409-48a2-b9f3-0ded7af58948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:08.816994 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1b163-c409-48a2-b9f3-0ded7af58948 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:08.817469 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1b163-c409-48a2-b9f3-0ded7af58948 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:08.818035 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1b163-c409-48a2-b9f3-0ded7af58948 None admin] PATH_INFO: `/v3/users/e7f2a812f0a7455abe8064344eabe693` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:08.820308 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1b163-c409-48a2-b9f3-0ded7af58948 None admin] RBAC: Authorizing `identity:get_user(user_id=e7f2a812f0a7455abe8064344eabe693)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:08.822898 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1b163-c409-48a2-b9f3-0ded7af58948 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:08.826168 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 72/127] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:48:08 2022] GET /identity/v3/users/e7f2a812f0a7455abe8064344eabe693 => generated 275 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:08.827475 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1b163-c409-48a2-b9f3-0ded7af58948 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:08.869682 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354636e-d43e-42fa-86a5-5327a3448e46 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:08.937223 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938add5-4907-4208-afd6-23a6288993f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:08.938933 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938add5-4907-4208-afd6-23a6288993f6 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:08.939784 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938add5-4907-4208-afd6-23a6288993f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:08.940575 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938add5-4907-4208-afd6-23a6288993f6 None admin] PATH_INFO: `/v3/projects/c8576b87aecf403699be87362271685d` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:08.942921 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938add5-4907-4208-afd6-23a6288993f6 None admin] RBAC: Authorizing `identity:get_project(project_id=c8576b87aecf403699be87362271685d)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:08.946134 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938add5-4907-4208-afd6-23a6288993f6 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:08.951510 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 56/128] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:08 2022] GET /identity/v3/projects/c8576b87aecf403699be87362271685d => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:08.953499 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938add5-4907-4208-afd6-23a6288993f6 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:09.020226 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1b163-c409-48a2-b9f3-0ded7af58948 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:09.082532 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa47f98-b1b9-4c7d-84b1-4a5b493eda86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:09.083557 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa47f98-b1b9-4c7d-84b1-4a5b493eda86 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:09.084143 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa47f98-b1b9-4c7d-84b1-4a5b493eda86 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:09.084694 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa47f98-b1b9-4c7d-84b1-4a5b493eda86 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:09.085734 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:09.085998 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa47f98-b1b9-4c7d-84b1-4a5b493eda86 None admin] RBAC: Adding query filter params (name=member) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:09.086468 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa47f98-b1b9-4c7d-84b1-4a5b493eda86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:09.088847 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa47f98-b1b9-4c7d-84b1-4a5b493eda86 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:09.104585 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 73/129] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Aug 2 08:48:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:09.106121 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa47f98-b1b9-4c7d-84b1-4a5b493eda86 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:09.156416 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938add5-4907-4208-afd6-23a6288993f6 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:09.173718 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:09.203370 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd596b1-c3a5-45e7-98ad-6ae4ed2a7d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:09.204400 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd596b1-c3a5-45e7-98ad-6ae4ed2a7d38 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:09.204690 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd596b1-c3a5-45e7-98ad-6ae4ed2a7d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:09.205447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd596b1-c3a5-45e7-98ad-6ae4ed2a7d38 None admin] PATH_INFO: `/v3/projects/c8576b87aecf403699be87362271685d` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:09.207657 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd596b1-c3a5-45e7-98ad-6ae4ed2a7d38 None admin] RBAC: Authorizing `identity:get_project(project_id=c8576b87aecf403699be87362271685d)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:09.209350 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd596b1-c3a5-45e7-98ad-6ae4ed2a7d38 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:09.211377 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 57/130] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:08 2022] GET /identity/v3/projects/c8576b87aecf403699be87362271685d => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:09.212137 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd596b1-c3a5-45e7-98ad-6ae4ed2a7d38 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:09.281114 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa47f98-b1b9-4c7d-84b1-4a5b493eda86 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:09.352497 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6dd03b-19de-436c-884a-ecfe2e5428a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:09.353727 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dd03b-19de-436c-884a-ecfe2e5428a9 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:09.354329 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dd03b-19de-436c-884a-ecfe2e5428a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:09.354827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dd03b-19de-436c-884a-ecfe2e5428a9 None admin] PATH_INFO: `/v3/projects/c8576b87aecf403699be87362271685d` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:09.355126 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd596b1-c3a5-45e7-98ad-6ae4ed2a7d38 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:09.357139 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6dd03b-19de-436c-884a-ecfe2e5428a9 None admin] RBAC: Authorizing `identity:get_project(project_id=c8576b87aecf403699be87362271685d)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:09.360050 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6dd03b-19de-436c-884a-ecfe2e5428a9 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:09.370159 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 74/131] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:09 2022] GET /identity/v3/projects/c8576b87aecf403699be87362271685d => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:09.370159 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffae48-1117-45ad-993a-7bcb7087133a None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:09.370159 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffae48-1117-45ad-993a-7bcb7087133a None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:09.370159 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffae48-1117-45ad-993a-7bcb7087133a None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:09.370159 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 75/132] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:09.371808 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ffae48-1117-45ad-993a-7bcb7087133a None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:09.403829 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:09.418778 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e6351-3e7d-4dfe-bcdb-a5f2739f7750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:09.419542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e6351-3e7d-4dfe-bcdb-a5f2739f7750 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:09.419843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e6351-3e7d-4dfe-bcdb-a5f2739f7750 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:09.420129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e6351-3e7d-4dfe-bcdb-a5f2739f7750 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:09.421137 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e6351-3e7d-4dfe-bcdb-a5f2739f7750 None admin] RBAC: Adding query filter params (role.id=6639a392f46d4388a120947fb8da02cc, scope.project.id=c8576b87aecf403699be87362271685d, user.id=9c0673c9ff77438792cce1f2fac6eb41) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:09.421593 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e6351-3e7d-4dfe-bcdb-a5f2739f7750 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:09.423211 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e6351-3e7d-4dfe-bcdb-a5f2739f7750 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:09.440194 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 58/133] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:48:09 2022] GET /identity/v3/role_assignments?user.id=9c0673c9ff77438792cce1f2fac6eb41&scope.project.id=c8576b87aecf403699be87362271685d&role.id=6639a392f46d4388a120947fb8da02cc => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:09.440194 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e6351-3e7d-4dfe-bcdb-a5f2739f7750 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:09.604304 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e6351-3e7d-4dfe-bcdb-a5f2739f7750 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:09.619943 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ffae48-1117-45ad-993a-7bcb7087133a None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:09.643310 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:09.670960 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c0ff9-e141-4d25-a3db-e79465d81430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:09.671927 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c0ff9-e141-4d25-a3db-e79465d81430 None admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:09.673179 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c0ff9-e141-4d25-a3db-e79465d81430 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:09.673889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c0ff9-e141-4d25-a3db-e79465d81430 None admin] PATH_INFO: `/v3/projects/c8576b87aecf403699be87362271685d/users/c124f3deb85b49f5a9becf0360ac8d93/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:09.677654 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c0ff9-e141-4d25-a3db-e79465d81430 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8576b87aecf403699be87362271685d, user_id=c124f3deb85b49f5a9becf0360ac8d93, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:09.680101 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c0ff9-e141-4d25-a3db-e79465d81430 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:09.703464 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5c267-8b02-4415-878c-7d9afbeccbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:09.707961 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5c267-8b02-4415-878c-7d9afbeccbc3 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:09.707961 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5c267-8b02-4415-878c-7d9afbeccbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:09.707961 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5c267-8b02-4415-878c-7d9afbeccbc3 None admin] PATH_INFO: `/v3/users/e7f2a812f0a7455abe8064344eabe693` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:09.707961 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5c267-8b02-4415-878c-7d9afbeccbc3 None admin] RBAC: Authorizing `identity:get_user(user_id=e7f2a812f0a7455abe8064344eabe693)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:09.709781 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5c267-8b02-4415-878c-7d9afbeccbc3 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:09.714526 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 76/134] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:48:09 2022] GET /identity/v3/users/e7f2a812f0a7455abe8064344eabe693 => generated 275 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:09.716212 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee1200-8313-4c69-bfab-ca0139e5a210 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:09.716212 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee1200-8313-4c69-bfab-ca0139e5a210 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:09.716212 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee1200-8313-4c69-bfab-ca0139e5a210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:09.747082 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-d7ee1200-8313-4c69-bfab-ca0139e5a210 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:09.749238 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-d7ee1200-8313-4c69-bfab-ca0139e5a210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:09.803568 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 59/135] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Aug 2 08:48:09 2022] PUT /identity/v3/projects/c8576b87aecf403699be87362271685d/users/c124f3deb85b49f5a9becf0360ac8d93/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:48:09.807011 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c0ff9-e141-4d25-a3db-e79465d81430 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:09.903186 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 77/136] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:09.904245 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee1200-8313-4c69-bfab-ca0139e5a210 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:09.924077 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:10.033616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c0ff9-e141-4d25-a3db-e79465d81430 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:10.115131 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc69025-a704-4569-9e5a-3763fd70f096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:10.120845 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc69025-a704-4569-9e5a-3763fd70f096 None admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:10.121820 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc69025-a704-4569-9e5a-3763fd70f096 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:10.122244 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc69025-a704-4569-9e5a-3763fd70f096 None admin] PATH_INFO: `/v3/projects/c8576b87aecf403699be87362271685d/users/e7f2a812f0a7455abe8064344eabe693/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:10.126907 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc69025-a704-4569-9e5a-3763fd70f096 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8576b87aecf403699be87362271685d, user_id=e7f2a812f0a7455abe8064344eabe693, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:10.129847 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc69025-a704-4569-9e5a-3763fd70f096 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:10.140742 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee1200-8313-4c69-bfab-ca0139e5a210 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:10.160028 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:10.204227 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d3abb-f5f2-4deb-a1ea-d3232650de7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:10.205159 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d3abb-f5f2-4deb-a1ea-d3232650de7b None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:10.205446 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d3abb-f5f2-4deb-a1ea-d3232650de7b None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:10.205736 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d3abb-f5f2-4deb-a1ea-d3232650de7b None admin] PATH_INFO: `/v3/projects/24217f09fa8b48ac99bcb1a2a3e306aa` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:10.207137 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d3abb-f5f2-4deb-a1ea-d3232650de7b None admin] RBAC: Authorizing `identity:get_project(project_id=24217f09fa8b48ac99bcb1a2a3e306aa)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:10.209912 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d3abb-f5f2-4deb-a1ea-d3232650de7b None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:10.212358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 78/137] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:09 2022] GET /identity/v3/projects/24217f09fa8b48ac99bcb1a2a3e306aa => generated 312 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:10.213280 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d3abb-f5f2-4deb-a1ea-d3232650de7b None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:10.244482 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 60/138] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Aug 2 08:48:09 2022] PUT /identity/v3/projects/c8576b87aecf403699be87362271685d/users/e7f2a812f0a7455abe8064344eabe693/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:48:10.247343 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc69025-a704-4569-9e5a-3763fd70f096 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:10.472566 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d3abb-f5f2-4deb-a1ea-d3232650de7b None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:10.533009 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc69025-a704-4569-9e5a-3763fd70f096 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:10.556713 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9c066-63ec-4363-bf32-5eeeb6e57c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:10.557762 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9c066-63ec-4363-bf32-5eeeb6e57c2f None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:10.558261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9c066-63ec-4363-bf32-5eeeb6e57c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:10.560727 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9c066-63ec-4363-bf32-5eeeb6e57c2f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:10.562085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:10.582436 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d9c066-63ec-4363-bf32-5eeeb6e57c2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:10.589437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-a5d9c066-63ec-4363-bf32-5eeeb6e57c2f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:48:10.589437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:10.589437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:10.589437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:10.589437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:10.589437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:10.589437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:10.589437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:10.589437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:10.589437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:10.589437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:10.589437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:10.589437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:10.589437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:10.589437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:10.589437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:10.590724 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:10.590724 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:10.590724 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:10.590724 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:10.590724 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:10.590724 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:10.590724 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:10.590724 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:10.590724 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:10.590724 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:10.590724 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:10.590724 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:10.590724 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:10.590724 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:10.590724 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:10.590724 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:10.591493 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:10.591493 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:10.591493 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:10.591493 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:10.591493 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:10.591493 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:10.591493 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:10.591493 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:10.591493 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:10.591493 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:10.591493 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:48:10.591493 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:48:10.591493 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 79/139] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Aug 2 08:48:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:10.595421 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f982c-ce27-4c98-ad6b-c22d77aaf9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:10.596505 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f982c-ce27-4c98-ad6b-c22d77aaf9cc None admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:10.596610 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7f06c-c036-453e-a7f8-0adbe7b6f9b9 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:10.596985 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7f06c-c036-453e-a7f8-0adbe7b6f9b9 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:10.597343 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f982c-ce27-4c98-ad6b-c22d77aaf9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:10.597892 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f982c-ce27-4c98-ad6b-c22d77aaf9cc None admin] PATH_INFO: `/v3/projects/24217f09fa8b48ac99bcb1a2a3e306aa/users/e7f2a812f0a7455abe8064344eabe693/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:10.598291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7f06c-c036-453e-a7f8-0adbe7b6f9b9 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:10.601320 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 80/140] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:10.605395 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7f06c-c036-453e-a7f8-0adbe7b6f9b9 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:10.606664 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f982c-ce27-4c98-ad6b-c22d77aaf9cc None admin] RBAC: Authorizing `identity:create_grant(project_id=24217f09fa8b48ac99bcb1a2a3e306aa, user_id=e7f2a812f0a7455abe8064344eabe693, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:10.608531 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f982c-ce27-4c98-ad6b-c22d77aaf9cc None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:10.669785 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:10.695772 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 61/141] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Aug 2 08:48:10 2022] PUT /identity/v3/projects/24217f09fa8b48ac99bcb1a2a3e306aa/users/e7f2a812f0a7455abe8064344eabe693/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:48:10.697576 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f3927-6a01-49a1-afdd-f8e5b92fba11 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:10.698124 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f3927-6a01-49a1-afdd-f8e5b92fba11 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:10.698612 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f3927-6a01-49a1-afdd-f8e5b92fba11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:10.741621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-952f3927-6a01-49a1-afdd-f8e5b92fba11 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:10.743332 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-952f3927-6a01-49a1-afdd-f8e5b92fba11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:10.753466 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7f06c-c036-453e-a7f8-0adbe7b6f9b9 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:10.798267 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d6c69-a914-49eb-8535-02f3df42ff16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:10.799038 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d6c69-a914-49eb-8535-02f3df42ff16 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:10.799511 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d6c69-a914-49eb-8535-02f3df42ff16 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:10.799684 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d6c69-a914-49eb-8535-02f3df42ff16 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:10.800600 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d6c69-a914-49eb-8535-02f3df42ff16 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:10.800912 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d6c69-a914-49eb-8535-02f3df42ff16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:10.802468 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d6c69-a914-49eb-8535-02f3df42ff16 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:10.812109 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 81/142] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:48:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:10.817906 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d6c69-a914-49eb-8535-02f3df42ff16 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:10.855061 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 62/143] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:10.884206 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f3927-6a01-49a1-afdd-f8e5b92fba11 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:10.939017 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:10.945488 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d6c69-a914-49eb-8535-02f3df42ff16 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:11.022859 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f3927-6a01-49a1-afdd-f8e5b92fba11 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:11.025580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68484e-9bc8-4f21-8522-78ac1f50a361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:11.026962 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68484e-9bc8-4f21-8522-78ac1f50a361 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:11.026962 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68484e-9bc8-4f21-8522-78ac1f50a361 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:11.027147 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:11.027215 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68484e-9bc8-4f21-8522-78ac1f50a361 None admin] PATH_INFO: `/v3/users/e7f2a812f0a7455abe8064344eabe693` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:11.033388 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68484e-9bc8-4f21-8522-78ac1f50a361 None admin] RBAC: Authorizing `identity:get_user(user_id=e7f2a812f0a7455abe8064344eabe693)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:11.034965 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68484e-9bc8-4f21-8522-78ac1f50a361 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:11.039119 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 82/144] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:48:10 2022] GET /identity/v3/users/e7f2a812f0a7455abe8064344eabe693 => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:11.045335 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68484e-9bc8-4f21-8522-78ac1f50a361 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:11.087537 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ff042-592e-46c3-94dc-6dd3c1341531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:11.088413 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ff042-592e-46c3-94dc-6dd3c1341531 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:11.088752 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ff042-592e-46c3-94dc-6dd3c1341531 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:11.089038 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ff042-592e-46c3-94dc-6dd3c1341531 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:11.091364 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ff042-592e-46c3-94dc-6dd3c1341531 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:11.092968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ff042-592e-46c3-94dc-6dd3c1341531 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:11.094990 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 63/145] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:48:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:48:11.100961 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ff042-592e-46c3-94dc-6dd3c1341531 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:11.205577 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68484e-9bc8-4f21-8522-78ac1f50a361 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:11.268091 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe752e-954f-4471-a9b4-6b5e47ce1211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:11.268783 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe752e-954f-4471-a9b4-6b5e47ce1211 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:11.269218 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe752e-954f-4471-a9b4-6b5e47ce1211 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:11.269689 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe752e-954f-4471-a9b4-6b5e47ce1211 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:11.310833 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:11.317370 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ff042-592e-46c3-94dc-6dd3c1341531 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:11.368025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9c84d-4ea5-466a-abd4-ce29e46d6d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:11.370146 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9c84d-4ea5-466a-abd4-ce29e46d6d62 None admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:11.372192 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9c84d-4ea5-466a-abd4-ce29e46d6d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:11.373063 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9c84d-4ea5-466a-abd4-ce29e46d6d62 None admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:11.374067 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9c84d-4ea5-466a-abd4-ce29e46d6d62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:11.377139 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9c84d-4ea5-466a-abd4-ce29e46d6d62 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:11.401449 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe752e-954f-4471-a9b4-6b5e47ce1211 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:11.403197 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe752e-954f-4471-a9b4-6b5e47ce1211 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:11.501381 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 64/146] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Aug 2 08:48:11 2022] POST /identity/v3/users => generated 283 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:48:11.620350 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 83/147] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:48:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:48:11.629413 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9c84d-4ea5-466a-abd4-ce29e46d6d62 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:11.674000 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:11.801210 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9c84d-4ea5-466a-abd4-ce29e46d6d62 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:11.876495 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1743f-5617-4bc7-89be-ad6c3060da59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:11.877646 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1743f-5617-4bc7-89be-ad6c3060da59 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:11.878170 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1743f-5617-4bc7-89be-ad6c3060da59 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:11.878654 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1743f-5617-4bc7-89be-ad6c3060da59 None admin] PATH_INFO: `/v3/projects/c8576b87aecf403699be87362271685d` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:11.880418 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1743f-5617-4bc7-89be-ad6c3060da59 None admin] RBAC: Authorizing `identity:get_project(project_id=c8576b87aecf403699be87362271685d)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:11.882539 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1743f-5617-4bc7-89be-ad6c3060da59 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:11.884696 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 65/148] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:11 2022] GET /identity/v3/projects/c8576b87aecf403699be87362271685d => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:11.893402 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe752e-954f-4471-a9b4-6b5e47ce1211 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:12.004774 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:12.059525 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe752e-954f-4471-a9b4-6b5e47ce1211 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:12.109289 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c2c3f-ab54-4ccf-812b-45360be0ed44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:12.109954 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c2c3f-ab54-4ccf-812b-45360be0ed44 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:12.110281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c2c3f-ab54-4ccf-812b-45360be0ed44 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:12.110561 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c2c3f-ab54-4ccf-812b-45360be0ed44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:12.111504 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c2c3f-ab54-4ccf-812b-45360be0ed44 None admin] RBAC: Adding query filter params (role.id=923eb688fccc4e79b6c3df28d754b6c4, scope.project.id=c8576b87aecf403699be87362271685d, user.id=e7f2a812f0a7455abe8064344eabe693) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:12.111826 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c2c3f-ab54-4ccf-812b-45360be0ed44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:12.113546 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c2c3f-ab54-4ccf-812b-45360be0ed44 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:12.126998 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 84/149] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:48:11 2022] GET /identity/v3/role_assignments?user.id=e7f2a812f0a7455abe8064344eabe693&scope.project.id=c8576b87aecf403699be87362271685d&role.id=923eb688fccc4e79b6c3df28d754b6c4 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:12.573322 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f068180-1dc1-4836-8bf9-a7837e7b78e3 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:12.573672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f068180-1dc1-4836-8bf9-a7837e7b78e3 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:12.573846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f068180-1dc1-4836-8bf9-a7837e7b78e3 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:12.577353 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 66/150] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:12.583245 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c5203-6dae-4d95-abd3-47f148c153f8 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:12.583525 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c5203-6dae-4d95-abd3-47f148c153f8 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:12.583810 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c5203-6dae-4d95-abd3-47f148c153f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:12.613786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-4b2c5203-6dae-4d95-abd3-47f148c153f8 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:12.614672 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-4b2c5203-6dae-4d95-abd3-47f148c153f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:12.708192 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 85/151] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:12.734726 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f068180-1dc1-4836-8bf9-a7837e7b78e3 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:12.850838 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:12.861061 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f068180-1dc1-4836-8bf9-a7837e7b78e3 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:12.912205 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31c82a-1077-49d4-9a0c-daae37e1bd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:12.912907 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31c82a-1077-49d4-9a0c-daae37e1bd47 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:12.913195 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31c82a-1077-49d4-9a0c-daae37e1bd47 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:12.913472 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31c82a-1077-49d4-9a0c-daae37e1bd47 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:12.931197 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e31c82a-1077-49d4-9a0c-daae37e1bd47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:12.937573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-2e31c82a-1077-49d4-9a0c-daae37e1bd47 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:48:12.937573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:12.937573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:12.937573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:12.937573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:12.937573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:12.937573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:12.937573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:12.937573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:12.937573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:12.937573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:12.937573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:12.937573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:12.937573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:12.937573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:12.937573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:12.938525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:12.938525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:12.938525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:12.938525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:12.938525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:12.938525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:12.938525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:12.938525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:12.938525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:12.938525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:12.938525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:12.938525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:12.938525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:12.938525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:12.938525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:12.938525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:12.939286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:12.939286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:12.939286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:12.939286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:12.939286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:12.939286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:12.939286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:12.939286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:12.939286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:12.939286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:12.939286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:48:12.939286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:48:12.939286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 67/152] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:48:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:12.945693 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c5203-6dae-4d95-abd3-47f148c153f8 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:13.031318 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:13.086247 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c5203-6dae-4d95-abd3-47f148c153f8 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:13.134894 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb5f2b-e0ff-4d84-809a-0ef5d5bd0265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:13.135544 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb5f2b-e0ff-4d84-809a-0ef5d5bd0265 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:13.135828 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb5f2b-e0ff-4d84-809a-0ef5d5bd0265 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:13.136107 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb5f2b-e0ff-4d84-809a-0ef5d5bd0265 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:13.137126 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb5f2b-e0ff-4d84-809a-0ef5d5bd0265 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:13.137459 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb5f2b-e0ff-4d84-809a-0ef5d5bd0265 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:13.139398 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb5f2b-e0ff-4d84-809a-0ef5d5bd0265 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:13.152462 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 86/153] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Aug 2 08:48:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:13.158546 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31c82a-1077-49d4-9a0c-daae37e1bd47 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:13.306907 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31c82a-1077-49d4-9a0c-daae37e1bd47 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:13.356063 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26821b14-21e9-4e03-ac9c-8b6b962a4508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:13.357418 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26821b14-21e9-4e03-ac9c-8b6b962a4508 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:13.357993 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26821b14-21e9-4e03-ac9c-8b6b962a4508 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:13.358507 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26821b14-21e9-4e03-ac9c-8b6b962a4508 None admin] PATH_INFO: `/v3/users/9c0673c9ff77438792cce1f2fac6eb41` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:13.360101 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26821b14-21e9-4e03-ac9c-8b6b962a4508 None admin] RBAC: Authorizing `identity:get_user(user_id=9c0673c9ff77438792cce1f2fac6eb41)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:13.361845 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26821b14-21e9-4e03-ac9c-8b6b962a4508 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:13.363914 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 68/154] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:48:13 2022] GET /identity/v3/users/9c0673c9ff77438792cce1f2fac6eb41 => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:13.370489 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb5f2b-e0ff-4d84-809a-0ef5d5bd0265 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:13.428086 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212a80e-cda3-4c23-8384-3a13ebb14fe1 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:13.428758 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212a80e-cda3-4c23-8384-3a13ebb14fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:13.429238 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212a80e-cda3-4c23-8384-3a13ebb14fe1 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:13.431360 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 69/155] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:13.454202 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1405d4-d9c3-40b0-8cd5-c7a4846456cb None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:13.454836 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1405d4-d9c3-40b0-8cd5-c7a4846456cb None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:13.455588 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1405d4-d9c3-40b0-8cd5-c7a4846456cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:13.497954 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-ce1405d4-d9c3-40b0-8cd5-c7a4846456cb None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:13.499224 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-ce1405d4-d9c3-40b0-8cd5-c7a4846456cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:13.536701 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:13.546572 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb5f2b-e0ff-4d84-809a-0ef5d5bd0265 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:13.572259 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:13.589448 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebab098-6375-4dec-98c5-0e415416341b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:13.590324 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebab098-6375-4dec-98c5-0e415416341b None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:13.590626 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebab098-6375-4dec-98c5-0e415416341b None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:13.590953 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebab098-6375-4dec-98c5-0e415416341b None admin] PATH_INFO: `/v3/projects/c8576b87aecf403699be87362271685d` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:13.592367 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebab098-6375-4dec-98c5-0e415416341b None admin] RBAC: Authorizing `identity:get_project(project_id=c8576b87aecf403699be87362271685d)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:13.594000 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebab098-6375-4dec-98c5-0e415416341b None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:13.595903 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 87/156] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:13 2022] GET /identity/v3/projects/c8576b87aecf403699be87362271685d => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:13.603466 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebab098-6375-4dec-98c5-0e415416341b None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:13.603684 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 70/157] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:48:13.610192 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4486f7e-f6ab-44dc-898e-099a2d2e3400 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:13.610633 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4486f7e-f6ab-44dc-898e-099a2d2e3400 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:13.611020 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4486f7e-f6ab-44dc-898e-099a2d2e3400 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:13.612570 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 71/158] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:48:13.625600 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b107e8-30f6-409d-9324-909db4bc48b1 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:13.626029 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b107e8-30f6-409d-9324-909db4bc48b1 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:13.626415 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b107e8-30f6-409d-9324-909db4bc48b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:13.661276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-f4b107e8-30f6-409d-9324-909db4bc48b1 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:13.662601 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-f4b107e8-30f6-409d-9324-909db4bc48b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:13.754891 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebab098-6375-4dec-98c5-0e415416341b None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:13.798670 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fff019-e02d-4076-88c7-6d8d60681808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:13.799389 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fff019-e02d-4076-88c7-6d8d60681808 None admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:13.799790 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fff019-e02d-4076-88c7-6d8d60681808 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:13.800074 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fff019-e02d-4076-88c7-6d8d60681808 None admin] PATH_INFO: `/v3/projects/c8576b87aecf403699be87362271685d/users/9c0673c9ff77438792cce1f2fac6eb41/roles/6639a392f46d4388a120947fb8da02cc` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:13.803492 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fff019-e02d-4076-88c7-6d8d60681808 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8576b87aecf403699be87362271685d, user_id=9c0673c9ff77438792cce1f2fac6eb41, role_id=6639a392f46d4388a120947fb8da02cc)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:13.805097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fff019-e02d-4076-88c7-6d8d60681808 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:13.809561 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 72/159] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:48:13.810650 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b107e8-30f6-409d-9324-909db4bc48b1 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:13.902468 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 88/160] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Aug 2 08:48:13 2022] PUT /identity/v3/projects/c8576b87aecf403699be87362271685d/users/9c0673c9ff77438792cce1f2fac6eb41/roles/6639a392f46d4388a120947fb8da02cc => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:48:13.908597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fff019-e02d-4076-88c7-6d8d60681808 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:13.967154 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:14.004840 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b107e8-30f6-409d-9324-909db4bc48b1 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:14.015422 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:14.114630 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa7d59-fdaf-4bc6-9283-90c2ff963855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:14.115747 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa7d59-fdaf-4bc6-9283-90c2ff963855 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:14.116283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa7d59-fdaf-4bc6-9283-90c2ff963855 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:14.116783 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa7d59-fdaf-4bc6-9283-90c2ff963855 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:14.147079 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fff019-e02d-4076-88c7-6d8d60681808 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:14.148715 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa7d59-fdaf-4bc6-9283-90c2ff963855 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:14.155066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-cefa7d59-fdaf-4bc6-9283-90c2ff963855 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:48:14.155066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:14.155066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:14.155066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:14.155066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:14.155066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:14.155066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:14.155066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:14.155066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:14.155066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:14.155066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:14.155066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:14.155066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:14.155066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:14.155066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:14.155066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:14.156006 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:14.156006 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:14.156006 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:14.156006 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:14.156006 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:14.156006 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:14.156006 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:14.156006 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:14.156006 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:14.156006 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:14.156006 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:14.156006 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:14.156006 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:14.156006 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:14.156006 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:14.156006 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:14.156820 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:14.156820 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:14.156820 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:14.156820 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:14.156820 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:14.156820 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:14.156820 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:14.156820 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:14.156820 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:14.156820 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:14.156820 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:48:14.156820 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:48:14.159402 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 73/161] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:48:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:14.168836 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa7d59-fdaf-4bc6-9283-90c2ff963855 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:14.213412 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030d977-859e-43b8-8183-8e5146ad7f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:14.214556 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030d977-859e-43b8-8183-8e5146ad7f74 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:14.215181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030d977-859e-43b8-8183-8e5146ad7f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:14.215658 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030d977-859e-43b8-8183-8e5146ad7f74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:14.238519 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2030d977-859e-43b8-8183-8e5146ad7f74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:14.245346 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-2030d977-859e-43b8-8183-8e5146ad7f74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:48:14.245346 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:14.245346 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:14.245346 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:14.245346 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:14.245346 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:14.245346 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:14.245346 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:14.245346 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:14.245346 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:14.245346 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:14.245346 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:14.245346 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:14.245346 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:14.245346 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:14.245346 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:14.246973 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:14.246973 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:14.246973 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:14.246973 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:14.246973 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:14.246973 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:14.246973 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:14.246973 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:14.246973 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:14.246973 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:14.246973 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:14.246973 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:14.246973 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:14.246973 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:14.246973 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:14.246973 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:14.247978 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:14.247978 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:14.247978 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:14.247978 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:14.247978 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:14.247978 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:14.247978 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:14.247978 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:14.247978 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:14.247978 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:14.247978 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:48:14.247978 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:48:14.250491 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 89/162] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:48:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:14.279434 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030d977-859e-43b8-8183-8e5146ad7f74 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:14.320841 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa7d59-fdaf-4bc6-9283-90c2ff963855 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:14.364191 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55da158-79e7-4dff-9837-8cb90edf7f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:14.364191 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55da158-79e7-4dff-9837-8cb90edf7f4d None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:14.364191 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55da158-79e7-4dff-9837-8cb90edf7f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:14.364191 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55da158-79e7-4dff-9837-8cb90edf7f4d None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:14.364595 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55da158-79e7-4dff-9837-8cb90edf7f4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:14.364595 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55da158-79e7-4dff-9837-8cb90edf7f4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:14.364595 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55da158-79e7-4dff-9837-8cb90edf7f4d None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:14.374461 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 74/163] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:48:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:48:14.381677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55da158-79e7-4dff-9837-8cb90edf7f4d None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:14.384942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:14.499008 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030d977-859e-43b8-8183-8e5146ad7f74 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:14.518890 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:14.522284 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55da158-79e7-4dff-9837-8cb90edf7f4d None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:14.562360 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e102d89-87c9-450c-96bb-787106d65ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:14.562961 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e102d89-87c9-450c-96bb-787106d65ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:14.563257 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e102d89-87c9-450c-96bb-787106d65ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:14.563539 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e102d89-87c9-450c-96bb-787106d65ab0 None admin] PATH_INFO: `/v3/users/c124f3deb85b49f5a9becf0360ac8d93` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:14.564894 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e102d89-87c9-450c-96bb-787106d65ab0 None admin] RBAC: Authorizing `identity:get_user(user_id=c124f3deb85b49f5a9becf0360ac8d93)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:14.566394 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e102d89-87c9-450c-96bb-787106d65ab0 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:14.568294 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 75/164] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:48:14 2022] GET /identity/v3/users/c124f3deb85b49f5a9becf0360ac8d93 => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:48:14.573355 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0dd921-c8c7-4d7b-a03f-5029220fe52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:14.575716 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e102d89-87c9-450c-96bb-787106d65ab0 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:14.578674 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dd921-c8c7-4d7b-a03f-5029220fe52c None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:14.578966 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dd921-c8c7-4d7b-a03f-5029220fe52c None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:14.579269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dd921-c8c7-4d7b-a03f-5029220fe52c None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:14.580047 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0dd921-c8c7-4d7b-a03f-5029220fe52c None admin] RBAC: Adding query filter params (name=member) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:14.587627 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0dd921-c8c7-4d7b-a03f-5029220fe52c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:14.589179 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0dd921-c8c7-4d7b-a03f-5029220fe52c None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:14.607761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 90/165] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Aug 2 08:48:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:14.626354 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0dd921-c8c7-4d7b-a03f-5029220fe52c None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:14.757223 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:14.842689 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0dd921-c8c7-4d7b-a03f-5029220fe52c None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:14.843144 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e102d89-87c9-450c-96bb-787106d65ab0 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:14.908801 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f51df-6f0c-4e87-b619-0eaa3a8353bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:14.909996 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f51df-6f0c-4e87-b619-0eaa3a8353bd None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:14.910619 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f51df-6f0c-4e87-b619-0eaa3a8353bd None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:14.911139 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f51df-6f0c-4e87-b619-0eaa3a8353bd None admin] PATH_INFO: `/v3/users/e7f2a812f0a7455abe8064344eabe693` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:14.912774 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f51df-6f0c-4e87-b619-0eaa3a8353bd None admin] RBAC: Authorizing `identity:get_user(user_id=e7f2a812f0a7455abe8064344eabe693)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:14.914570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f51df-6f0c-4e87-b619-0eaa3a8353bd None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:14.916658 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 91/166] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:48:14 2022] GET /identity/v3/users/e7f2a812f0a7455abe8064344eabe693 => generated 275 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:14.925915 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f51df-6f0c-4e87-b619-0eaa3a8353bd None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:14.926274 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19869faa-917f-4f4a-ae8d-b7379f97743d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:14.927046 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19869faa-917f-4f4a-ae8d-b7379f97743d None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:14.927332 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19869faa-917f-4f4a-ae8d-b7379f97743d None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:14.927619 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19869faa-917f-4f4a-ae8d-b7379f97743d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:15.005860 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:15.020241 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19869faa-917f-4f4a-ae8d-b7379f97743d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:15.020241 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19869faa-917f-4f4a-ae8d-b7379f97743d None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:15.128138 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f51df-6f0c-4e87-b619-0eaa3a8353bd None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:15.145576 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:15.186993 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a94d1-bd83-4c29-9a8a-0346c765ed78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:15.188045 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a94d1-bd83-4c29-9a8a-0346c765ed78 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:15.188544 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a94d1-bd83-4c29-9a8a-0346c765ed78 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:15.189172 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a94d1-bd83-4c29-9a8a-0346c765ed78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:15.224193 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 76/167] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:48:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 08:48:15.229272 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19869faa-917f-4f4a-ae8d-b7379f97743d None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:15.311357 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a94d1-bd83-4c29-9a8a-0346c765ed78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:15.313277 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a94d1-bd83-4c29-9a8a-0346c765ed78 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:15.360016 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:15.458342 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 92/168] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:48:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:48:15.460356 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd96d3-ad1d-43a7-9822-72a6a753e206 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:15.460863 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd96d3-ad1d-43a7-9822-72a6a753e206 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:15.461346 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd96d3-ad1d-43a7-9822-72a6a753e206 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:15.463476 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 93/169] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:15.471217 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd96d3-ad1d-43a7-9822-72a6a753e206 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:15.509811 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19869faa-917f-4f4a-ae8d-b7379f97743d None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:15.613365 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7decf2-7a84-411f-8a97-bb322aff7a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:15.614711 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7decf2-7a84-411f-8a97-bb322aff7a0d None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:15.614711 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7decf2-7a84-411f-8a97-bb322aff7a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:15.614975 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7decf2-7a84-411f-8a97-bb322aff7a0d None admin] PATH_INFO: `/v3/projects/c8576b87aecf403699be87362271685d` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:15.617139 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7decf2-7a84-411f-8a97-bb322aff7a0d None admin] RBAC: Authorizing `identity:get_project(project_id=c8576b87aecf403699be87362271685d)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:15.618989 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7decf2-7a84-411f-8a97-bb322aff7a0d None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:15.634984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 77/170] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:15 2022] GET /identity/v3/projects/c8576b87aecf403699be87362271685d => generated 298 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:48:15.642697 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6288d-c638-4d3d-8048-253180118df9 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:15.643103 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6288d-c638-4d3d-8048-253180118df9 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:15.643294 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6288d-c638-4d3d-8048-253180118df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:15.722094 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-cdb6288d-c638-4d3d-8048-253180118df9 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:15.723962 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-cdb6288d-c638-4d3d-8048-253180118df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:15.800932 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd96d3-ad1d-43a7-9822-72a6a753e206 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:15.833340 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:15.907936 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7bd58-7982-43dc-b29c-3ddbe50e18a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:15.908671 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7bd58-7982-43dc-b29c-3ddbe50e18a8 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:15.909074 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7bd58-7982-43dc-b29c-3ddbe50e18a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:15.909479 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7bd58-7982-43dc-b29c-3ddbe50e18a8 None admin] PATH_INFO: `/v3/projects/c8576b87aecf403699be87362271685d` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:15.911811 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7bd58-7982-43dc-b29c-3ddbe50e18a8 None admin] RBAC: Authorizing `identity:get_project(project_id=c8576b87aecf403699be87362271685d)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:15.919454 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7bd58-7982-43dc-b29c-3ddbe50e18a8 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:15.921799 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 94/171] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:15 2022] GET /identity/v3/projects/c8576b87aecf403699be87362271685d => generated 298 bytes in 452 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:48:15.929222 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7bd58-7982-43dc-b29c-3ddbe50e18a8 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:15.952131 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 78/172] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:15.957128 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6288d-c638-4d3d-8048-253180118df9 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:15.958344 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:16.242554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6288d-c638-4d3d-8048-253180118df9 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:16.259881 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7bd58-7982-43dc-b29c-3ddbe50e18a8 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:16.363592 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6261a520-cc6c-419d-b9ca-ae1f15c13841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:16.364785 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261a520-cc6c-419d-b9ca-ae1f15c13841 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:16.365440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261a520-cc6c-419d-b9ca-ae1f15c13841 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:16.366490 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261a520-cc6c-419d-b9ca-ae1f15c13841 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:16.368372 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6261a520-cc6c-419d-b9ca-ae1f15c13841 None admin] RBAC: Adding query filter params (role.id=5fd593d076084fbaa9208dd505b58150, scope.project.id=c8576b87aecf403699be87362271685d, user.id=e7f2a812f0a7455abe8064344eabe693) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:16.369247 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6261a520-cc6c-419d-b9ca-ae1f15c13841 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:16.372589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6261a520-cc6c-419d-b9ca-ae1f15c13841 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:16.389824 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 79/173] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:48:15 2022] GET /identity/v3/role_assignments?user.id=e7f2a812f0a7455abe8064344eabe693&scope.project.id=c8576b87aecf403699be87362271685d&role.id=5fd593d076084fbaa9208dd505b58150 => generated 608 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:16.391811 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6261a520-cc6c-419d-b9ca-ae1f15c13841 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:16.416498 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d03882-4130-46a0-bf4e-fb16eb5f4b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:16.418704 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d03882-4130-46a0-bf4e-fb16eb5f4b18 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:16.419442 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d03882-4130-46a0-bf4e-fb16eb5f4b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:16.420432 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d03882-4130-46a0-bf4e-fb16eb5f4b18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:16.422198 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d03882-4130-46a0-bf4e-fb16eb5f4b18 None admin] RBAC: Adding query filter params (role.id=b5477d3c4e5a4514b64211ec2452d1d8, scope.project.id=c8576b87aecf403699be87362271685d, user.id=c124f3deb85b49f5a9becf0360ac8d93) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:16.422938 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d03882-4130-46a0-bf4e-fb16eb5f4b18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:16.428139 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d03882-4130-46a0-bf4e-fb16eb5f4b18 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:16.453335 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 95/174] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:48:15 2022] GET /identity/v3/role_assignments?user.id=c124f3deb85b49f5a9becf0360ac8d93&scope.project.id=c8576b87aecf403699be87362271685d&role.id=b5477d3c4e5a4514b64211ec2452d1d8 => generated 608 bytes in 531 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:16.460537 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955d8c5-a0b4-42e3-b478-e7a3d03648ab None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:16.460819 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955d8c5-a0b4-42e3-b478-e7a3d03648ab None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:16.461176 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955d8c5-a0b4-42e3-b478-e7a3d03648ab None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:16.462649 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 96/175] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:16.471613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580c0d5-7994-4c04-b732-6e9adb2b615d None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:16.472772 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580c0d5-7994-4c04-b732-6e9adb2b615d None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:16.473564 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580c0d5-7994-4c04-b732-6e9adb2b615d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:16.504768 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:16.545972 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-7580c0d5-7994-4c04-b732-6e9adb2b615d None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:16.548893 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-7580c0d5-7994-4c04-b732-6e9adb2b615d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:16.787532 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6261a520-cc6c-419d-b9ca-ae1f15c13841 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:16.824486 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:16.836688 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 97/176] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:16.876276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aeaaee-a448-4e1d-8226-1042f32b1e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:16.877029 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aeaaee-a448-4e1d-8226-1042f32b1e07 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:16.877313 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aeaaee-a448-4e1d-8226-1042f32b1e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:16.877585 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aeaaee-a448-4e1d-8226-1042f32b1e07 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:16.895570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580c0d5-7994-4c04-b732-6e9adb2b615d None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:16.905365 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aeaaee-a448-4e1d-8226-1042f32b1e07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:16.910806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-81aeaaee-a448-4e1d-8226-1042f32b1e07 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:48:16.910806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:16.910806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:16.910806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:16.910806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:16.910806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:16.910806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:16.910806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:16.910806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:16.910806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:16.910806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:16.910806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:16.910806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:16.910806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:16.910806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:16.910806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:16.911806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:16.911806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:16.911806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:16.911806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:16.911806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:16.911806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:16.911806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:16.911806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:16.911806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:16.911806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:16.911806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:16.911806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:16.911806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:16.911806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:16.911806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:16.911806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:16.912626 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:16.912626 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:16.912626 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:16.912626 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:16.912626 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:16.912626 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:16.912626 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:16.912626 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:16.912626 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:16.912626 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:16.912626 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:48:16.912626 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:48:16.912626 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 80/177] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:48:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 521 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:16.920644 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aeaaee-a448-4e1d-8226-1042f32b1e07 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:17.232130 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:17.253561 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580c0d5-7994-4c04-b732-6e9adb2b615d None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:17.264372 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aeaaee-a448-4e1d-8226-1042f32b1e07 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:17.352797 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a34119-6203-464d-b804-a5092ae8b7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:17.353448 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a34119-6203-464d-b804-a5092ae8b7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:17.353728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a34119-6203-464d-b804-a5092ae8b7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:17.354050 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a34119-6203-464d-b804-a5092ae8b7c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:17.354800 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a34119-6203-464d-b804-a5092ae8b7c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:17.355127 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a34119-6203-464d-b804-a5092ae8b7c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:17.356892 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a34119-6203-464d-b804-a5092ae8b7c8 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:17.367221 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90392b49-e51b-49fb-a123-f554bc068f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:17.368036 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90392b49-e51b-49fb-a123-f554bc068f41 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:17.368387 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90392b49-e51b-49fb-a123-f554bc068f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:17.368535 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90392b49-e51b-49fb-a123-f554bc068f41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:17.384710 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 81/178] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Aug 2 08:48:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 464 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:17.392960 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90392b49-e51b-49fb-a123-f554bc068f41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:17.394319 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a34119-6203-464d-b804-a5092ae8b7c8 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:17.412470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-90392b49-e51b-49fb-a123-f554bc068f41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:48:17.412470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:17.412470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:17.412470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:17.412470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:17.412470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:17.412470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:17.412470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:17.412470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:17.412470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:17.412470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:17.412470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:17.412470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:17.412470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:17.412470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:17.412470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:17.419945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:17.419945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:17.419945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:17.419945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:17.419945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:17.419945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:17.419945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:17.419945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:17.419945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:17.419945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:17.419945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:17.419945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:17.419945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:17.419945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:17.419945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:17.419945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:17.423128 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:17.423128 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:17.423128 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:17.423128 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:17.423128 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:17.423128 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:17.423128 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:17.423128 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:17.423128 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:17.423128 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:17.423128 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:48:17.423128 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:48:17.423128 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 98/179] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:48:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 523 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:17.425680 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90392b49-e51b-49fb-a123-f554bc068f41 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:17.589260 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:17.678385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90392b49-e51b-49fb-a123-f554bc068f41 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:17.694896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a34119-6203-464d-b804-a5092ae8b7c8 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:17.718127 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13119bfd-1c98-483f-9f31-d51e66d2c9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:17.718769 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13119bfd-1c98-483f-9f31-d51e66d2c9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:17.719047 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13119bfd-1c98-483f-9f31-d51e66d2c9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:17.719320 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13119bfd-1c98-483f-9f31-d51e66d2c9a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:17.720060 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13119bfd-1c98-483f-9f31-d51e66d2c9a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:17.720404 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13119bfd-1c98-483f-9f31-d51e66d2c9a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:17.721839 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13119bfd-1c98-483f-9f31-d51e66d2c9a3 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:17.732861 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 99/180] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:48:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:17.743354 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13119bfd-1c98-483f-9f31-d51e66d2c9a3 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:17.772084 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4390e-8a98-4dc0-b17a-107432855773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:17.773879 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4390e-8a98-4dc0-b17a-107432855773 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:17.774820 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4390e-8a98-4dc0-b17a-107432855773 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:17.775601 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4390e-8a98-4dc0-b17a-107432855773 None admin] PATH_INFO: `/v3/users/e7f2a812f0a7455abe8064344eabe693` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:17.778637 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4390e-8a98-4dc0-b17a-107432855773 None admin] RBAC: Authorizing `identity:get_user(user_id=e7f2a812f0a7455abe8064344eabe693)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:17.782249 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4390e-8a98-4dc0-b17a-107432855773 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:17.793509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 82/181] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:48:17 2022] GET /identity/v3/users/e7f2a812f0a7455abe8064344eabe693 => generated 275 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:48:17.803205 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4390e-8a98-4dc0-b17a-107432855773 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:17.862109 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:17.900348 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13119bfd-1c98-483f-9f31-d51e66d2c9a3 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:17.931490 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:17.955786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850deee-2964-4055-b721-262b08c02c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:17.957525 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850deee-2964-4055-b721-262b08c02c78 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:17.958231 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850deee-2964-4055-b721-262b08c02c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:17.958742 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850deee-2964-4055-b721-262b08c02c78 None admin] PATH_INFO: `/v3/users/d2858c5f061f4e5ea34e7a559d960d06` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:17.994910 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850deee-2964-4055-b721-262b08c02c78 None admin] RBAC: Authorizing `identity:get_user(user_id=d2858c5f061f4e5ea34e7a559d960d06)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:17.997819 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850deee-2964-4055-b721-262b08c02c78 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:18.000438 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 100/182] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:48:17 2022] GET /identity/v3/users/d2858c5f061f4e5ea34e7a559d960d06 => generated 283 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:18.002409 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c6fd3-0a3f-47b0-9499-0d0711ffc178 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:18.002976 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c6fd3-0a3f-47b0-9499-0d0711ffc178 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:18.003542 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c6fd3-0a3f-47b0-9499-0d0711ffc178 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:18.005216 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 101/183] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:18.008921 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c6fd3-0a3f-47b0-9499-0d0711ffc178 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:18.042180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4390e-8a98-4dc0-b17a-107432855773 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:18.092525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5114f-8931-47e2-9939-0b2816287be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:18.093182 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5114f-8931-47e2-9939-0b2816287be4 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:18.093612 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5114f-8931-47e2-9939-0b2816287be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:18.093886 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5114f-8931-47e2-9939-0b2816287be4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:18.170148 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c6fd3-0a3f-47b0-9499-0d0711ffc178 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:18.210442 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5114f-8931-47e2-9939-0b2816287be4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:18.212279 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5114f-8931-47e2-9939-0b2816287be4 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:18.232803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd039936-59a4-4025-b01d-ee47ffc5d69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:18.233885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd039936-59a4-4025-b01d-ee47ffc5d69f None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:18.234383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd039936-59a4-4025-b01d-ee47ffc5d69f None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:18.234871 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd039936-59a4-4025-b01d-ee47ffc5d69f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:18.248235 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:18.331300 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:18.357373 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd039936-59a4-4025-b01d-ee47ffc5d69f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:18.358984 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd039936-59a4-4025-b01d-ee47ffc5d69f None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:18.385876 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 83/184] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:48:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 08:48:18.390271 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f5ea3-06ad-42ce-856a-13008ec7f95e None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:18.390671 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f5ea3-06ad-42ce-856a-13008ec7f95e None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:18.390916 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f5ea3-06ad-42ce-856a-13008ec7f95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:18.416621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-801f5ea3-06ad-42ce-856a-13008ec7f95e None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:18.418675 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-801f5ea3-06ad-42ce-856a-13008ec7f95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:18.490813 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 102/185] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:48:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:48:18.492016 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28b995-6d51-4c92-b78c-70db722c6d59 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:18.492370 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28b995-6d51-4c92-b78c-70db722c6d59 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:18.492652 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28b995-6d51-4c92-b78c-70db722c6d59 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:18.494002 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 103/186] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:18.496574 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a3645-1c1c-43f3-bdd6-8c1acb4ca31c None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:18.497040 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a3645-1c1c-43f3-bdd6-8c1acb4ca31c None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:18.497322 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a3645-1c1c-43f3-bdd6-8c1acb4ca31c None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:18.498788 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 104/187] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:18.499614 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a3645-1c1c-43f3-bdd6-8c1acb4ca31c None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:18.599356 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 84/188] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:18.601980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f5ea3-06ad-42ce-856a-13008ec7f95e None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:18.635948 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:18.661484 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a3645-1c1c-43f3-bdd6-8c1acb4ca31c None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:18.682658 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:18.707665 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca6006-3ac7-4000-bbf3-6ac7f04aa710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:18.708470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca6006-3ac7-4000-bbf3-6ac7f04aa710 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:18.708827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca6006-3ac7-4000-bbf3-6ac7f04aa710 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:18.709159 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca6006-3ac7-4000-bbf3-6ac7f04aa710 None admin] PATH_INFO: `/v3/projects/24217f09fa8b48ac99bcb1a2a3e306aa` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:18.710552 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ca6006-3ac7-4000-bbf3-6ac7f04aa710 None admin] RBAC: Authorizing `identity:get_project(project_id=24217f09fa8b48ac99bcb1a2a3e306aa)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:18.712770 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ca6006-3ac7-4000-bbf3-6ac7f04aa710 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:18.714478 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 105/189] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:18 2022] GET /identity/v3/projects/24217f09fa8b48ac99bcb1a2a3e306aa => generated 312 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:18.717470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914972b-67ad-4ec1-854d-50acdfd66b0e None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:18.718647 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914972b-67ad-4ec1-854d-50acdfd66b0e None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:18.718647 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914972b-67ad-4ec1-854d-50acdfd66b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:18.740929 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-7914972b-67ad-4ec1-854d-50acdfd66b0e None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:18.742211 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-7914972b-67ad-4ec1-854d-50acdfd66b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:18.750420 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f5ea3-06ad-42ce-856a-13008ec7f95e None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:18.791799 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f68558-d67d-4ba5-9b90-9b6c17525997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:18.792564 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f68558-d67d-4ba5-9b90-9b6c17525997 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:18.793420 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f68558-d67d-4ba5-9b90-9b6c17525997 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:18.794396 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f68558-d67d-4ba5-9b90-9b6c17525997 None admin] PATH_INFO: `/v3/projects/2937cdbeb750480e8d69fe400d2cca9e` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:18.795146 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f68558-d67d-4ba5-9b90-9b6c17525997 None admin] RBAC: Authorizing `identity:get_project(project_id=2937cdbeb750480e8d69fe400d2cca9e)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:18.796884 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f68558-d67d-4ba5-9b90-9b6c17525997 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:18.798674 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 85/190] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:18 2022] GET /identity/v3/projects/2937cdbeb750480e8d69fe400d2cca9e => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:18.799884 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef1d82-e447-4ed7-a2f2-48f34b9e29be None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:18.800274 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef1d82-e447-4ed7-a2f2-48f34b9e29be None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:18.800548 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef1d82-e447-4ed7-a2f2-48f34b9e29be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:18.821190 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-30ef1d82-e447-4ed7-a2f2-48f34b9e29be None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:18.822415 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-30ef1d82-e447-4ed7-a2f2-48f34b9e29be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:18.831944 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 106/191] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:18.833812 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914972b-67ad-4ec1-854d-50acdfd66b0e None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:18.914473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 86/192] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:18.916005 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef1d82-e447-4ed7-a2f2-48f34b9e29be None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:18.942439 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:18.968836 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914972b-67ad-4ec1-854d-50acdfd66b0e None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:19.010791 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:19.022576 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228a188-bd6c-4615-ac5c-bfec75dd18d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:19.028412 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228a188-bd6c-4615-ac5c-bfec75dd18d2 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:19.028412 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228a188-bd6c-4615-ac5c-bfec75dd18d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:19.028412 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228a188-bd6c-4615-ac5c-bfec75dd18d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:19.028412 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d228a188-bd6c-4615-ac5c-bfec75dd18d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:19.028962 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d228a188-bd6c-4615-ac5c-bfec75dd18d2 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:19.031159 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 107/193] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:48:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:19.034261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228a188-bd6c-4615-ac5c-bfec75dd18d2 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:19.099242 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef1d82-e447-4ed7-a2f2-48f34b9e29be None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:19.143849 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a66e78-38be-4abe-8660-80ee88de0948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:19.144724 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a66e78-38be-4abe-8660-80ee88de0948 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:19.145008 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a66e78-38be-4abe-8660-80ee88de0948 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:19.145346 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a66e78-38be-4abe-8660-80ee88de0948 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:19.146163 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a66e78-38be-4abe-8660-80ee88de0948 None admin] RBAC: Adding query filter params (role.id=5fd593d076084fbaa9208dd505b58150, scope.project.id=24217f09fa8b48ac99bcb1a2a3e306aa, user.id=e7f2a812f0a7455abe8064344eabe693) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:19.146471 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a66e78-38be-4abe-8660-80ee88de0948 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:19.147993 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a66e78-38be-4abe-8660-80ee88de0948 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:19.155096 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 87/194] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:48:18 2022] GET /identity/v3/role_assignments?user.id=e7f2a812f0a7455abe8064344eabe693&scope.project.id=24217f09fa8b48ac99bcb1a2a3e306aa&role.id=5fd593d076084fbaa9208dd505b58150 => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:19.155964 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a66e78-38be-4abe-8660-80ee88de0948 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:19.205183 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228a188-bd6c-4615-ac5c-bfec75dd18d2 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:19.267223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604754ca-41a4-4e6a-b1ae-5860c0b4a4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:19.268202 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604754ca-41a4-4e6a-b1ae-5860c0b4a4ec None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:19.268689 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604754ca-41a4-4e6a-b1ae-5860c0b4a4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:19.269313 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604754ca-41a4-4e6a-b1ae-5860c0b4a4ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:19.271822 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604754ca-41a4-4e6a-b1ae-5860c0b4a4ec None admin] RBAC: Adding query filter params (role.id=b5477d3c4e5a4514b64211ec2452d1d8, scope.project.id=2937cdbeb750480e8d69fe400d2cca9e, user.id=d2858c5f061f4e5ea34e7a559d960d06) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:19.272397 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604754ca-41a4-4e6a-b1ae-5860c0b4a4ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:19.277162 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604754ca-41a4-4e6a-b1ae-5860c0b4a4ec None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:19.294101 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 108/195] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:48:19 2022] GET /identity/v3/role_assignments?user.id=d2858c5f061f4e5ea34e7a559d960d06&scope.project.id=2937cdbeb750480e8d69fe400d2cca9e&role.id=b5477d3c4e5a4514b64211ec2452d1d8 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:19.294101 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604754ca-41a4-4e6a-b1ae-5860c0b4a4ec None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:19.315268 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:19.350285 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a66e78-38be-4abe-8660-80ee88de0948 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:19.383620 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:19.435697 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67179600-0db5-422d-9cf3-e4ee990550a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:19.436808 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67179600-0db5-422d-9cf3-e4ee990550a4 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:19.437275 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67179600-0db5-422d-9cf3-e4ee990550a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:19.437734 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67179600-0db5-422d-9cf3-e4ee990550a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:19.455769 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67179600-0db5-422d-9cf3-e4ee990550a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:19.462768 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-67179600-0db5-422d-9cf3-e4ee990550a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:48:19.462768 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:19.462768 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:19.462768 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:19.462768 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:19.462768 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:19.462768 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:19.462768 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:19.462768 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:19.462768 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:19.462768 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:19.462768 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:19.462768 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:19.462768 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:19.462768 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:19.462768 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:19.464428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:19.464428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:19.464428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:19.464428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:19.464428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:19.464428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:19.464428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:19.464428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:19.464428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:19.464428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:19.464428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:19.464428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:19.464428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:19.464428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:19.464428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:19.464428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:19.466348 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:19.466348 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:19.466348 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:19.466348 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:19.466348 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:19.466348 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:19.466348 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:19.466348 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:19.466348 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:19.466348 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:19.466348 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:48:19.466348 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:48:19.466348 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 88/196] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Aug 2 08:48:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:19.466348 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67179600-0db5-422d-9cf3-e4ee990550a4 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:19.493837 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604754ca-41a4-4e6a-b1ae-5860c0b4a4ec None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:19.565030 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b54d38-54be-4ae1-aac6-6723929ca913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:19.566051 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b54d38-54be-4ae1-aac6-6723929ca913 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:19.566512 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b54d38-54be-4ae1-aac6-6723929ca913 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:19.566975 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b54d38-54be-4ae1-aac6-6723929ca913 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:19.588683 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b54d38-54be-4ae1-aac6-6723929ca913 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:19.598697 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-88b54d38-54be-4ae1-aac6-6723929ca913 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:48:19.598697 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:19.598697 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:19.598697 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:19.598697 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:19.598697 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:19.598697 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:19.598697 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:19.598697 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:19.598697 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:19.598697 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:19.598697 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:19.598697 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:19.598697 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:19.598697 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:19.598697 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:19.600746 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:19.600746 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:19.600746 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:19.600746 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:19.600746 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:19.600746 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:19.600746 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:19.600746 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:19.600746 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:19.600746 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:19.600746 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:19.600746 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:19.600746 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:19.600746 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:19.600746 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:19.600746 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:19.602677 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:19.602677 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:19.602677 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:19.602677 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:19.602677 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:19.602677 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:19.602677 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:19.602677 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:19.602677 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:19.602677 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:19.602677 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:48:19.602677 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:48:19.602677 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 109/197] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:48:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:19.602677 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b54d38-54be-4ae1-aac6-6723929ca913 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:19.654180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67179600-0db5-422d-9cf3-e4ee990550a4 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:19.709396 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ea7e5-af6a-4864-ad8c-438951ce57ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:19.710376 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ea7e5-af6a-4864-ad8c-438951ce57ad None admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:19.710806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ea7e5-af6a-4864-ad8c-438951ce57ad None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:19.711248 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ea7e5-af6a-4864-ad8c-438951ce57ad None admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:19.712448 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725ea7e5-af6a-4864-ad8c-438951ce57ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:19.713041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:19.715700 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725ea7e5-af6a-4864-ad8c-438951ce57ad None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:19.758628 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b54d38-54be-4ae1-aac6-6723929ca913 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:19.822093 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913123ef-2b1d-4266-a648-ddb10b9f414b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:19.823089 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913123ef-2b1d-4266-a648-ddb10b9f414b None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:19.823641 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913123ef-2b1d-4266-a648-ddb10b9f414b None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:19.824778 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913123ef-2b1d-4266-a648-ddb10b9f414b None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:19.826122 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913123ef-2b1d-4266-a648-ddb10b9f414b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:19.826676 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913123ef-2b1d-4266-a648-ddb10b9f414b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:19.829366 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913123ef-2b1d-4266-a648-ddb10b9f414b None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:19.845154 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 110/198] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:48:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:19.847574 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913123ef-2b1d-4266-a648-ddb10b9f414b None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:19.860196 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 89/199] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Aug 2 08:48:19 2022] POST /identity/v3/users => generated 297 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:48:19.860196 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ea7e5-af6a-4864-ad8c-438951ce57ad None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:19.915696 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:20.021666 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ea7e5-af6a-4864-ad8c-438951ce57ad None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:20.049535 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913123ef-2b1d-4266-a648-ddb10b9f414b None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:20.072976 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc8f2a-36fa-4a2a-a600-c02517f8dfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:20.073482 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc8f2a-36fa-4a2a-a600-c02517f8dfbb None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:20.075273 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc8f2a-36fa-4a2a-a600-c02517f8dfbb None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:20.075273 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc8f2a-36fa-4a2a-a600-c02517f8dfbb None admin] PATH_INFO: `/v3/users/d2858c5f061f4e5ea34e7a559d960d06` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:20.079904 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc8f2a-36fa-4a2a-a600-c02517f8dfbb None admin] RBAC: Authorizing `identity:get_user(user_id=d2858c5f061f4e5ea34e7a559d960d06)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:20.082862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc8f2a-36fa-4a2a-a600-c02517f8dfbb None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:20.086483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 90/200] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:48:19 2022] GET /identity/v3/users/d2858c5f061f4e5ea34e7a559d960d06 => generated 283 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:20.096619 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc8f2a-36fa-4a2a-a600-c02517f8dfbb None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:20.119235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:20.132518 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8a602-1c6e-4db8-b4af-720580d8dafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:20.133310 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8a602-1c6e-4db8-b4af-720580d8dafe None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:20.135617 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8a602-1c6e-4db8-b4af-720580d8dafe None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:20.135617 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8a602-1c6e-4db8-b4af-720580d8dafe None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:20.135617 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8a602-1c6e-4db8-b4af-720580d8dafe None admin] RBAC: Adding query filter params (name=reader) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:20.135617 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8a602-1c6e-4db8-b4af-720580d8dafe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:20.137219 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8a602-1c6e-4db8-b4af-720580d8dafe None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:20.150453 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 111/201] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Aug 2 08:48:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:20.165284 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8a602-1c6e-4db8-b4af-720580d8dafe None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:20.307837 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc8f2a-36fa-4a2a-a600-c02517f8dfbb None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:20.312738 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:20.337757 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8a602-1c6e-4db8-b4af-720580d8dafe None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:20.355517 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3abff0-459f-4538-b8ab-0e14feb89f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:20.356530 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3abff0-459f-4538-b8ab-0e14feb89f51 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:20.356530 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3abff0-459f-4538-b8ab-0e14feb89f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:20.356958 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3abff0-459f-4538-b8ab-0e14feb89f51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:20.396220 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee29ebb-8459-4b19-8265-00b6e1a9a49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:20.397701 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee29ebb-8459-4b19-8265-00b6e1a9a49b None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:20.398469 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee29ebb-8459-4b19-8265-00b6e1a9a49b None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:20.398751 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee29ebb-8459-4b19-8265-00b6e1a9a49b None admin] PATH_INFO: `/v3/users/9c0673c9ff77438792cce1f2fac6eb41` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:20.401054 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee29ebb-8459-4b19-8265-00b6e1a9a49b None admin] RBAC: Authorizing `identity:get_user(user_id=9c0673c9ff77438792cce1f2fac6eb41)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:20.402964 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee29ebb-8459-4b19-8265-00b6e1a9a49b None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:20.406297 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 112/202] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:48:20 2022] GET /identity/v3/users/9c0673c9ff77438792cce1f2fac6eb41 => generated 289 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:48:20.412550 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee29ebb-8459-4b19-8265-00b6e1a9a49b None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:20.461460 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3abff0-459f-4538-b8ab-0e14feb89f51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:20.462970 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3abff0-459f-4538-b8ab-0e14feb89f51 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:20.552553 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:20.640733 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee29ebb-8459-4b19-8265-00b6e1a9a49b None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:20.656474 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:20.662187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 91/203] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:48:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 08:48:20.670776 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3abff0-459f-4538-b8ab-0e14feb89f51 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:20.732051 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa102e-4814-4b3b-a2b1-f57119a6b5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:20.733043 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa102e-4814-4b3b-a2b1-f57119a6b5ff None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:20.733538 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa102e-4814-4b3b-a2b1-f57119a6b5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:20.733987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa102e-4814-4b3b-a2b1-f57119a6b5ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:20.881178 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa102e-4814-4b3b-a2b1-f57119a6b5ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:20.883343 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa102e-4814-4b3b-a2b1-f57119a6b5ff None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:20.904013 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3abff0-459f-4538-b8ab-0e14feb89f51 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:20.956660 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166ec5e-3aa4-4913-8523-933f209bddb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:20.957623 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166ec5e-3aa4-4913-8523-933f209bddb1 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:20.958084 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166ec5e-3aa4-4913-8523-933f209bddb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:20.958533 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166ec5e-3aa4-4913-8523-933f209bddb1 None admin] PATH_INFO: `/v3/projects/2937cdbeb750480e8d69fe400d2cca9e` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:20.960036 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166ec5e-3aa4-4913-8523-933f209bddb1 None admin] RBAC: Authorizing `identity:get_project(project_id=2937cdbeb750480e8d69fe400d2cca9e)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:20.962323 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166ec5e-3aa4-4913-8523-933f209bddb1 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:20.968991 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 92/204] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:20 2022] GET /identity/v3/projects/2937cdbeb750480e8d69fe400d2cca9e => generated 302 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:48:20.974835 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166ec5e-3aa4-4913-8523-933f209bddb1 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:21.052149 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:21.099154 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 113/205] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:48:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 687 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:48:21.106055 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa102e-4814-4b3b-a2b1-f57119a6b5ff None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:21.144685 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:21.235276 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa102e-4814-4b3b-a2b1-f57119a6b5ff None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:21.296310 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166ec5e-3aa4-4913-8523-933f209bddb1 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:21.325049 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fa4a1-6e10-411e-8bc7-ce50186ffc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:21.326680 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fa4a1-6e10-411e-8bc7-ce50186ffc9c None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:21.327148 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fa4a1-6e10-411e-8bc7-ce50186ffc9c None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:21.327647 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fa4a1-6e10-411e-8bc7-ce50186ffc9c None admin] PATH_INFO: `/v3/projects/c8576b87aecf403699be87362271685d` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:21.329931 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475fa4a1-6e10-411e-8bc7-ce50186ffc9c None admin] RBAC: Authorizing `identity:get_project(project_id=c8576b87aecf403699be87362271685d)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:21.332615 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475fa4a1-6e10-411e-8bc7-ce50186ffc9c None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:21.335862 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 114/206] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:21 2022] GET /identity/v3/projects/c8576b87aecf403699be87362271685d => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:21.342460 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fa4a1-6e10-411e-8bc7-ce50186ffc9c None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:21.374971 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ff540-8953-4ffe-9669-6582c4ebde93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:21.375616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ff540-8953-4ffe-9669-6582c4ebde93 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:21.375906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ff540-8953-4ffe-9669-6582c4ebde93 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:21.376215 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ff540-8953-4ffe-9669-6582c4ebde93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:21.377033 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ff540-8953-4ffe-9669-6582c4ebde93 None admin] RBAC: Adding query filter params (role.id=923eb688fccc4e79b6c3df28d754b6c4, scope.project.id=2937cdbeb750480e8d69fe400d2cca9e, user.id=d2858c5f061f4e5ea34e7a559d960d06) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:21.377385 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ff540-8953-4ffe-9669-6582c4ebde93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:21.380227 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ff540-8953-4ffe-9669-6582c4ebde93 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:21.385994 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 93/207] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:48:20 2022] GET /identity/v3/role_assignments?user.id=d2858c5f061f4e5ea34e7a559d960d06&scope.project.id=2937cdbeb750480e8d69fe400d2cca9e&role.id=923eb688fccc4e79b6c3df28d754b6c4 => generated 259 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:48:21.416854 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:21.555437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fa4a1-6e10-411e-8bc7-ce50186ffc9c None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:21.624233 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bacfd-a463-4356-83b1-c8d5e414acd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:21.625358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bacfd-a463-4356-83b1-c8d5e414acd4 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:21.625854 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bacfd-a463-4356-83b1-c8d5e414acd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:21.626315 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bacfd-a463-4356-83b1-c8d5e414acd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:21.627851 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56bacfd-a463-4356-83b1-c8d5e414acd4 None admin] RBAC: Adding query filter params (role.id=6639a392f46d4388a120947fb8da02cc, scope.project.id=c8576b87aecf403699be87362271685d, user.id=9c0673c9ff77438792cce1f2fac6eb41) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:21.628436 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56bacfd-a463-4356-83b1-c8d5e414acd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:21.631452 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56bacfd-a463-4356-83b1-c8d5e414acd4 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:21.644222 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 115/208] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:48:21 2022] GET /identity/v3/role_assignments?user.id=9c0673c9ff77438792cce1f2fac6eb41&scope.project.id=c8576b87aecf403699be87362271685d&role.id=6639a392f46d4388a120947fb8da02cc => generated 608 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:22.128513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed3d35-8f13-4919-bc97-e45d1e34d306 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:22.128998 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed3d35-8f13-4919-bc97-e45d1e34d306 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:22.129453 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed3d35-8f13-4919-bc97-e45d1e34d306 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:22.132504 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 94/209] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:22.140892 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3562c32-a396-4959-8c84-98bf6f33b1f8 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:22.141390 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3562c32-a396-4959-8c84-98bf6f33b1f8 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:22.141875 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3562c32-a396-4959-8c84-98bf6f33b1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:22.172852 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-f3562c32-a396-4959-8c84-98bf6f33b1f8 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:22.174079 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-f3562c32-a396-4959-8c84-98bf6f33b1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:22.279421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 116/210] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:22.309165 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed3d35-8f13-4919-bc97-e45d1e34d306 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:22.537094 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed3d35-8f13-4919-bc97-e45d1e34d306 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:22.594442 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:22.603935 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047c504-a256-48c4-8ecd-bf8894d891ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:22.609525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047c504-a256-48c4-8ecd-bf8894d891ab None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:22.609525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047c504-a256-48c4-8ecd-bf8894d891ab None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:22.609525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047c504-a256-48c4-8ecd-bf8894d891ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:22.627328 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047c504-a256-48c4-8ecd-bf8894d891ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:22.639251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-7047c504-a256-48c4-8ecd-bf8894d891ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:48:22.639251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:22.639251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:22.639251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:22.639251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:22.639251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:22.639251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:22.639251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:22.639251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:22.639251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:22.639251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:22.639251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:22.639251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:22.639251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:22.639251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:22.639251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:22.641020 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:22.641020 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:22.641020 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:22.641020 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:22.641020 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:22.641020 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:22.641020 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:22.641020 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:22.641020 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:22.641020 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:22.641020 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:22.641020 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:22.641020 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:22.641020 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:22.641020 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:22.641020 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:22.642086 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:22.642086 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:22.642086 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:22.642086 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:22.642086 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:22.642086 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:22.642086 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:22.642086 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:22.642086 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:22.642086 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:22.642086 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:48:22.642086 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:48:22.642086 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 95/211] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:48:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:22.649495 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3562c32-a396-4959-8c84-98bf6f33b1f8 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:22.688744 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:22.833890 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0270a-b1b4-40bc-8b05-35d4a342f0c6 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:22.834740 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3562c32-a396-4959-8c84-98bf6f33b1f8 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:22.834922 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0270a-b1b4-40bc-8b05-35d4a342f0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:22.835629 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0270a-b1b4-40bc-8b05-35d4a342f0c6 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:22.838793 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 96/212] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:22.845878 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3bb04-b796-4a53-95db-a4452119117c None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:22.846548 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3bb04-b796-4a53-95db-a4452119117c None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:22.847039 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3bb04-b796-4a53-95db-a4452119117c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:22.873261 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-c6a3bb04-b796-4a53-95db-a4452119117c None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:22.874877 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-c6a3bb04-b796-4a53-95db-a4452119117c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:22.906587 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a9d26-a46e-4afd-aff8-248efcfe9e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:22.907945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a9d26-a46e-4afd-aff8-248efcfe9e41 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:22.908722 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a9d26-a46e-4afd-aff8-248efcfe9e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:22.909435 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a9d26-a46e-4afd-aff8-248efcfe9e41 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:22.910937 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a9d26-a46e-4afd-aff8-248efcfe9e41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:22.911688 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a9d26-a46e-4afd-aff8-248efcfe9e41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:22.914435 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a9d26-a46e-4afd-aff8-248efcfe9e41 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:22.930623 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 117/213] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:48:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:22.939574 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a9d26-a46e-4afd-aff8-248efcfe9e41 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:23.018293 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 97/214] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:23.065661 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3bb04-b796-4a53-95db-a4452119117c None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:23.108964 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:23.139776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a9d26-a46e-4afd-aff8-248efcfe9e41 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:23.211212 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999098a-db53-4fa7-b958-a1b4613a8aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:23.213135 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999098a-db53-4fa7-b958-a1b4613a8aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:23.213796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999098a-db53-4fa7-b958-a1b4613a8aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:23.215567 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999098a-db53-4fa7-b958-a1b4613a8aa5 None admin] PATH_INFO: `/v3/users/d2858c5f061f4e5ea34e7a559d960d06` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:23.218625 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999098a-db53-4fa7-b958-a1b4613a8aa5 None admin] RBAC: Authorizing `identity:get_user(user_id=d2858c5f061f4e5ea34e7a559d960d06)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:23.221364 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999098a-db53-4fa7-b958-a1b4613a8aa5 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:23.225213 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 118/215] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:48:22 2022] GET /identity/v3/users/d2858c5f061f4e5ea34e7a559d960d06 => generated 283 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:23.231302 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999098a-db53-4fa7-b958-a1b4613a8aa5 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:23.288543 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3bb04-b796-4a53-95db-a4452119117c None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:23.317796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:23.337543 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e4824-634c-4c65-a4ed-2280e165cfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:23.338488 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e4824-634c-4c65-a4ed-2280e165cfa0 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:23.338778 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e4824-634c-4c65-a4ed-2280e165cfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:23.339080 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e4824-634c-4c65-a4ed-2280e165cfa0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:23.341374 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e4824-634c-4c65-a4ed-2280e165cfa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:23.343364 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e4824-634c-4c65-a4ed-2280e165cfa0 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:23.346147 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 98/216] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:48:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:23.354731 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e4824-634c-4c65-a4ed-2280e165cfa0 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:23.457232 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999098a-db53-4fa7-b958-a1b4613a8aa5 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:23.507751 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fe97f-d601-45e1-b356-3e57482df4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:23.508935 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fe97f-d601-45e1-b356-3e57482df4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:23.509308 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fe97f-d601-45e1-b356-3e57482df4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:23.509589 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fe97f-d601-45e1-b356-3e57482df4a7 None admin] PATH_INFO: `/v3/projects/2937cdbeb750480e8d69fe400d2cca9e` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:23.511006 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2fe97f-d601-45e1-b356-3e57482df4a7 None admin] RBAC: Authorizing `identity:get_project(project_id=2937cdbeb750480e8d69fe400d2cca9e)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:23.513959 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2fe97f-d601-45e1-b356-3e57482df4a7 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:23.524437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 119/217] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:23 2022] GET /identity/v3/projects/2937cdbeb750480e8d69fe400d2cca9e => generated 302 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:23.524437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd9624-f9a6-448a-8c3f-b761c58a89fa None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:23.524437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd9624-f9a6-448a-8c3f-b761c58a89fa None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:23.524437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd9624-f9a6-448a-8c3f-b761c58a89fa None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:23.524437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 120/218] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:23.525726 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb005c-940d-4f3d-9e51-34527bf957b9 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:23.526890 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb005c-940d-4f3d-9e51-34527bf957b9 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:23.526890 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb005c-940d-4f3d-9e51-34527bf957b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:23.543266 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e4824-634c-4c65-a4ed-2280e165cfa0 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:23.547430 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-2cfb005c-940d-4f3d-9e51-34527bf957b9 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:23.548667 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-2cfb005c-940d-4f3d-9e51-34527bf957b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:23.571458 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:23.591307 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa22f0f-ac5c-4ccc-aa74-1087c33f6b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:23.591940 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa22f0f-ac5c-4ccc-aa74-1087c33f6b89 None admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:23.592271 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa22f0f-ac5c-4ccc-aa74-1087c33f6b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:23.592555 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa22f0f-ac5c-4ccc-aa74-1087c33f6b89 None admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:23.593334 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa22f0f-ac5c-4ccc-aa74-1087c33f6b89 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:23.594895 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa22f0f-ac5c-4ccc-aa74-1087c33f6b89 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:23.650734 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 121/219] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:23.653543 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb005c-940d-4f3d-9e51-34527bf957b9 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:23.712287 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 99/220] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Aug 2 08:48:23 2022] POST /identity/v3/users => generated 297 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:48:23.712287 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa22f0f-ac5c-4ccc-aa74-1087c33f6b89 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:23.819475 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:23.824585 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb005c-940d-4f3d-9e51-34527bf957b9 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:23.889042 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272e0c7-67c5-42c3-99c7-f9f4cf06ddbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:23.890952 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272e0c7-67c5-42c3-99c7-f9f4cf06ddbd None admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:23.891493 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272e0c7-67c5-42c3-99c7-f9f4cf06ddbd None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:23.891968 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272e0c7-67c5-42c3-99c7-f9f4cf06ddbd None admin] PATH_INFO: `/v3/projects/2937cdbeb750480e8d69fe400d2cca9e/users/d2858c5f061f4e5ea34e7a559d960d06/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:23.896360 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5272e0c7-67c5-42c3-99c7-f9f4cf06ddbd None admin] RBAC: Authorizing `identity:create_grant(project_id=2937cdbeb750480e8d69fe400d2cca9e, user_id=d2858c5f061f4e5ea34e7a559d960d06, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:23.900064 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5272e0c7-67c5-42c3-99c7-f9f4cf06ddbd None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:23.929119 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa22f0f-ac5c-4ccc-aa74-1087c33f6b89 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:23.975102 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 122/221] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Aug 2 08:48:23 2022] PUT /identity/v3/projects/2937cdbeb750480e8d69fe400d2cca9e/users/d2858c5f061f4e5ea34e7a559d960d06/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:48:23.985177 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84965bb5-591b-48d9-b98e-a0fb78cc0488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:23.985889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84965bb5-591b-48d9-b98e-a0fb78cc0488 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:23.986173 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84965bb5-591b-48d9-b98e-a0fb78cc0488 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:23.986452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84965bb5-591b-48d9-b98e-a0fb78cc0488 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:24.001773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84965bb5-591b-48d9-b98e-a0fb78cc0488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:24.007867 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-84965bb5-591b-48d9-b98e-a0fb78cc0488 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:48:24.007867 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:24.007867 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:24.007867 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:24.007867 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:24.007867 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:24.007867 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:24.007867 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:24.007867 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:24.007867 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:24.007867 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:24.007867 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:24.007867 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:24.007867 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:24.007867 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:24.007867 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:24.009345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:24.009345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:24.009345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:24.009345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:24.009345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:24.009345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:24.009345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:24.009345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:24.009345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:24.009345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:24.009345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:24.009345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:24.009345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:24.009345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:24.009345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:24.009345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:24.010310 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:24.010310 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:24.010310 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:24.010310 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:24.010310 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:24.010310 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:24.010310 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:24.010310 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:24.010310 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:24.010310 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:24.010310 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:48:24.010310 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:48:24.010310 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 100/222] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:48:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:24.017899 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272e0c7-67c5-42c3-99c7-f9f4cf06ddbd None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:24.042502 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:24.161658 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272e0c7-67c5-42c3-99c7-f9f4cf06ddbd None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:24.209113 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe5495-733b-4d45-848b-46187e09bf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:24.209760 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe5495-733b-4d45-848b-46187e09bf84 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:24.210046 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe5495-733b-4d45-848b-46187e09bf84 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:24.210329 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe5495-733b-4d45-848b-46187e09bf84 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:24.211099 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe5495-733b-4d45-848b-46187e09bf84 None admin] RBAC: Adding query filter params (name=member) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:24.211407 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe5495-733b-4d45-848b-46187e09bf84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:24.212910 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe5495-733b-4d45-848b-46187e09bf84 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:24.224567 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 123/223] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Aug 2 08:48:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:24.231219 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84965bb5-591b-48d9-b98e-a0fb78cc0488 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:24.364898 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9e1e0-1617-48b2-a213-907208292512 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:24.365369 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9e1e0-1617-48b2-a213-907208292512 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:24.365747 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9e1e0-1617-48b2-a213-907208292512 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:24.367288 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 124/224] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:24.382773 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61df2d2-9631-41e2-b847-dd5bc84e0f8e None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:24.383063 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61df2d2-9631-41e2-b847-dd5bc84e0f8e None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:24.383351 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61df2d2-9631-41e2-b847-dd5bc84e0f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:24.395368 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84965bb5-591b-48d9-b98e-a0fb78cc0488 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:24.398474 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:24.429361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-b61df2d2-9631-41e2-b847-dd5bc84e0f8e None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:24.430645 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-b61df2d2-9631-41e2-b847-dd5bc84e0f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:24.454669 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3f507-3360-40c8-8e0b-ef4cda47f6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:24.455348 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3f507-3360-40c8-8e0b-ef4cda47f6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:24.455633 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3f507-3360-40c8-8e0b-ef4cda47f6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:24.455915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3f507-3360-40c8-8e0b-ef4cda47f6a9 None admin] PATH_INFO: `/v3/users/4566a1a6f9e640b09e2a59d3dc93e6bb` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:24.490891 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3f507-3360-40c8-8e0b-ef4cda47f6a9 None admin] RBAC: Authorizing `identity:get_user(user_id=4566a1a6f9e640b09e2a59d3dc93e6bb)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:24.492337 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3f507-3360-40c8-8e0b-ef4cda47f6a9 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:24.494107 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 101/225] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:48:24 2022] GET /identity/v3/users/4566a1a6f9e640b09e2a59d3dc93e6bb => generated 297 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:24.500789 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3f507-3360-40c8-8e0b-ef4cda47f6a9 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:24.584294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 125/226] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:48:24.618764 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61df2d2-9631-41e2-b847-dd5bc84e0f8e None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:24.636611 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:24.638778 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3f507-3360-40c8-8e0b-ef4cda47f6a9 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:24.712451 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc655bb-e98a-4f62-a68c-ec66615667cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:24.713519 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc655bb-e98a-4f62-a68c-ec66615667cf None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:24.714015 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc655bb-e98a-4f62-a68c-ec66615667cf None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:24.715147 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc655bb-e98a-4f62-a68c-ec66615667cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:24.764894 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:24.807011 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc655bb-e98a-4f62-a68c-ec66615667cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:24.809685 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc655bb-e98a-4f62-a68c-ec66615667cf None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:24.933930 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 102/227] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:48:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 08:48:24.943464 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc655bb-e98a-4f62-a68c-ec66615667cf None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:24.962406 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61df2d2-9631-41e2-b847-dd5bc84e0f8e None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:25.043830 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46611769-98ff-4dbb-b723-16428636e6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:25.044445 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46611769-98ff-4dbb-b723-16428636e6df None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:25.044725 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46611769-98ff-4dbb-b723-16428636e6df None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:25.044996 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46611769-98ff-4dbb-b723-16428636e6df None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:25.068889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46611769-98ff-4dbb-b723-16428636e6df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:25.075013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-46611769-98ff-4dbb-b723-16428636e6df None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:48:25.075013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:25.075013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:25.075013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:25.075013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:25.075013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:25.075013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:25.075013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:25.075013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:25.075013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:25.075013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:25.075013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:25.075013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:25.075013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:25.075013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:25.075013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:25.076754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:25.076754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:25.076754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:25.076754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:25.076754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:25.076754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:25.076754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:25.076754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:25.076754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:25.076754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:25.076754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:25.076754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:25.076754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:25.076754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:25.076754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:25.076754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:25.078325 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:25.078325 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:25.078325 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:25.078325 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:25.078325 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:25.078325 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:25.078325 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:25.078325 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:25.078325 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:25.078325 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:25.078325 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:48:25.078325 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:48:25.078325 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 126/228] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Aug 2 08:48:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 458 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:48:25.092241 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46611769-98ff-4dbb-b723-16428636e6df None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:25.092901 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:25.148957 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc655bb-e98a-4f62-a68c-ec66615667cf None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:25.189810 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3845c0-996b-4074-b695-f71526855317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:25.190506 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3845c0-996b-4074-b695-f71526855317 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:25.190866 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3845c0-996b-4074-b695-f71526855317 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:25.191147 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3845c0-996b-4074-b695-f71526855317 None admin] PATH_INFO: `/v3/projects/2937cdbeb750480e8d69fe400d2cca9e` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:25.192492 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3845c0-996b-4074-b695-f71526855317 None admin] RBAC: Authorizing `identity:get_project(project_id=2937cdbeb750480e8d69fe400d2cca9e)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:25.194178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3845c0-996b-4074-b695-f71526855317 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:25.196044 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 103/229] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:24 2022] GET /identity/v3/projects/2937cdbeb750480e8d69fe400d2cca9e => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:48:25.205013 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3845c0-996b-4074-b695-f71526855317 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:25.332831 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:25.368473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3845c0-996b-4074-b695-f71526855317 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:25.432547 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:25.454886 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5283df8-5a7c-4123-9fd0-1014c9f1cb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:25.455956 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5283df8-5a7c-4123-9fd0-1014c9f1cb6f None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:25.456491 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5283df8-5a7c-4123-9fd0-1014c9f1cb6f None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:25.456976 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5283df8-5a7c-4123-9fd0-1014c9f1cb6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:25.457902 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5283df8-5a7c-4123-9fd0-1014c9f1cb6f None admin] RBAC: Adding query filter params (role.id=5fd593d076084fbaa9208dd505b58150, scope.project.id=2937cdbeb750480e8d69fe400d2cca9e, user.id=4566a1a6f9e640b09e2a59d3dc93e6bb) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:25.458324 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5283df8-5a7c-4123-9fd0-1014c9f1cb6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:25.460250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5283df8-5a7c-4123-9fd0-1014c9f1cb6f None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:25.473672 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46611769-98ff-4dbb-b723-16428636e6df None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:25.486623 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 104/230] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:48:25 2022] GET /identity/v3/role_assignments?user.id=4566a1a6f9e640b09e2a59d3dc93e6bb&scope.project.id=2937cdbeb750480e8d69fe400d2cca9e&role.id=5fd593d076084fbaa9208dd505b58150 => generated 259 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:48:25.546323 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8c6ee-df53-442a-b192-1763a8b51e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:25.547454 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8c6ee-df53-442a-b192-1763a8b51e97 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:25.547951 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8c6ee-df53-442a-b192-1763a8b51e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:25.548452 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8c6ee-df53-442a-b192-1763a8b51e97 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:25.549803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8c6ee-df53-442a-b192-1763a8b51e97 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:25.550347 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8c6ee-df53-442a-b192-1763a8b51e97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:25.552948 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8c6ee-df53-442a-b192-1763a8b51e97 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:25.570278 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 127/231] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:48:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 478 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:25.579223 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5283df8-5a7c-4123-9fd0-1014c9f1cb6f None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:25.751993 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5283df8-5a7c-4123-9fd0-1014c9f1cb6f None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:25.791519 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b824b-891f-4e88-ae90-b3a501e26f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:25.793079 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b824b-891f-4e88-ae90-b3a501e26f1c None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:25.793557 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b824b-891f-4e88-ae90-b3a501e26f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:25.794018 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b824b-891f-4e88-ae90-b3a501e26f1c None admin] PATH_INFO: `/v3/users/d2858c5f061f4e5ea34e7a559d960d06` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:25.795491 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b824b-891f-4e88-ae90-b3a501e26f1c None admin] RBAC: Authorizing `identity:get_user(user_id=d2858c5f061f4e5ea34e7a559d960d06)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:25.797223 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b824b-891f-4e88-ae90-b3a501e26f1c None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:25.799807 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 105/232] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:48:25 2022] GET /identity/v3/users/d2858c5f061f4e5ea34e7a559d960d06 => generated 283 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:25.804968 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8c6ee-df53-442a-b192-1763a8b51e97 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:25.988844 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8c6ee-df53-442a-b192-1763a8b51e97 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:26.036076 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:26.047785 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98337d4-533a-4864-89f8-685435ae1ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:26.048598 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98337d4-533a-4864-89f8-685435ae1ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:26.049028 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98337d4-533a-4864-89f8-685435ae1ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:26.049310 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98337d4-533a-4864-89f8-685435ae1ae7 None admin] PATH_INFO: `/v3/projects/2937cdbeb750480e8d69fe400d2cca9e` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:26.051356 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98337d4-533a-4864-89f8-685435ae1ae7 None admin] RBAC: Authorizing `identity:get_project(project_id=2937cdbeb750480e8d69fe400d2cca9e)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:26.054306 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98337d4-533a-4864-89f8-685435ae1ae7 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:26.059043 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 128/233] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:25 2022] GET /identity/v3/projects/2937cdbeb750480e8d69fe400d2cca9e => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:26.066510 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b824b-891f-4e88-ae90-b3a501e26f1c None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:26.164154 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:26.225046 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b824b-891f-4e88-ae90-b3a501e26f1c None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:26.282579 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81406dc3-c15b-43ab-92fb-b82131022b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:26.283291 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81406dc3-c15b-43ab-92fb-b82131022b2c None admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:26.283566 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81406dc3-c15b-43ab-92fb-b82131022b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:26.283837 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81406dc3-c15b-43ab-92fb-b82131022b2c None admin] PATH_INFO: `/v3/projects/2937cdbeb750480e8d69fe400d2cca9e/users/d2858c5f061f4e5ea34e7a559d960d06/roles/923eb688fccc4e79b6c3df28d754b6c4` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:26.290371 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81406dc3-c15b-43ab-92fb-b82131022b2c None admin] RBAC: Authorizing `identity:create_grant(project_id=2937cdbeb750480e8d69fe400d2cca9e, user_id=d2858c5f061f4e5ea34e7a559d960d06, role_id=923eb688fccc4e79b6c3df28d754b6c4)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:26.291796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81406dc3-c15b-43ab-92fb-b82131022b2c None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:26.382069 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 106/234] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Aug 2 08:48:26 2022] PUT /identity/v3/projects/2937cdbeb750480e8d69fe400d2cca9e/users/d2858c5f061f4e5ea34e7a559d960d06/roles/923eb688fccc4e79b6c3df28d754b6c4 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:48:26.695101 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97181fa-955d-4b3b-ae2a-49ada688d306 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:26.695618 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97181fa-955d-4b3b-ae2a-49ada688d306 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:26.696116 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97181fa-955d-4b3b-ae2a-49ada688d306 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:26.698156 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 129/235] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:26.706405 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa690b-2998-4904-970f-61451ad6a21c None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:26.706731 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa690b-2998-4904-970f-61451ad6a21c None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:26.707119 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa690b-2998-4904-970f-61451ad6a21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:26.742661 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-9aaa690b-2998-4904-970f-61451ad6a21c None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:26.744723 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-9aaa690b-2998-4904-970f-61451ad6a21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:26.811463 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916cd3c-b80a-48de-b389-ce4ec7cd754d None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:26.811870 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916cd3c-b80a-48de-b389-ce4ec7cd754d None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:26.812366 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916cd3c-b80a-48de-b389-ce4ec7cd754d None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:26.820796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 130/236] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:26 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:26.823805 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff8af9-5025-477d-b3c7-1f8a38e2836d None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:26.824341 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff8af9-5025-477d-b3c7-1f8a38e2836d None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:26.824749 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff8af9-5025-477d-b3c7-1f8a38e2836d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:26.862786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-daff8af9-5025-477d-b3c7-1f8a38e2836d None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:26.865552 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-daff8af9-5025-477d-b3c7-1f8a38e2836d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:26.875716 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 107/237] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:26.878162 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354930a8-6459-4ccb-86c8-d1f94625a33c None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:26.878683 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354930a8-6459-4ccb-86c8-d1f94625a33c None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:26.879370 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354930a8-6459-4ccb-86c8-d1f94625a33c None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:26.886873 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 108/238] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:26.889920 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70319e-822a-49f2-ab98-094793f7063b None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:26.890777 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70319e-822a-49f2-ab98-094793f7063b None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:26.891266 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70319e-822a-49f2-ab98-094793f7063b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:26.924795 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-cd70319e-822a-49f2-ab98-094793f7063b None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:26.930161 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-cd70319e-822a-49f2-ab98-094793f7063b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:27.032206 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:27.053733 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 131/239] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:27.055883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff8af9-5025-477d-b3c7-1f8a38e2836d None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:27.068349 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 109/240] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:48:27.085734 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70319e-822a-49f2-ab98-094793f7063b None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:27.230601 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70319e-822a-49f2-ab98-094793f7063b None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:27.249678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff8af9-5025-477d-b3c7-1f8a38e2836d None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:27.292260 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a2655-96c3-4daf-81fa-4c8fafb76203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:27.293392 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a2655-96c3-4daf-81fa-4c8fafb76203 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:27.293895 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a2655-96c3-4daf-81fa-4c8fafb76203 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:27.294388 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a2655-96c3-4daf-81fa-4c8fafb76203 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:27.301762 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:27.316014 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9046051-9f38-4aaa-9d80-d080777dd27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:27.316782 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9046051-9f38-4aaa-9d80-d080777dd27d None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:27.317166 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9046051-9f38-4aaa-9d80-d080777dd27d None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:27.317547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9046051-9f38-4aaa-9d80-d080777dd27d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:27.319625 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a2655-96c3-4daf-81fa-4c8fafb76203 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:27.327621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-8a9a2655-96c3-4daf-81fa-4c8fafb76203 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:48:27.327621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:27.327621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:27.327621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:27.327621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:27.327621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:27.327621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:27.327621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:27.327621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:27.327621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:27.327621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:27.327621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:27.327621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:27.327621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:27.327621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:27.327621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:27.328773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:27.328773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:27.328773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:27.328773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:27.328773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:27.328773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:27.328773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:27.328773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:27.328773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:27.328773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:27.328773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:27.328773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:27.328773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:27.328773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:27.328773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:27.328773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:27.330313 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:27.330313 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:27.330313 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:27.330313 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:27.330313 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:27.330313 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:27.330313 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:27.330313 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:27.330313 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:27.330313 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:27.330313 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:48:27.330313 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:48:27.332884 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9046051-9f38-4aaa-9d80-d080777dd27d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:27.335210 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 110/241] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:48:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:27.336994 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a2655-96c3-4daf-81fa-4c8fafb76203 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:27.347147 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-e9046051-9f38-4aaa-9d80-d080777dd27d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:48:27.347147 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:27.347147 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:27.347147 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:27.347147 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:27.347147 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:27.347147 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:27.347147 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:27.347147 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:27.347147 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:27.347147 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:27.347147 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:27.347147 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:27.347147 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:27.347147 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:27.347147 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:27.348837 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:27.348837 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:27.348837 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:27.348837 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:27.348837 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:27.348837 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:27.348837 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:27.348837 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:27.348837 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:27.348837 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:27.348837 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:27.348837 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:27.348837 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:27.348837 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:27.348837 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:27.348837 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:27.350384 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:27.350384 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:27.350384 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:27.350384 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:27.350384 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:27.350384 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:27.350384 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:27.350384 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:27.350384 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:27.350384 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:27.350384 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:48:27.350384 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:48:27.354904 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 132/242] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:48:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:27.360271 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9046051-9f38-4aaa-9d80-d080777dd27d None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:27.407935 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:27.518630 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9046051-9f38-4aaa-9d80-d080777dd27d None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:27.523512 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a2655-96c3-4daf-81fa-4c8fafb76203 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:27.569109 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bb239-ca29-40d4-bcb4-a7a3b800e69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:27.569700 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bb239-ca29-40d4-bcb4-a7a3b800e69b None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:27.569987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bb239-ca29-40d4-bcb4-a7a3b800e69b None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:27.570278 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bb239-ca29-40d4-bcb4-a7a3b800e69b None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:27.571292 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997bb239-ca29-40d4-bcb4-a7a3b800e69b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:27.571600 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997bb239-ca29-40d4-bcb4-a7a3b800e69b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:27.574137 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997bb239-ca29-40d4-bcb4-a7a3b800e69b None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:27.579441 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7d148-f459-4d67-806c-0dd56d5e8383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:27.580522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7d148-f459-4d67-806c-0dd56d5e8383 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:27.581001 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7d148-f459-4d67-806c-0dd56d5e8383 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:27.581650 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7d148-f459-4d67-806c-0dd56d5e8383 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:27.583362 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc7d148-f459-4d67-806c-0dd56d5e8383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:27.585436 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc7d148-f459-4d67-806c-0dd56d5e8383 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:27.587431 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 111/244] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:48:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:27.588536 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7d148-f459-4d67-806c-0dd56d5e8383 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:27.590193 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 133/244] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Aug 2 08:48:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:27.591883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bb239-ca29-40d4-bcb4-a7a3b800e69b None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:27.654876 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:27.725066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7d148-f459-4d67-806c-0dd56d5e8383 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:27.726969 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bb239-ca29-40d4-bcb4-a7a3b800e69b None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:27.740614 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:27.767930 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cdc73-d2c6-4df0-8a3d-ac878450ade6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:27.768544 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cdc73-d2c6-4df0-8a3d-ac878450ade6 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:27.768898 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cdc73-d2c6-4df0-8a3d-ac878450ade6 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:27.769345 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cdc73-d2c6-4df0-8a3d-ac878450ade6 None admin] PATH_INFO: `/v3/users/fb329322ef2a44019e6f61b1259d8465` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:27.774618 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aef2e9-fb4d-4918-8aa2-25ae4b5154fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:27.775643 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aef2e9-fb4d-4918-8aa2-25ae4b5154fa None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:27.776262 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aef2e9-fb4d-4918-8aa2-25ae4b5154fa None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:27.777529 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aef2e9-fb4d-4918-8aa2-25ae4b5154fa None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:27.778793 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aef2e9-fb4d-4918-8aa2-25ae4b5154fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:27.779395 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aef2e9-fb4d-4918-8aa2-25ae4b5154fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:27.781324 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aef2e9-fb4d-4918-8aa2-25ae4b5154fa None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:27.786313 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835cdc73-d2c6-4df0-8a3d-ac878450ade6 None admin] RBAC: Authorizing `identity:get_user(user_id=fb329322ef2a44019e6f61b1259d8465)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:27.787812 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835cdc73-d2c6-4df0-8a3d-ac878450ade6 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:27.794491 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 134/245] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:48:27 2022] GET /identity/v3/users/fb329322ef2a44019e6f61b1259d8465 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:48:27.795470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cdc73-d2c6-4df0-8a3d-ac878450ade6 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:27.796452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 112/246] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:48:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:27.797583 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aef2e9-fb4d-4918-8aa2-25ae4b5154fa None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:27.919070 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cdc73-d2c6-4df0-8a3d-ac878450ade6 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:27.922148 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:27.935057 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aef2e9-fb4d-4918-8aa2-25ae4b5154fa None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:27.959082 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d306c-a64d-48a4-9772-190348319a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:27.960396 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d306c-a64d-48a4-9772-190348319a06 None admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:27.961012 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d306c-a64d-48a4-9772-190348319a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:27.961766 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d306c-a64d-48a4-9772-190348319a06 None admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:27.962791 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d306c-a64d-48a4-9772-190348319a06 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:27.965514 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d306c-a64d-48a4-9772-190348319a06 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:28.006612 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c4205-74fb-4874-8b5c-fd56e5319e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:28.007696 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c4205-74fb-4874-8b5c-fd56e5319e86 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:28.008431 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c4205-74fb-4874-8b5c-fd56e5319e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:28.008920 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c4205-74fb-4874-8b5c-fd56e5319e86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:28.051589 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 135/247] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Aug 2 08:48:27 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:48:28.054045 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d306c-a64d-48a4-9772-190348319a06 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:28.108841 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:28.172430 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c4205-74fb-4874-8b5c-fd56e5319e86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:28.177190 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c4205-74fb-4874-8b5c-fd56e5319e86 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:28.232010 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d306c-a64d-48a4-9772-190348319a06 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:28.287905 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ccf9c-edee-49b2-a4e7-ce432eec5ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:28.289558 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ccf9c-edee-49b2-a4e7-ce432eec5ebf None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:28.290417 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ccf9c-edee-49b2-a4e7-ce432eec5ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:28.291160 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ccf9c-edee-49b2-a4e7-ce432eec5ebf None admin] PATH_INFO: `/v3/users/d2858c5f061f4e5ea34e7a559d960d06` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:28.294504 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ccf9c-edee-49b2-a4e7-ce432eec5ebf None admin] RBAC: Authorizing `identity:get_user(user_id=d2858c5f061f4e5ea34e7a559d960d06)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:28.296614 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ccf9c-edee-49b2-a4e7-ce432eec5ebf None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:28.299680 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 136/248] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:48:28 2022] GET /identity/v3/users/d2858c5f061f4e5ea34e7a559d960d06 => generated 283 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:28.309755 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ccf9c-edee-49b2-a4e7-ce432eec5ebf None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:28.351754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:28.480583 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 113/249] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:48:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:48:28.488315 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c4205-74fb-4874-8b5c-fd56e5319e86 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:28.503083 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ccf9c-edee-49b2-a4e7-ce432eec5ebf None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:28.582506 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e858c-c6fb-4f60-96fc-4d98628e1e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:28.583639 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e858c-c6fb-4f60-96fc-4d98628e1e4f None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:28.584136 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e858c-c6fb-4f60-96fc-4d98628e1e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:28.584696 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e858c-c6fb-4f60-96fc-4d98628e1e4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:28.667983 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:28.701488 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e858c-c6fb-4f60-96fc-4d98628e1e4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:28.703084 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e858c-c6fb-4f60-96fc-4d98628e1e4f None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:28.727943 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c4205-74fb-4874-8b5c-fd56e5319e86 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:28.762483 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:28.815048 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056919a2-5540-4351-aae6-85c87e453081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:28.816479 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056919a2-5540-4351-aae6-85c87e453081 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:28.817180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056919a2-5540-4351-aae6-85c87e453081 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:28.817815 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056919a2-5540-4351-aae6-85c87e453081 None admin] PATH_INFO: `/v3/projects/2937cdbeb750480e8d69fe400d2cca9e` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:28.820107 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056919a2-5540-4351-aae6-85c87e453081 None admin] RBAC: Authorizing `identity:get_project(project_id=2937cdbeb750480e8d69fe400d2cca9e)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:28.825189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056919a2-5540-4351-aae6-85c87e453081 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:28.835900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 114/250] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:28 2022] GET /identity/v3/projects/2937cdbeb750480e8d69fe400d2cca9e => generated 302 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:48:28.839046 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8566a-d8cf-46e6-8b56-30de05962fca None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:28.839759 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8566a-d8cf-46e6-8b56-30de05962fca None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:28.840446 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8566a-d8cf-46e6-8b56-30de05962fca None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:28.843735 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 115/251] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:28.847565 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8566a-d8cf-46e6-8b56-30de05962fca None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:28.925698 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 137/252] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:48:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 08:48:28.928527 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa4ded-261a-4b49-ba54-07eff74df0c4 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:28.929366 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa4ded-261a-4b49-ba54-07eff74df0c4 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:28.930034 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa4ded-261a-4b49-ba54-07eff74df0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:28.965735 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-20fa4ded-261a-4b49-ba54-07eff74df0c4 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:28.968250 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-20fa4ded-261a-4b49-ba54-07eff74df0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:29.008864 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8566a-d8cf-46e6-8b56-30de05962fca None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:29.052018 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3a318-1c97-49b1-87f5-f8a507a406ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:29.052573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3a318-1c97-49b1-87f5-f8a507a406ca None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:29.052858 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3a318-1c97-49b1-87f5-f8a507a406ca None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:29.053139 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3a318-1c97-49b1-87f5-f8a507a406ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:29.054164 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3a318-1c97-49b1-87f5-f8a507a406ca None admin] RBAC: Adding query filter params (role.id=6639a392f46d4388a120947fb8da02cc, scope.project.id=2937cdbeb750480e8d69fe400d2cca9e, user.id=fb329322ef2a44019e6f61b1259d8465) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:29.054484 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3a318-1c97-49b1-87f5-f8a507a406ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:29.056952 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3a318-1c97-49b1-87f5-f8a507a406ca None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:29.064231 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 116/253] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:48:28 2022] GET /identity/v3/role_assignments?user.id=fb329322ef2a44019e6f61b1259d8465&scope.project.id=2937cdbeb750480e8d69fe400d2cca9e&role.id=6639a392f46d4388a120947fb8da02cc => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:48:29.064918 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3a318-1c97-49b1-87f5-f8a507a406ca None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:29.077229 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:29.123533 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 138/254] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:29.155810 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa4ded-261a-4b49-ba54-07eff74df0c4 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:29.326617 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:29.388654 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3a318-1c97-49b1-87f5-f8a507a406ca None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:29.497374 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa4ded-261a-4b49-ba54-07eff74df0c4 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:29.536372 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6ebe9-762c-453d-bccb-91c48599fc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:29.537487 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6ebe9-762c-453d-bccb-91c48599fc17 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:29.537906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6ebe9-762c-453d-bccb-91c48599fc17 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:29.538320 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6ebe9-762c-453d-bccb-91c48599fc17 None admin] PATH_INFO: `/v3/projects/2937cdbeb750480e8d69fe400d2cca9e` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:29.540454 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a6ebe9-762c-453d-bccb-91c48599fc17 None admin] RBAC: Authorizing `identity:get_project(project_id=2937cdbeb750480e8d69fe400d2cca9e)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:29.542761 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a6ebe9-762c-453d-bccb-91c48599fc17 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:29.545982 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 117/255] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:29 2022] GET /identity/v3/projects/2937cdbeb750480e8d69fe400d2cca9e => generated 302 bytes in 481 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:29.555459 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6ebe9-762c-453d-bccb-91c48599fc17 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:29.611997 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca3971-d46a-4a5f-a02c-d9ce54856bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:29.612828 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca3971-d46a-4a5f-a02c-d9ce54856bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:29.613310 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca3971-d46a-4a5f-a02c-d9ce54856bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:29.613786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca3971-d46a-4a5f-a02c-d9ce54856bd6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:29.633611 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca3971-d46a-4a5f-a02c-d9ce54856bd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:29.640783 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-c0ca3971-d46a-4a5f-a02c-d9ce54856bd6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:48:29.640783 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:29.640783 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:29.640783 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:29.640783 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:29.640783 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:29.640783 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:29.640783 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:29.640783 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:29.640783 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:29.640783 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:29.640783 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:29.640783 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:29.640783 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:29.640783 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:29.640783 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:29.641858 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:29.641858 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:29.641858 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:29.641858 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:29.641858 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:29.641858 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:29.641858 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:29.641858 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:29.641858 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:29.641858 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:29.641858 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:29.641858 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:29.641858 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:29.641858 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:29.641858 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:29.641858 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:29.643169 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:29.643169 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:29.643169 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:29.643169 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:29.643169 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:29.643169 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:29.643169 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:29.643169 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:29.643169 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:29.643169 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:29.643169 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:48:29.643169 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:48:29.646177 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 139/256] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:48:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 491 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:29.648643 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98affa28-9daf-4b10-a190-07343e564b9f None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:29.649186 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98affa28-9daf-4b10-a190-07343e564b9f None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:29.649862 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98affa28-9daf-4b10-a190-07343e564b9f None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:29.652294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 140/257] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:29.659163 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98affa28-9daf-4b10-a190-07343e564b9f None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:29.701682 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:29.801293 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6ebe9-762c-453d-bccb-91c48599fc17 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:29.888703 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518175d-e2b0-409a-b406-1e7e529524b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:29.890080 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518175d-e2b0-409a-b406-1e7e529524b9 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:29.890660 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518175d-e2b0-409a-b406-1e7e529524b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:29.891242 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518175d-e2b0-409a-b406-1e7e529524b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:29.892872 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518175d-e2b0-409a-b406-1e7e529524b9 None admin] RBAC: Adding query filter params (role.id=b5477d3c4e5a4514b64211ec2452d1d8, scope.project.id=2937cdbeb750480e8d69fe400d2cca9e, user.id=d2858c5f061f4e5ea34e7a559d960d06) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:29.893529 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518175d-e2b0-409a-b406-1e7e529524b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:29.896463 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518175d-e2b0-409a-b406-1e7e529524b9 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:29.909847 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 118/258] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:48:29 2022] GET /identity/v3/role_assignments?user.id=d2858c5f061f4e5ea34e7a559d960d06&scope.project.id=2937cdbeb750480e8d69fe400d2cca9e&role.id=b5477d3c4e5a4514b64211ec2452d1d8 => generated 608 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:29.912416 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d61e6-6359-48e5-b88c-da8f5948a40c None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:29.913039 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d61e6-6359-48e5-b88c-da8f5948a40c None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:29.913650 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d61e6-6359-48e5-b88c-da8f5948a40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:29.948995 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-b95d61e6-6359-48e5-b88c-da8f5948a40c None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:29.951145 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-b95d61e6-6359-48e5-b88c-da8f5948a40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:29.994502 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98affa28-9daf-4b10-a190-07343e564b9f None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:30.075011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:30.091691 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 119/259] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:30.135792 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d61e6-6359-48e5-b88c-da8f5948a40c None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:30.148513 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15f7f5-5a7e-4faf-863c-4b8e0b0d7131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:30.149502 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15f7f5-5a7e-4faf-863c-4b8e0b0d7131 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:30.150007 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15f7f5-5a7e-4faf-863c-4b8e0b0d7131 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:30.150495 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15f7f5-5a7e-4faf-863c-4b8e0b0d7131 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:30.152396 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d15f7f5-5a7e-4faf-863c-4b8e0b0d7131 None admin] RBAC: Adding query filter params (name=member) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:30.152969 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d15f7f5-5a7e-4faf-863c-4b8e0b0d7131 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:30.155705 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d15f7f5-5a7e-4faf-863c-4b8e0b0d7131 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:30.192279 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 141/260] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Aug 2 08:48:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 535 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:30.201914 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15f7f5-5a7e-4faf-863c-4b8e0b0d7131 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:30.327922 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:30.433701 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d61e6-6359-48e5-b88c-da8f5948a40c None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:30.503408 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3cb69-111e-4b3f-998a-8fb81b9482b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:30.504517 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3cb69-111e-4b3f-998a-8fb81b9482b2 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:30.506764 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3cb69-111e-4b3f-998a-8fb81b9482b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:30.509829 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3cb69-111e-4b3f-998a-8fb81b9482b2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:30.536792 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15f7f5-5a7e-4faf-863c-4b8e0b0d7131 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:30.559240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3cb69-111e-4b3f-998a-8fb81b9482b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:30.577078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-73c3cb69-111e-4b3f-998a-8fb81b9482b2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:48:30.577078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:30.577078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:30.577078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:30.577078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:30.577078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:30.577078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:30.577078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:30.577078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:30.577078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:30.577078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:30.577078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:30.577078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:30.577078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:30.577078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:30.577078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:30.578189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:30.578189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:30.578189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:30.578189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:30.578189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:30.578189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:30.578189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:30.578189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:30.578189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:30.578189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:30.578189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:30.578189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:30.578189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:30.578189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:30.578189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:30.578189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:30.579180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:30.579180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:30.579180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:30.579180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:30.579180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:30.579180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:30.579180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:30.579180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:30.579180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:30.579180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:30.579180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:48:30.579180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:48:30.580388 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 120/261] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Aug 2 08:48:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 445 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:48:30.608764 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3cb69-111e-4b3f-998a-8fb81b9482b2 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:30.677463 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5b50d-cc17-40cc-ac03-57e3856f4583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:30.678594 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5b50d-cc17-40cc-ac03-57e3856f4583 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:30.679101 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5b50d-cc17-40cc-ac03-57e3856f4583 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:30.682234 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5b50d-cc17-40cc-ac03-57e3856f4583 None admin] PATH_INFO: `/v3/users/4566a1a6f9e640b09e2a59d3dc93e6bb` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:30.691242 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5b50d-cc17-40cc-ac03-57e3856f4583 None admin] RBAC: Authorizing `identity:get_user(user_id=4566a1a6f9e640b09e2a59d3dc93e6bb)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:30.694236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5b50d-cc17-40cc-ac03-57e3856f4583 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:30.710964 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 142/262] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:48:30 2022] GET /identity/v3/users/4566a1a6f9e640b09e2a59d3dc93e6bb => generated 297 bytes in 510 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:48:30.713579 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5b50d-cc17-40cc-ac03-57e3856f4583 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:30.871759 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:30.906417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3cb69-111e-4b3f-998a-8fb81b9482b2 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:30.958175 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:30.974847 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f4e83-bf83-4210-a8c6-a595c529201e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:30.975940 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f4e83-bf83-4210-a8c6-a595c529201e None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:30.976492 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f4e83-bf83-4210-a8c6-a595c529201e None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:30.977000 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f4e83-bf83-4210-a8c6-a595c529201e None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:30.978614 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f4e83-bf83-4210-a8c6-a595c529201e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:30.979159 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f4e83-bf83-4210-a8c6-a595c529201e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:30.981850 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f4e83-bf83-4210-a8c6-a595c529201e None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:30.992659 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 121/263] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:48:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:30.998667 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f4e83-bf83-4210-a8c6-a595c529201e None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:31.055794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5b50d-cc17-40cc-ac03-57e3856f4583 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:31.141035 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f4e83-bf83-4210-a8c6-a595c529201e None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:31.185606 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f847b0-eeef-47a4-b6ea-ef80239e2a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:31.186386 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f847b0-eeef-47a4-b6ea-ef80239e2a4c None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:31.186702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f847b0-eeef-47a4-b6ea-ef80239e2a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:31.186986 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f847b0-eeef-47a4-b6ea-ef80239e2a4c None admin] PATH_INFO: `/v3/users/d2858c5f061f4e5ea34e7a559d960d06` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:31.188332 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f847b0-eeef-47a4-b6ea-ef80239e2a4c None admin] RBAC: Authorizing `identity:get_user(user_id=d2858c5f061f4e5ea34e7a559d960d06)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:31.189986 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f847b0-eeef-47a4-b6ea-ef80239e2a4c None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:31.192525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 122/264] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:48:30 2022] GET /identity/v3/users/d2858c5f061f4e5ea34e7a559d960d06 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:48:31.197759 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00defdac-d192-49de-abe9-6cdd37197874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:31.199282 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00defdac-d192-49de-abe9-6cdd37197874 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:31.199767 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00defdac-d192-49de-abe9-6cdd37197874 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:31.199980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f847b0-eeef-47a4-b6ea-ef80239e2a4c None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:31.200298 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00defdac-d192-49de-abe9-6cdd37197874 None admin] PATH_INFO: `/v3/projects/2937cdbeb750480e8d69fe400d2cca9e` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:31.209307 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00defdac-d192-49de-abe9-6cdd37197874 None admin] RBAC: Authorizing `identity:get_project(project_id=2937cdbeb750480e8d69fe400d2cca9e)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:31.211029 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00defdac-d192-49de-abe9-6cdd37197874 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:31.213208 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 143/265] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:30 2022] GET /identity/v3/projects/2937cdbeb750480e8d69fe400d2cca9e => generated 302 bytes in 501 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:31.225246 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00defdac-d192-49de-abe9-6cdd37197874 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:31.274481 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:31.331528 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f847b0-eeef-47a4-b6ea-ef80239e2a4c None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:31.378219 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2739ac-cc63-46ac-a7b0-f9432bfc06ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:31.378878 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2739ac-cc63-46ac-a7b0-f9432bfc06ba None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:31.379172 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2739ac-cc63-46ac-a7b0-f9432bfc06ba None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:31.379452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2739ac-cc63-46ac-a7b0-f9432bfc06ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:31.489158 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2739ac-cc63-46ac-a7b0-f9432bfc06ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:31.490666 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2739ac-cc63-46ac-a7b0-f9432bfc06ba None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:31.562128 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:31.620043 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 123/266] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:48:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:48:31.625337 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00defdac-d192-49de-abe9-6cdd37197874 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:31.642599 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2739ac-cc63-46ac-a7b0-f9432bfc06ba None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:31.669291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:31.716872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dedcdd-8704-4682-8074-c945b1b8246d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:31.720351 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dedcdd-8704-4682-8074-c945b1b8246d None admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:31.720744 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dedcdd-8704-4682-8074-c945b1b8246d None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:31.720978 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dedcdd-8704-4682-8074-c945b1b8246d None admin] PATH_INFO: `/v3/projects/2937cdbeb750480e8d69fe400d2cca9e/users/4566a1a6f9e640b09e2a59d3dc93e6bb/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:31.725963 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dedcdd-8704-4682-8074-c945b1b8246d None admin] RBAC: Authorizing `identity:create_grant(project_id=2937cdbeb750480e8d69fe400d2cca9e, user_id=4566a1a6f9e640b09e2a59d3dc93e6bb, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:31.733428 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dedcdd-8704-4682-8074-c945b1b8246d None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:31.827091 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 144/267] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Aug 2 08:48:31 2022] PUT /identity/v3/projects/2937cdbeb750480e8d69fe400d2cca9e/users/4566a1a6f9e640b09e2a59d3dc93e6bb/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:48:31.828829 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abdd18-b8c4-45fc-a619-d04912d70707 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:31.829157 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abdd18-b8c4-45fc-a619-d04912d70707 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:31.829401 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abdd18-b8c4-45fc-a619-d04912d70707 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:31.830811 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 145/268] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:31.831210 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2739ac-cc63-46ac-a7b0-f9432bfc06ba None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:31.838317 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918b612-414d-4ac8-b818-972be9cc1540 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:31.838648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918b612-414d-4ac8-b818-972be9cc1540 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:31.839171 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918b612-414d-4ac8-b818-972be9cc1540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:31.865318 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-b918b612-414d-4ac8-b818-972be9cc1540 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:31.866838 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-b918b612-414d-4ac8-b818-972be9cc1540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:31.915929 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705b87f-2e4a-4c1d-97ed-8ff7301eee5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:31.916726 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705b87f-2e4a-4c1d-97ed-8ff7301eee5e None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:31.917582 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705b87f-2e4a-4c1d-97ed-8ff7301eee5e None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:31.917933 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705b87f-2e4a-4c1d-97ed-8ff7301eee5e None admin] PATH_INFO: `/v3/projects/2937cdbeb750480e8d69fe400d2cca9e` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:31.919888 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2705b87f-2e4a-4c1d-97ed-8ff7301eee5e None admin] RBAC: Authorizing `identity:get_project(project_id=2937cdbeb750480e8d69fe400d2cca9e)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:31.921535 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2705b87f-2e4a-4c1d-97ed-8ff7301eee5e None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:31.923687 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 124/269] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:31 2022] GET /identity/v3/projects/2937cdbeb750480e8d69fe400d2cca9e => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:48:31.928236 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5324a7e-5702-40c8-b225-05402185083e None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:31.928236 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5324a7e-5702-40c8-b225-05402185083e None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:31.928236 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5324a7e-5702-40c8-b225-05402185083e None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:31.928236 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 125/270] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:31.933648 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5324a7e-5702-40c8-b225-05402185083e None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:31.971411 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:31.981881 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 146/271] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:31.985466 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde1466-26c3-45b5-8211-f2212b3566c7 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:31.985466 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde1466-26c3-45b5-8211-f2212b3566c7 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:31.985466 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde1466-26c3-45b5-8211-f2212b3566c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:32.034905 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-0dde1466-26c3-45b5-8211-f2212b3566c7 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:32.037220 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-0dde1466-26c3-45b5-8211-f2212b3566c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:32.108735 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5324a7e-5702-40c8-b225-05402185083e None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:32.161604 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568b653-939d-492c-9c5f-6f417cd57969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:32.164670 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568b653-939d-492c-9c5f-6f417cd57969 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:32.165173 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568b653-939d-492c-9c5f-6f417cd57969 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:32.165686 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568b653-939d-492c-9c5f-6f417cd57969 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:32.167323 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c568b653-939d-492c-9c5f-6f417cd57969 None admin] RBAC: Adding query filter params (role.id=923eb688fccc4e79b6c3df28d754b6c4, scope.project.id=2937cdbeb750480e8d69fe400d2cca9e, user.id=d2858c5f061f4e5ea34e7a559d960d06) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:32.167863 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c568b653-939d-492c-9c5f-6f417cd57969 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:32.171133 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c568b653-939d-492c-9c5f-6f417cd57969 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:32.184594 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 126/272] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:48:31 2022] GET /identity/v3/role_assignments?user.id=d2858c5f061f4e5ea34e7a559d960d06&scope.project.id=2937cdbeb750480e8d69fe400d2cca9e&role.id=923eb688fccc4e79b6c3df28d754b6c4 => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:48:32.186535 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568b653-939d-492c-9c5f-6f417cd57969 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:32.194256 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 147/273] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:32.238386 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde1466-26c3-45b5-8211-f2212b3566c7 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:32.313584 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:32.399878 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:32.424278 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568b653-939d-492c-9c5f-6f417cd57969 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:32.449336 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde1466-26c3-45b5-8211-f2212b3566c7 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:32.494105 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6f027-c96f-4dbb-a930-3c9b1e6e78ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:32.495662 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6f027-c96f-4dbb-a930-3c9b1e6e78ab None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:32.496103 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6f027-c96f-4dbb-a930-3c9b1e6e78ab None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:32.496586 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6f027-c96f-4dbb-a930-3c9b1e6e78ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:32.505479 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6f027-c96f-4dbb-a930-3c9b1e6e78ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:32.507038 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6f027-c96f-4dbb-a930-3c9b1e6e78ab None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:32.509255 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 127/274] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:48:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:32.515834 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6f027-c96f-4dbb-a930-3c9b1e6e78ab None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:32.526002 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4644f-742c-48b7-9342-50e61bd0079b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:32.527434 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4644f-742c-48b7-9342-50e61bd0079b None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:32.527727 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4644f-742c-48b7-9342-50e61bd0079b None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:32.528118 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4644f-742c-48b7-9342-50e61bd0079b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:32.545013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd4644f-742c-48b7-9342-50e61bd0079b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:32.551580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-ddd4644f-742c-48b7-9342-50e61bd0079b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:48:32.551580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:32.551580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:32.551580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:32.551580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:32.551580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:32.551580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:32.551580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:32.551580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:32.551580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:32.551580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:32.551580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:32.551580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:32.551580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:32.551580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:32.551580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:32.553445 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:32.553445 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:32.553445 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:32.553445 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:32.553445 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:32.553445 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:32.553445 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:32.553445 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:32.553445 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:32.553445 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:32.553445 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:32.553445 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:32.553445 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:32.553445 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:32.553445 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:32.553445 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:32.554897 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:32.554897 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:32.554897 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:32.554897 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:32.554897 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:32.554897 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:32.554897 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:32.554897 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:32.554897 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:32.554897 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:32.554897 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:48:32.554897 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:48:32.554897 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 148/275] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:48:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:32.567863 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4644f-742c-48b7-9342-50e61bd0079b None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:32.752407 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6f027-c96f-4dbb-a930-3c9b1e6e78ab None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:32.765488 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:32.778395 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4644f-742c-48b7-9342-50e61bd0079b None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:32.808766 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e95917-91b6-477f-a758-d4d748397724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:32.809981 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e95917-91b6-477f-a758-d4d748397724 None admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:32.810510 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e95917-91b6-477f-a758-d4d748397724 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:32.810943 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e95917-91b6-477f-a758-d4d748397724 None admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:32.812028 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e95917-91b6-477f-a758-d4d748397724 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:32.814146 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e95917-91b6-477f-a758-d4d748397724 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:32.854027 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ddeaaf-7123-4b3c-830e-7c8d770e80f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:32.856639 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddeaaf-7123-4b3c-830e-7c8d770e80f4 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:32.856639 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddeaaf-7123-4b3c-830e-7c8d770e80f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:32.857008 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddeaaf-7123-4b3c-830e-7c8d770e80f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:32.858428 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ddeaaf-7123-4b3c-830e-7c8d770e80f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:32.858428 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ddeaaf-7123-4b3c-830e-7c8d770e80f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:32.860454 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ddeaaf-7123-4b3c-830e-7c8d770e80f4 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:32.874989 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 149/276] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Aug 2 08:48:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:32.882197 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ddeaaf-7123-4b3c-830e-7c8d770e80f4 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:32.940047 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 128/277] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Aug 2 08:48:32 2022] POST /identity/v3/users => generated 293 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:48:32.941880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1de25-b3bd-4523-8302-970eb837465d None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:32.942320 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1de25-b3bd-4523-8302-970eb837465d None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:32.943242 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1de25-b3bd-4523-8302-970eb837465d None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:32.945066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 129/278] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:32.957396 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2a674-3df8-4eca-b8f2-cea5209f7699 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:32.957722 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2a674-3df8-4eca-b8f2-cea5209f7699 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:32.957960 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2a674-3df8-4eca-b8f2-cea5209f7699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:32.980532 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-f8b2a674-3df8-4eca-b8f2-cea5209f7699 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:32.981982 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-f8b2a674-3df8-4eca-b8f2-cea5209f7699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:32.997511 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:33.089320 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ddeaaf-7123-4b3c-830e-7c8d770e80f4 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:33.118572 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 130/279] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:33.139812 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2a674-3df8-4eca-b8f2-cea5209f7699 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:33.141690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f4cdf-3d50-45fc-b118-b44fa2f8b812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:33.143394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f4cdf-3d50-45fc-b118-b44fa2f8b812 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:33.143905 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f4cdf-3d50-45fc-b118-b44fa2f8b812 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:33.144398 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f4cdf-3d50-45fc-b118-b44fa2f8b812 None admin] PATH_INFO: `/v3/users/1359e0d6c9214071b170a432ba068b79` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:33.170108 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f4cdf-3d50-45fc-b118-b44fa2f8b812 None admin] RBAC: Authorizing `identity:get_user(user_id=1359e0d6c9214071b170a432ba068b79)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:33.172695 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f4cdf-3d50-45fc-b118-b44fa2f8b812 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:33.175377 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 150/280] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:48:32 2022] GET /identity/v3/users/1359e0d6c9214071b170a432ba068b79 => generated 293 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:48:33.182126 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f4cdf-3d50-45fc-b118-b44fa2f8b812 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:33.216987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:33.309337 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2a674-3df8-4eca-b8f2-cea5209f7699 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:33.362481 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd931a-3518-4bdf-bf4e-dabf94122569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:33.363367 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd931a-3518-4bdf-bf4e-dabf94122569 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:33.364086 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd931a-3518-4bdf-bf4e-dabf94122569 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:33.364261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f4cdf-3d50-45fc-b118-b44fa2f8b812 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:33.364704 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd931a-3518-4bdf-bf4e-dabf94122569 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:33.391052 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd931a-3518-4bdf-bf4e-dabf94122569 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:33.399861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-47cd931a-3518-4bdf-bf4e-dabf94122569 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:48:33.399861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:33.399861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:33.399861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:33.399861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:33.399861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:33.399861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:33.399861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:33.399861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:33.399861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:33.399861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:33.399861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:33.399861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:33.399861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:33.399861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:33.399861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:33.404651 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:33.404651 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:33.404651 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:33.404651 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:33.404651 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:33.404651 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:33.404651 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:33.404651 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:33.404651 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:33.404651 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:33.404651 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:33.404651 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:33.404651 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:33.404651 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:33.404651 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:33.404651 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:33.405423 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:33.405423 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:33.405423 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:33.405423 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:33.405423 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:33.405423 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:33.405423 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:33.405423 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:33.405423 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:33.405423 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:33.405423 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:48:33.405423 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:48:33.405423 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 131/281] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:48:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:33.425505 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd931a-3518-4bdf-bf4e-dabf94122569 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:33.434946 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:33.439846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2dd0f-60f3-475f-9faf-7495daec9621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:33.440897 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2dd0f-60f3-475f-9faf-7495daec9621 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:33.441394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2dd0f-60f3-475f-9faf-7495daec9621 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:33.442376 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2dd0f-60f3-475f-9faf-7495daec9621 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:33.444685 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2dd0f-60f3-475f-9faf-7495daec9621 None admin] RBAC: Adding query filter params (role.id=5fd593d076084fbaa9208dd505b58150, user.id=1359e0d6c9214071b170a432ba068b79, scope.system=all) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:33.445246 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2dd0f-60f3-475f-9faf-7495daec9621 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:33.447485 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2dd0f-60f3-475f-9faf-7495daec9621 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:33.458378 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 151/282] 10.222.0.20 () {56 vars in 1308 bytes} [Tue Aug 2 08:48:33 2022] GET /identity/v3/role_assignments?user.id=1359e0d6c9214071b170a432ba068b79&scope.system=all&role.id=5fd593d076084fbaa9208dd505b58150 => generated 226 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:33.646514 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd931a-3518-4bdf-bf4e-dabf94122569 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:33.729646 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f9756-8db9-43c2-b41e-5a34545df81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:33.730840 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f9756-8db9-43c2-b41e-5a34545df81c None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:33.731332 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f9756-8db9-43c2-b41e-5a34545df81c None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:33.731805 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f9756-8db9-43c2-b41e-5a34545df81c None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:33.733278 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f9756-8db9-43c2-b41e-5a34545df81c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:33.733803 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f9756-8db9-43c2-b41e-5a34545df81c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:33.736610 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f9756-8db9-43c2-b41e-5a34545df81c None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:33.759181 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 132/283] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Aug 2 08:48:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:33.766595 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2dd0f-60f3-475f-9faf-7495daec9621 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:33.962963 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:34.013804 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2dd0f-60f3-475f-9faf-7495daec9621 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:34.094408 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceaf0b1-6110-4af5-b00a-6038bcc3fa88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:34.095495 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceaf0b1-6110-4af5-b00a-6038bcc3fa88 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:34.095976 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceaf0b1-6110-4af5-b00a-6038bcc3fa88 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:34.096496 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceaf0b1-6110-4af5-b00a-6038bcc3fa88 None admin] PATH_INFO: `/v3/users/fb329322ef2a44019e6f61b1259d8465` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:34.098715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceaf0b1-6110-4af5-b00a-6038bcc3fa88 None admin] RBAC: Authorizing `identity:get_user(user_id=fb329322ef2a44019e6f61b1259d8465)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:34.101438 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceaf0b1-6110-4af5-b00a-6038bcc3fa88 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:34.105947 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 152/284] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:48:33 2022] GET /identity/v3/users/fb329322ef2a44019e6f61b1259d8465 => generated 297 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:34.111949 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f9756-8db9-43c2-b41e-5a34545df81c None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:34.256347 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:34.333941 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f9756-8db9-43c2-b41e-5a34545df81c None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:34.401924 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e7c90-3886-4e80-b123-d6891f04d4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:34.402966 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e7c90-3886-4e80-b123-d6891f04d4d3 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:34.403423 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e7c90-3886-4e80-b123-d6891f04d4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:34.403913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e7c90-3886-4e80-b123-d6891f04d4d3 None admin] PATH_INFO: `/v3/projects/2937cdbeb750480e8d69fe400d2cca9e` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:34.406312 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e7c90-3886-4e80-b123-d6891f04d4d3 None admin] RBAC: Authorizing `identity:get_project(project_id=2937cdbeb750480e8d69fe400d2cca9e)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:34.409078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e7c90-3886-4e80-b123-d6891f04d4d3 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:34.412900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 133/285] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:34 2022] GET /identity/v3/projects/2937cdbeb750480e8d69fe400d2cca9e => generated 302 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:34.422309 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceaf0b1-6110-4af5-b00a-6038bcc3fa88 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:34.668655 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceaf0b1-6110-4af5-b00a-6038bcc3fa88 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:34.764360 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f711ae2-0dfd-4c0c-a468-268d83c64570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:34.765522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f711ae2-0dfd-4c0c-a468-268d83c64570 None admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:34.766016 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f711ae2-0dfd-4c0c-a468-268d83c64570 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:34.766505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f711ae2-0dfd-4c0c-a468-268d83c64570 None admin] PATH_INFO: `/v3/projects/2937cdbeb750480e8d69fe400d2cca9e/users/fb329322ef2a44019e6f61b1259d8465/roles/6639a392f46d4388a120947fb8da02cc` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:34.770056 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f711ae2-0dfd-4c0c-a468-268d83c64570 None admin] RBAC: Authorizing `identity:create_grant(project_id=2937cdbeb750480e8d69fe400d2cca9e, user_id=fb329322ef2a44019e6f61b1259d8465, role_id=6639a392f46d4388a120947fb8da02cc)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:34.772769 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f711ae2-0dfd-4c0c-a468-268d83c64570 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:34.865535 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 153/286] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Aug 2 08:48:34 2022] PUT /identity/v3/projects/2937cdbeb750480e8d69fe400d2cca9e/users/fb329322ef2a44019e6f61b1259d8465/roles/6639a392f46d4388a120947fb8da02cc => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:48:35.344698 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af442f-8ab3-46e2-819c-019c14b00271 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:35.345484 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af442f-8ab3-46e2-819c-019c14b00271 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:35.345484 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af442f-8ab3-46e2-819c-019c14b00271 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:35.346625 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 134/287] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:48:35.354529 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186689a-5074-45af-9e18-ac33d518acc0 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:35.354965 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186689a-5074-45af-9e18-ac33d518acc0 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:35.355402 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186689a-5074-45af-9e18-ac33d518acc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:35.387603 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-d186689a-5074-45af-9e18-ac33d518acc0 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:35.394370 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-d186689a-5074-45af-9e18-ac33d518acc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:35.395844 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:35.494086 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 154/288] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:35.534275 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af442f-8ab3-46e2-819c-019c14b00271 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:35.704735 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af442f-8ab3-46e2-819c-019c14b00271 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:35.743821 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:35.750123 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c564c-0015-4a59-ac07-881cd6bb0666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:35.755590 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c564c-0015-4a59-ac07-881cd6bb0666 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:35.755590 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c564c-0015-4a59-ac07-881cd6bb0666 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:35.755590 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c564c-0015-4a59-ac07-881cd6bb0666 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:35.769610 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c564c-0015-4a59-ac07-881cd6bb0666 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:35.777632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-2d9c564c-0015-4a59-ac07-881cd6bb0666 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:48:35.777632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:35.777632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:35.777632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:35.777632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:35.777632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:35.777632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:35.777632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:35.777632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:35.777632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:35.777632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:35.777632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:35.777632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:35.777632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:35.777632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:35.777632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:35.781243 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:35.781243 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:35.781243 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:35.781243 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:35.781243 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:35.781243 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:35.781243 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:35.781243 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:35.781243 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:35.781243 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:35.781243 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:35.781243 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:35.781243 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:35.781243 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:35.781243 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:35.781243 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:35.789233 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:35.789233 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:35.789233 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:35.789233 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:35.789233 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:35.789233 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:35.789233 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:35.789233 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:35.789233 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:35.789233 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:35.789233 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:48:35.789233 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:48:35.789233 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 135/289] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:48:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:35.792375 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186689a-5074-45af-9e18-ac33d518acc0 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:35.986437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186689a-5074-45af-9e18-ac33d518acc0 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:36.051332 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1f93e-df89-46f9-9fce-dcad7eb6d368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:36.052942 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1f93e-df89-46f9-9fce-dcad7eb6d368 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:36.053713 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1f93e-df89-46f9-9fce-dcad7eb6d368 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:36.054496 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1f93e-df89-46f9-9fce-dcad7eb6d368 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:36.056142 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1f93e-df89-46f9-9fce-dcad7eb6d368 None admin] RBAC: Adding query filter params (name=member) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:36.057054 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1f93e-df89-46f9-9fce-dcad7eb6d368 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:36.060573 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1f93e-df89-46f9-9fce-dcad7eb6d368 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:36.073439 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:36.080586 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 155/290] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Aug 2 08:48:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:48:36.086669 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c564c-0015-4a59-ac07-881cd6bb0666 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:36.357259 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c564c-0015-4a59-ac07-881cd6bb0666 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:36.450011 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e98a32-ab43-4c54-a689-00e0c6431f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:36.451142 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e98a32-ab43-4c54-a689-00e0c6431f8c None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:36.451641 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e98a32-ab43-4c54-a689-00e0c6431f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:36.452144 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e98a32-ab43-4c54-a689-00e0c6431f8c None admin] PATH_INFO: `/v3/users/4566a1a6f9e640b09e2a59d3dc93e6bb` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:36.454598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e98a32-ab43-4c54-a689-00e0c6431f8c None admin] RBAC: Authorizing `identity:get_user(user_id=4566a1a6f9e640b09e2a59d3dc93e6bb)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:36.457400 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e98a32-ab43-4c54-a689-00e0c6431f8c None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:36.460979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 136/291] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:48:36 2022] GET /identity/v3/users/4566a1a6f9e640b09e2a59d3dc93e6bb => generated 297 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:36.470321 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1f93e-df89-46f9-9fce-dcad7eb6d368 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:36.605942 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1f93e-df89-46f9-9fce-dcad7eb6d368 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:36.645665 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ff4b5-f302-4587-a375-2710952e7fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:36.646331 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ff4b5-f302-4587-a375-2710952e7fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:36.646610 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ff4b5-f302-4587-a375-2710952e7fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:36.646889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ff4b5-f302-4587-a375-2710952e7fe1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:36.726143 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:36.733149 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ff4b5-f302-4587-a375-2710952e7fe1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:36.734509 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ff4b5-f302-4587-a375-2710952e7fe1 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:36.860578 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 156/292] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:48:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:48:36.868928 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e98a32-ab43-4c54-a689-00e0c6431f8c None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:36.915528 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c86d2-964a-4134-a60f-1620264a0dfc None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:36.916366 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c86d2-964a-4134-a60f-1620264a0dfc None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:36.917693 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c86d2-964a-4134-a60f-1620264a0dfc None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:36.920501 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 157/293] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:36.937175 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61444f41-e90f-47cf-9e5b-15ea45192a36 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:36.938057 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61444f41-e90f-47cf-9e5b-15ea45192a36 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:36.938738 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61444f41-e90f-47cf-9e5b-15ea45192a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:36.992574 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-61444f41-e90f-47cf-9e5b-15ea45192a36 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:36.995115 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-61444f41-e90f-47cf-9e5b-15ea45192a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:37.003218 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:37.075476 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e98a32-ab43-4c54-a689-00e0c6431f8c None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:37.128182 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fbd19-817b-4cfd-9a8c-3d4afdab12b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:37.129121 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fbd19-817b-4cfd-9a8c-3d4afdab12b2 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:37.129528 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fbd19-817b-4cfd-9a8c-3d4afdab12b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:37.130257 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fbd19-817b-4cfd-9a8c-3d4afdab12b2 None admin] PATH_INFO: `/v3/projects/2937cdbeb750480e8d69fe400d2cca9e` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:37.132279 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0fbd19-817b-4cfd-9a8c-3d4afdab12b2 None admin] RBAC: Authorizing `identity:get_project(project_id=2937cdbeb750480e8d69fe400d2cca9e)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:37.134297 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0fbd19-817b-4cfd-9a8c-3d4afdab12b2 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:37.138135 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 137/294] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:36 2022] GET /identity/v3/projects/2937cdbeb750480e8d69fe400d2cca9e => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:37.140227 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273f9e4-af46-477e-9316-8a15ad0d37bb None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:37.140517 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273f9e4-af46-477e-9316-8a15ad0d37bb None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:37.140831 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273f9e4-af46-477e-9316-8a15ad0d37bb None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:37.142750 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 138/295] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:37.149346 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273f9e4-af46-477e-9316-8a15ad0d37bb None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:37.178349 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 158/296] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:37.187066 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8353f-cb0b-451b-9d8c-227cfe21a671 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:37.187890 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8353f-cb0b-451b-9d8c-227cfe21a671 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:37.188650 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8353f-cb0b-451b-9d8c-227cfe21a671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:37.235154 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-f7f8353f-cb0b-451b-9d8c-227cfe21a671 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:37.238011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-f7f8353f-cb0b-451b-9d8c-227cfe21a671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:37.301108 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:37.343148 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273f9e4-af46-477e-9316-8a15ad0d37bb None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:37.365262 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 159/297] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:37.366700 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8353f-cb0b-451b-9d8c-227cfe21a671 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:37.404609 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:37.418561 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7f2c0-8c68-4b08-bcd5-e8a19d7489ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:37.419336 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7f2c0-8c68-4b08-bcd5-e8a19d7489ca None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:37.419696 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7f2c0-8c68-4b08-bcd5-e8a19d7489ca None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:37.420068 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7f2c0-8c68-4b08-bcd5-e8a19d7489ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:37.421031 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd7f2c0-8c68-4b08-bcd5-e8a19d7489ca None admin] RBAC: Adding query filter params (role.id=5fd593d076084fbaa9208dd505b58150, scope.project.id=2937cdbeb750480e8d69fe400d2cca9e, user.id=4566a1a6f9e640b09e2a59d3dc93e6bb) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:37.421446 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd7f2c0-8c68-4b08-bcd5-e8a19d7489ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:37.423137 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd7f2c0-8c68-4b08-bcd5-e8a19d7489ca None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:37.431458 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 139/298] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:48:37 2022] GET /identity/v3/role_assignments?user.id=4566a1a6f9e640b09e2a59d3dc93e6bb&scope.project.id=2937cdbeb750480e8d69fe400d2cca9e&role.id=5fd593d076084fbaa9208dd505b58150 => generated 608 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:37.433192 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f0a82-84e0-416d-9b7d-afe152e00795 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:37.433640 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f0a82-84e0-416d-9b7d-afe152e00795 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:37.434013 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f0a82-84e0-416d-9b7d-afe152e00795 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:37.435923 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 140/299] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:37.441655 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f0a82-84e0-416d-9b7d-afe152e00795 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:37.615818 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8353f-cb0b-451b-9d8c-227cfe21a671 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:37.656982 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f0a82-84e0-416d-9b7d-afe152e00795 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:37.669281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5661d3-5828-4949-8712-0b2f606e1678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:37.670040 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5661d3-5828-4949-8712-0b2f606e1678 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:37.670292 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5661d3-5828-4949-8712-0b2f606e1678 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:37.670542 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5661d3-5828-4949-8712-0b2f606e1678 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:37.683692 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5661d3-5828-4949-8712-0b2f606e1678 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:37.688945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-8d5661d3-5828-4949-8712-0b2f606e1678 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:48:37.688945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:37.688945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:37.688945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:37.688945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:37.688945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:37.688945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:37.688945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:37.688945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:37.688945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:37.688945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:37.688945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:37.688945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:37.688945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:37.688945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:37.688945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:37.690756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:37.690756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:37.690756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:37.690756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:37.690756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:37.690756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:37.690756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:37.690756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:37.690756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:37.690756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:37.690756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:37.690756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:37.690756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:37.690756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:37.690756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:37.690756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:37.692401 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:37.692401 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:37.692401 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:37.692401 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:37.692401 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:37.692401 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:37.692401 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:37.692401 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:37.692401 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:37.692401 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:37.692401 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:48:37.692401 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:48:37.692401 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 160/300] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:48:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:37.692401 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8cec5-5a8e-4b61-afeb-af2a0c112d3c None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:37.694120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8cec5-5a8e-4b61-afeb-af2a0c112d3c None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:37.694120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8cec5-5a8e-4b61-afeb-af2a0c112d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:37.715071 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-31c8cec5-5a8e-4b61-afeb-af2a0c112d3c None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:37.716396 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-31c8cec5-5a8e-4b61-afeb-af2a0c112d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:37.733962 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd86e6f-2b79-4d85-856a-84a626889597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:37.734799 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd86e6f-2b79-4d85-856a-84a626889597 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:37.735217 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd86e6f-2b79-4d85-856a-84a626889597 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:37.735695 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd86e6f-2b79-4d85-856a-84a626889597 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:37.740314 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd86e6f-2b79-4d85-856a-84a626889597 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:37.740730 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd86e6f-2b79-4d85-856a-84a626889597 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:37.743572 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 141/301] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:48:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:37.746713 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd86e6f-2b79-4d85-856a-84a626889597 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:37.749463 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:37.840334 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 161/302] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:37.841663 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8cec5-5a8e-4b61-afeb-af2a0c112d3c None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:37.860713 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:37.930667 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd86e6f-2b79-4d85-856a-84a626889597 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:37.977109 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4cde9f-29d3-4887-b62a-eef851af8e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:37.977855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4cde9f-29d3-4887-b62a-eef851af8e7c None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:37.978341 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4cde9f-29d3-4887-b62a-eef851af8e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:37.978786 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4cde9f-29d3-4887-b62a-eef851af8e7c None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:37.980264 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4cde9f-29d3-4887-b62a-eef851af8e7c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:37.980874 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4cde9f-29d3-4887-b62a-eef851af8e7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:37.982902 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4cde9f-29d3-4887-b62a-eef851af8e7c None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:38.000131 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 142/303] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Aug 2 08:48:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:38.000131 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4cde9f-29d3-4887-b62a-eef851af8e7c None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:38.046349 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8cec5-5a8e-4b61-afeb-af2a0c112d3c None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:38.108302 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd9f0d-a616-408a-b180-c3ae6ff6b452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:38.109334 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd9f0d-a616-408a-b180-c3ae6ff6b452 None admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:38.109988 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd9f0d-a616-408a-b180-c3ae6ff6b452 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:38.110447 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd9f0d-a616-408a-b180-c3ae6ff6b452 None admin] PATH_INFO: `/v3/groups` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:38.111653 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd9f0d-a616-408a-b180-c3ae6ff6b452 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:38.114050 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd9f0d-a616-408a-b180-c3ae6ff6b452 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:38.173558 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4cde9f-29d3-4887-b62a-eef851af8e7c None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:38.195999 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 162/304] 10.222.0.20 () {60 vars in 1134 bytes} [Tue Aug 2 08:48:37 2022] POST /identity/v3/groups => generated 229 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:48:38.197318 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd9f0d-a616-408a-b180-c3ae6ff6b452 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:38.220554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:38.222591 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:38.247478 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd268d30-6b16-4a5d-a888-4098c7482231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:38.248305 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd268d30-6b16-4a5d-a888-4098c7482231 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:38.249327 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd268d30-6b16-4a5d-a888-4098c7482231 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:38.249796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd268d30-6b16-4a5d-a888-4098c7482231 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:38.275038 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd268d30-6b16-4a5d-a888-4098c7482231 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:38.287311 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-bd268d30-6b16-4a5d-a888-4098c7482231 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:48:38.287311 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:38.287311 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:38.287311 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:38.287311 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:38.287311 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:38.287311 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:38.287311 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:38.287311 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:38.287311 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:38.287311 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:38.287311 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:38.287311 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:38.287311 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:38.287311 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:38.287311 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:38.289133 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:38.289133 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:38.289133 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:38.289133 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:38.289133 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:38.289133 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:38.289133 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:38.289133 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:38.289133 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:38.289133 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:38.289133 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:38.289133 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:38.289133 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:38.289133 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:38.289133 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:38.289133 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:38.297644 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:38.297644 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:38.297644 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:38.297644 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:38.297644 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:38.297644 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:38.297644 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:38.297644 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:38.297644 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:38.297644 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:38.297644 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:48:38.297644 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:48:38.297644 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 143/305] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:48:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:38.297644 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c4d7e-5aa3-4ec9-baae-65de92998e5c None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:38.300775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c4d7e-5aa3-4ec9-baae-65de92998e5c None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:38.300775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c4d7e-5aa3-4ec9-baae-65de92998e5c None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:38.300775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 144/306] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:38.305896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c4d7e-5aa3-4ec9-baae-65de92998e5c None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:38.420024 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd9f0d-a616-408a-b180-c3ae6ff6b452 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:38.485846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcab6f-7a23-4277-a79f-155eae6a7452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:38.487622 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcab6f-7a23-4277-a79f-155eae6a7452 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:38.488244 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcab6f-7a23-4277-a79f-155eae6a7452 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:38.488601 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcab6f-7a23-4277-a79f-155eae6a7452 None admin] PATH_INFO: `/v3/users/0a988b45f15b44dab4cf50803484f773` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:38.497891 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c4d7e-5aa3-4ec9-baae-65de92998e5c None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:38.509232 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcab6f-7a23-4277-a79f-155eae6a7452 None admin] RBAC: Authorizing `identity:get_user(user_id=0a988b45f15b44dab4cf50803484f773)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:38.512644 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcab6f-7a23-4277-a79f-155eae6a7452 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:38.520205 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 163/307] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:48:38 2022] GET /identity/v3/users/0a988b45f15b44dab4cf50803484f773 => generated 293 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:38.520205 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197d940-7a2f-404d-a24e-c8511986418a None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:38.520205 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197d940-7a2f-404d-a24e-c8511986418a None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:38.520205 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197d940-7a2f-404d-a24e-c8511986418a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:38.548640 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-a197d940-7a2f-404d-a24e-c8511986418a None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:38.550054 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-a197d940-7a2f-404d-a24e-c8511986418a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:38.562510 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d00279-39cd-491c-9cd2-5c9d79925920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:38.563558 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d00279-39cd-491c-9cd2-5c9d79925920 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:38.564035 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d00279-39cd-491c-9cd2-5c9d79925920 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:38.564457 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d00279-39cd-491c-9cd2-5c9d79925920 None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:38.565597 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d00279-39cd-491c-9cd2-5c9d79925920 None admin] RBAC: Adding query filter params (name=member) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:38.566157 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d00279-39cd-491c-9cd2-5c9d79925920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:38.567816 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d00279-39cd-491c-9cd2-5c9d79925920 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:38.581657 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 145/308] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Aug 2 08:48:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:38.588385 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d00279-39cd-491c-9cd2-5c9d79925920 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:38.633870 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:38.642160 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 164/309] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:38.643049 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197d940-7a2f-404d-a24e-c8511986418a None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:38.677121 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:38.753960 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d00279-39cd-491c-9cd2-5c9d79925920 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:38.786101 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197d940-7a2f-404d-a24e-c8511986418a None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:38.807549 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b73f8-fde2-41df-aff2-efb08282f5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:38.808634 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b73f8-fde2-41df-aff2-efb08282f5dd None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:38.809100 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b73f8-fde2-41df-aff2-efb08282f5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:38.809545 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b73f8-fde2-41df-aff2-efb08282f5dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:38.810945 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b73f8-fde2-41df-aff2-efb08282f5dd None admin] RBAC: Adding query filter params (role.id=6639a392f46d4388a120947fb8da02cc, user.id=0a988b45f15b44dab4cf50803484f773, scope.system=all) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:38.811439 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b73f8-fde2-41df-aff2-efb08282f5dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:38.813697 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b73f8-fde2-41df-aff2-efb08282f5dd None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:38.823962 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 146/310] 10.222.0.20 () {56 vars in 1308 bytes} [Tue Aug 2 08:48:38 2022] GET /identity/v3/role_assignments?user.id=0a988b45f15b44dab4cf50803484f773&scope.system=all&role.id=6639a392f46d4388a120947fb8da02cc => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:38.825576 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b73f8-fde2-41df-aff2-efb08282f5dd None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:38.850421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf875a-2dde-406c-8163-3554c0fa456f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:38.851423 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf875a-2dde-406c-8163-3554c0fa456f None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:38.851859 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf875a-2dde-406c-8163-3554c0fa456f None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:38.852410 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf875a-2dde-406c-8163-3554c0fa456f None admin] PATH_INFO: `/v3/users/1359e0d6c9214071b170a432ba068b79` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:38.854610 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf875a-2dde-406c-8163-3554c0fa456f None admin] RBAC: Authorizing `identity:get_user(user_id=1359e0d6c9214071b170a432ba068b79)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:38.857354 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf875a-2dde-406c-8163-3554c0fa456f None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:38.870122 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 165/311] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:48:38 2022] GET /identity/v3/users/1359e0d6c9214071b170a432ba068b79 => generated 293 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:38.880220 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf875a-2dde-406c-8163-3554c0fa456f None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:39.011917 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:39.033497 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b73f8-fde2-41df-aff2-efb08282f5dd None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:39.052589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:39.085772 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235baf8-cb48-4625-98d0-cce5a2204334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:39.086839 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235baf8-cb48-4625-98d0-cce5a2204334 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:39.087432 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235baf8-cb48-4625-98d0-cce5a2204334 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:39.087809 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235baf8-cb48-4625-98d0-cce5a2204334 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:39.097847 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf875a-2dde-406c-8163-3554c0fa456f None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:39.103068 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5235baf8-cb48-4625-98d0-cce5a2204334 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:39.109549 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-5235baf8-cb48-4625-98d0-cce5a2204334 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:48:39.109549 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:39.109549 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:39.109549 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:39.109549 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:39.109549 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:39.109549 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:39.109549 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:39.109549 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:39.109549 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:39.109549 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:39.109549 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:39.109549 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:39.109549 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:39.109549 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:39.109549 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:39.111522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:39.111522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:39.111522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:39.111522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:39.111522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:39.111522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:39.111522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:39.111522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:39.111522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:39.111522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:39.111522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:39.111522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:39.111522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:39.111522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:39.111522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:39.111522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:39.113775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:39.113775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:39.113775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:39.113775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:39.113775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:39.113775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:39.113775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:39.113775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:39.113775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:39.113775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:39.113775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:48:39.113775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:48:39.113775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 147/312] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:48:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:39.126351 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235baf8-cb48-4625-98d0-cce5a2204334 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:39.196028 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d7b55-c265-41a8-bac4-efb841629e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:39.197692 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d7b55-c265-41a8-bac4-efb841629e43 None admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:39.198985 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d7b55-c265-41a8-bac4-efb841629e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:39.199724 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d7b55-c265-41a8-bac4-efb841629e43 None admin] PATH_INFO: `/v3/system/users/1359e0d6c9214071b170a432ba068b79/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:39.202876 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d7b55-c265-41a8-bac4-efb841629e43 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1359e0d6c9214071b170a432ba068b79, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:39.206413 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d7b55-c265-41a8-bac4-efb841629e43 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:39.322502 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 166/313] 10.222.0.20 () {58 vars in 1334 bytes} [Tue Aug 2 08:48:38 2022] PUT /identity/v3/system/users/1359e0d6c9214071b170a432ba068b79/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:48:39.360838 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235baf8-cb48-4625-98d0-cce5a2204334 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:39.421801 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3adab-4dea-4c31-a32e-4ccd1817164f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:39.422923 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3adab-4dea-4c31-a32e-4ccd1817164f None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:39.423430 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3adab-4dea-4c31-a32e-4ccd1817164f None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:39.423917 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3adab-4dea-4c31-a32e-4ccd1817164f None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:39.425343 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3adab-4dea-4c31-a32e-4ccd1817164f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:39.425896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3adab-4dea-4c31-a32e-4ccd1817164f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:39.428869 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3adab-4dea-4c31-a32e-4ccd1817164f None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:39.449230 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 148/314] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Aug 2 08:48:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:39.458972 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d7b55-c265-41a8-bac4-efb841629e43 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:39.677222 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d7b55-c265-41a8-bac4-efb841629e43 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:39.738543 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:39.749707 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea806f-524f-49fe-a209-9f7981e50ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:39.753979 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea806f-524f-49fe-a209-9f7981e50ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:39.753979 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea806f-524f-49fe-a209-9f7981e50ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:39.753979 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea806f-524f-49fe-a209-9f7981e50ce7 None admin] PATH_INFO: `/v3/users/fb329322ef2a44019e6f61b1259d8465` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:39.755302 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea806f-524f-49fe-a209-9f7981e50ce7 None admin] RBAC: Authorizing `identity:get_user(user_id=fb329322ef2a44019e6f61b1259d8465)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:39.758350 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea806f-524f-49fe-a209-9f7981e50ce7 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:39.762866 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 167/315] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:48:39 2022] GET /identity/v3/users/fb329322ef2a44019e6f61b1259d8465 => generated 297 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:39.768244 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3adab-4dea-4c31-a32e-4ccd1817164f None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:39.807929 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:39.894069 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3adab-4dea-4c31-a32e-4ccd1817164f None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:39.935553 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748661a-7a2d-4d58-9e27-9de63005f379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:39.936107 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748661a-7a2d-4d58-9e27-9de63005f379 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:39.936494 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748661a-7a2d-4d58-9e27-9de63005f379 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:39.936772 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748661a-7a2d-4d58-9e27-9de63005f379 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:40.017722 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748661a-7a2d-4d58-9e27-9de63005f379 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:40.019233 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748661a-7a2d-4d58-9e27-9de63005f379 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:40.054830 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:40.144305 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 149/316] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:48:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:48:40.146168 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea806f-524f-49fe-a209-9f7981e50ce7 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:40.329390 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea806f-524f-49fe-a209-9f7981e50ce7 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:40.395469 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f436b7e-1a83-4d32-b402-f48a9230726a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:40.396642 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f436b7e-1a83-4d32-b402-f48a9230726a None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:40.397152 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f436b7e-1a83-4d32-b402-f48a9230726a None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:40.397657 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f436b7e-1a83-4d32-b402-f48a9230726a None admin] PATH_INFO: `/v3/projects/2937cdbeb750480e8d69fe400d2cca9e` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:40.399745 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f436b7e-1a83-4d32-b402-f48a9230726a None admin] RBAC: Authorizing `identity:get_project(project_id=2937cdbeb750480e8d69fe400d2cca9e)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:40.402788 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f436b7e-1a83-4d32-b402-f48a9230726a None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:40.406599 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 168/317] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:40 2022] GET /identity/v3/projects/2937cdbeb750480e8d69fe400d2cca9e => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:48:40.415463 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748661a-7a2d-4d58-9e27-9de63005f379 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:40.623990 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748661a-7a2d-4d58-9e27-9de63005f379 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:40.693220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:40.696840 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e684f7-e9ae-49f0-a6ee-16829cb33582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:40.698468 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e684f7-e9ae-49f0-a6ee-16829cb33582 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:40.699283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e684f7-e9ae-49f0-a6ee-16829cb33582 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:40.700045 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e684f7-e9ae-49f0-a6ee-16829cb33582 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:40.701967 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e684f7-e9ae-49f0-a6ee-16829cb33582 None admin] RBAC: Adding query filter params (role.id=6639a392f46d4388a120947fb8da02cc, scope.project.id=2937cdbeb750480e8d69fe400d2cca9e, user.id=fb329322ef2a44019e6f61b1259d8465) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:40.702850 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e684f7-e9ae-49f0-a6ee-16829cb33582 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:40.706039 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e684f7-e9ae-49f0-a6ee-16829cb33582 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:40.719850 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 150/318] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:48:40 2022] GET /identity/v3/role_assignments?user.id=fb329322ef2a44019e6f61b1259d8465&scope.project.id=2937cdbeb750480e8d69fe400d2cca9e&role.id=6639a392f46d4388a120947fb8da02cc => generated 608 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:40.882551 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2a76d-2b59-4d3d-95a7-c1f35272d020 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:40.883238 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2a76d-2b59-4d3d-95a7-c1f35272d020 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:40.883516 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2a76d-2b59-4d3d-95a7-c1f35272d020 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:40.886818 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 169/319] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:40.896561 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af8bcb-cff8-43a4-82b8-90a35ded9ef2 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:40.897097 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af8bcb-cff8-43a4-82b8-90a35ded9ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:40.897547 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af8bcb-cff8-43a4-82b8-90a35ded9ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:40.936613 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-04af8bcb-cff8-43a4-82b8-90a35ded9ef2 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:40.938757 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-04af8bcb-cff8-43a4-82b8-90a35ded9ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:41.069913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 151/320] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:41.113374 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b2a76d-2b59-4d3d-95a7-c1f35272d020 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:41.251814 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:41.343392 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b2a76d-2b59-4d3d-95a7-c1f35272d020 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:41.402339 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3252a-0f5e-467a-8229-3222607b46dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:41.403048 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3252a-0f5e-467a-8229-3222607b46dc None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:41.403516 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3252a-0f5e-467a-8229-3222607b46dc None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:41.403971 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3252a-0f5e-467a-8229-3222607b46dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:41.405642 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3252a-0f5e-467a-8229-3222607b46dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:41.407672 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3252a-0f5e-467a-8229-3222607b46dc None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:41.409818 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 170/321] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:48:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:41.417464 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af8bcb-cff8-43a4-82b8-90a35ded9ef2 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:41.606399 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af8bcb-cff8-43a4-82b8-90a35ded9ef2 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:41.629037 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5006c-ffff-4fca-8df5-af289a33e589 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:41.629327 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5006c-ffff-4fca-8df5-af289a33e589 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:41.629871 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5006c-ffff-4fca-8df5-af289a33e589 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:41.631390 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 171/322] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:48:41.638272 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a29a8-2e60-498d-9e50-447019f2e4c6 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:41.638694 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a29a8-2e60-498d-9e50-447019f2e4c6 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:41.638872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a29a8-2e60-498d-9e50-447019f2e4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:41.654888 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:41.662838 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-e44a29a8-2e60-498d-9e50-447019f2e4c6 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:41.665178 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-e44a29a8-2e60-498d-9e50-447019f2e4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:41.669602 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4d4d7-99f0-4d4f-87ab-fb583f5f8ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:41.670036 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4d4d7-99f0-4d4f-87ab-fb583f5f8ce8 None admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:41.670473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4d4d7-99f0-4d4f-87ab-fb583f5f8ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:41.670872 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4d4d7-99f0-4d4f-87ab-fb583f5f8ce8 None admin] PATH_INFO: `/v3/groups` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:41.671780 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c4d4d7-99f0-4d4f-87ab-fb583f5f8ce8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:41.673910 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c4d4d7-99f0-4d4f-87ab-fb583f5f8ce8 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:41.774310 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 172/323] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:48:41.785362 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 152/324] 10.222.0.20 () {60 vars in 1134 bytes} [Tue Aug 2 08:48:41 2022] POST /identity/v3/groups => generated 226 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:48:41.798069 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a29a8-2e60-498d-9e50-447019f2e4c6 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:41.901157 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:41.977852 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a29a8-2e60-498d-9e50-447019f2e4c6 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:42.044057 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e5fdc-d00f-448d-9aa2-07798d8a56f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:42.045423 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e5fdc-d00f-448d-9aa2-07798d8a56f2 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:42.045975 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e5fdc-d00f-448d-9aa2-07798d8a56f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:42.046395 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e5fdc-d00f-448d-9aa2-07798d8a56f2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:42.070152 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e5fdc-d00f-448d-9aa2-07798d8a56f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:42.080750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-f09e5fdc-d00f-448d-9aa2-07798d8a56f2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:48:42.080750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:42.080750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:42.080750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:42.080750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:42.080750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:42.080750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:42.080750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:42.080750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:42.080750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:42.080750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:42.080750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:42.080750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:42.080750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:42.080750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:42.080750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:42.082385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:42.082385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:42.082385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:42.082385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:42.082385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:42.082385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:42.082385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:42.082385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:42.082385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:42.082385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:42.082385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:42.082385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:42.082385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:42.082385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:42.082385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:42.082385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:42.083761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:42.083761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:42.083761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:42.083761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:42.083761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:42.083761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:42.083761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:42.083761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:42.083761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:42.083761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:42.083761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:48:42.083761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:48:42.083761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 173/325] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:48:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:48:42.092622 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4d4d7-99f0-4d4f-87ab-fb583f5f8ce8 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:42.294260 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4d4d7-99f0-4d4f-87ab-fb583f5f8ce8 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:42.353589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641ce39-d1e3-46e4-8e28-9dc7ba158bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:42.355272 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641ce39-d1e3-46e4-8e28-9dc7ba158bed None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:42.356093 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641ce39-d1e3-46e4-8e28-9dc7ba158bed None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:42.356873 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641ce39-d1e3-46e4-8e28-9dc7ba158bed None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:42.358506 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641ce39-d1e3-46e4-8e28-9dc7ba158bed None admin] RBAC: Adding query filter params (name=reader) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:42.359291 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641ce39-d1e3-46e4-8e28-9dc7ba158bed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:42.362597 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641ce39-d1e3-46e4-8e28-9dc7ba158bed None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:42.382600 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 153/326] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Aug 2 08:48:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:42.392978 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e5fdc-d00f-448d-9aa2-07798d8a56f2 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:42.429033 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919d525-a5d9-46d5-b9a2-040a657c823e None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:42.429525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919d525-a5d9-46d5-b9a2-040a657c823e None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:42.430010 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919d525-a5d9-46d5-b9a2-040a657c823e None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:42.433615 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 154/327] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:42.447589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60cc9a-252f-4bd6-a340-c1e8cd524741 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:42.449040 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60cc9a-252f-4bd6-a340-c1e8cd524741 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:42.450551 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60cc9a-252f-4bd6-a340-c1e8cd524741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:42.482693 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-ec60cc9a-252f-4bd6-a340-c1e8cd524741 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:42.483934 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-ec60cc9a-252f-4bd6-a340-c1e8cd524741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:42.547152 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:42.584197 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 155/328] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:42.605838 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e5fdc-d00f-448d-9aa2-07798d8a56f2 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:42.627485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60cc9a-252f-4bd6-a340-c1e8cd524741 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:42.655064 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:42.673528 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f81053-9f67-4dfe-ab93-451e0855bed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:42.674560 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f81053-9f67-4dfe-ab93-451e0855bed3 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:42.675065 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f81053-9f67-4dfe-ab93-451e0855bed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:42.675593 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f81053-9f67-4dfe-ab93-451e0855bed3 None admin] PATH_INFO: `/v3/users/0a988b45f15b44dab4cf50803484f773` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:42.677207 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f81053-9f67-4dfe-ab93-451e0855bed3 None admin] RBAC: Authorizing `identity:get_user(user_id=0a988b45f15b44dab4cf50803484f773)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:42.678986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f81053-9f67-4dfe-ab93-451e0855bed3 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:42.681203 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 174/329] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:48:42 2022] GET /identity/v3/users/0a988b45f15b44dab4cf50803484f773 => generated 293 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:42.687349 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f81053-9f67-4dfe-ab93-451e0855bed3 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:42.831167 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f81053-9f67-4dfe-ab93-451e0855bed3 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:42.849995 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60cc9a-252f-4bd6-a340-c1e8cd524741 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:42.910532 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df4a10-8afc-4636-a089-7f0b528b3526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:42.911159 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df4a10-8afc-4636-a089-7f0b528b3526 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:42.911447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df4a10-8afc-4636-a089-7f0b528b3526 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:42.911721 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df4a10-8afc-4636-a089-7f0b528b3526 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:42.925677 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75f89a-73ad-49a9-a48f-9ae37baa2baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:42.926430 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75f89a-73ad-49a9-a48f-9ae37baa2baf None admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:42.926637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75f89a-73ad-49a9-a48f-9ae37baa2baf None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:42.926955 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75f89a-73ad-49a9-a48f-9ae37baa2baf None admin] PATH_INFO: `/v3/system/users/0a988b45f15b44dab4cf50803484f773/roles/6639a392f46d4388a120947fb8da02cc` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:42.928621 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75f89a-73ad-49a9-a48f-9ae37baa2baf None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0a988b45f15b44dab4cf50803484f773, role_id=6639a392f46d4388a120947fb8da02cc)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:42.930039 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75f89a-73ad-49a9-a48f-9ae37baa2baf None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:42.936468 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df4a10-8afc-4636-a089-7f0b528b3526 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:42.945500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-e9df4a10-8afc-4636-a089-7f0b528b3526 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:48:42.945500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:42.945500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:42.945500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:42.945500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:42.945500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:42.945500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:42.945500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:42.945500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:42.945500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:42.945500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:42.945500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:42.945500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:42.945500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:42.945500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:42.945500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:42.947158 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:42.947158 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:42.947158 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:42.947158 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:42.947158 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:42.947158 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:42.947158 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:42.947158 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:42.947158 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:42.947158 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:42.947158 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:42.947158 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:42.947158 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:42.947158 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:42.947158 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:42.947158 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:42.949632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:42.949632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:42.949632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:42.949632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:42.949632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:42.949632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:42.949632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:42.949632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:42.949632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:42.949632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:42.949632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:48:42.949632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:48:42.953855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 156/330] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:48:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:42.964377 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df4a10-8afc-4636-a089-7f0b528b3526 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:43.009738 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 175/331] 10.222.0.20 () {58 vars in 1334 bytes} [Tue Aug 2 08:48:42 2022] PUT /identity/v3/system/users/0a988b45f15b44dab4cf50803484f773/roles/6639a392f46d4388a120947fb8da02cc => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:48:43.050294 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:43.186954 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df4a10-8afc-4636-a089-7f0b528b3526 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:43.244910 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd2a9d-b88d-4430-8a6b-648504f70f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:43.245844 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd2a9d-b88d-4430-8a6b-648504f70f30 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:43.246363 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd2a9d-b88d-4430-8a6b-648504f70f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:43.246793 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd2a9d-b88d-4430-8a6b-648504f70f30 None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:43.247717 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd2a9d-b88d-4430-8a6b-648504f70f30 None admin] RBAC: Adding query filter params (name=member) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:43.248200 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd2a9d-b88d-4430-8a6b-648504f70f30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:43.250024 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd2a9d-b88d-4430-8a6b-648504f70f30 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:43.262740 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 157/332] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Aug 2 08:48:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:43.269081 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75f89a-73ad-49a9-a48f-9ae37baa2baf None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:43.412418 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:43.471886 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75f89a-73ad-49a9-a48f-9ae37baa2baf None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:43.524035 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d775aa7-ddf6-4386-8b04-ebc35d504cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:43.524824 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d775aa7-ddf6-4386-8b04-ebc35d504cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:43.525130 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d775aa7-ddf6-4386-8b04-ebc35d504cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:43.525480 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d775aa7-ddf6-4386-8b04-ebc35d504cb2 None admin] PATH_INFO: `/v3/users/1359e0d6c9214071b170a432ba068b79` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:43.527839 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d775aa7-ddf6-4386-8b04-ebc35d504cb2 None admin] RBAC: Authorizing `identity:get_user(user_id=1359e0d6c9214071b170a432ba068b79)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:43.529355 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d775aa7-ddf6-4386-8b04-ebc35d504cb2 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:43.531605 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 176/333] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:48:43 2022] GET /identity/v3/users/1359e0d6c9214071b170a432ba068b79 => generated 293 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:43.537789 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd2a9d-b88d-4430-8a6b-648504f70f30 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:43.679830 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:43.684900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd2a9d-b88d-4430-8a6b-648504f70f30 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:43.732072 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f268feb8-b4da-4c80-8428-65d2733ffdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:43.732644 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268feb8-b4da-4c80-8428-65d2733ffdd0 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:43.732928 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268feb8-b4da-4c80-8428-65d2733ffdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:43.733204 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268feb8-b4da-4c80-8428-65d2733ffdd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:43.734020 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f268feb8-b4da-4c80-8428-65d2733ffdd0 None admin] RBAC: Adding query filter params (role.id=5fd593d076084fbaa9208dd505b58150, user.id=1359e0d6c9214071b170a432ba068b79, scope.system=all) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:43.734331 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f268feb8-b4da-4c80-8428-65d2733ffdd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:43.735862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f268feb8-b4da-4c80-8428-65d2733ffdd0 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:43.753885 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 158/334] 10.222.0.20 () {56 vars in 1308 bytes} [Tue Aug 2 08:48:43 2022] GET /identity/v3/role_assignments?user.id=1359e0d6c9214071b170a432ba068b79&scope.system=all&role.id=5fd593d076084fbaa9208dd505b58150 => generated 510 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:48:45.363523 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c99c1-2538-412a-9f4a-e80c8498e81d None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:45.364040 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c99c1-2538-412a-9f4a-e80c8498e81d None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:45.364293 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c99c1-2538-412a-9f4a-e80c8498e81d None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:45.365893 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 177/335] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:45.374136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6f393-68c1-4dc0-9948-888f55d6347a None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:45.374651 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6f393-68c1-4dc0-9948-888f55d6347a None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:45.374966 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6f393-68c1-4dc0-9948-888f55d6347a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:45.406567 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-9ef6f393-68c1-4dc0-9948-888f55d6347a None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:45.407987 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-9ef6f393-68c1-4dc0-9948-888f55d6347a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:45.505572 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 159/336] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:48:45.543456 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c99c1-2538-412a-9f4a-e80c8498e81d None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:45.701509 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c99c1-2538-412a-9f4a-e80c8498e81d None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:45.739857 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:45.752102 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a125668-d453-4e8d-8554-a569ed6e0ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:45.752809 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a125668-d453-4e8d-8554-a569ed6e0ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:45.753091 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a125668-d453-4e8d-8554-a569ed6e0ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:45.753363 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a125668-d453-4e8d-8554-a569ed6e0ce0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:45.773250 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a125668-d453-4e8d-8554-a569ed6e0ce0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:45.779802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-4a125668-d453-4e8d-8554-a569ed6e0ce0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:48:45.779802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:45.779802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:45.779802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:45.779802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:45.779802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:45.779802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:45.779802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:45.779802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:45.779802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:45.779802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:45.779802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:45.779802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:45.779802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:45.779802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:45.779802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:45.780824 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:45.780824 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:45.780824 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:45.780824 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:45.780824 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:45.780824 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:45.780824 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:45.780824 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:45.780824 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:45.780824 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:45.780824 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:45.780824 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:45.780824 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:45.780824 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:45.780824 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:45.780824 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:45.781946 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:45.781946 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:45.781946 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:45.781946 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:45.781946 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:45.781946 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:45.781946 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:45.781946 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:45.781946 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:45.781946 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:45.781946 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:48:45.781946 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:48:45.781946 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 178/337] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Aug 2 08:48:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:45.791511 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6f393-68c1-4dc0-9948-888f55d6347a None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:45.825556 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e8d6d-85b4-4f83-99f4-e9b25f416cc1 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:45.825769 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e8d6d-85b4-4f83-99f4-e9b25f416cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:45.826018 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e8d6d-85b4-4f83-99f4-e9b25f416cc1 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:45.827561 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 179/338] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:45.839880 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d0122-7f7f-4438-a09c-37029332de01 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:45.840856 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d0122-7f7f-4438-a09c-37029332de01 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:45.841625 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d0122-7f7f-4438-a09c-37029332de01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:45.898343 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-488d0122-7f7f-4438-a09c-37029332de01 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:45.901042 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-488d0122-7f7f-4438-a09c-37029332de01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:46.013514 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:46.037814 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6f393-68c1-4dc0-9948-888f55d6347a None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:46.070153 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 180/339] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:46.111428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b3787-e86e-4c1c-b127-79013ee4b708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:46.111986 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b3787-e86e-4c1c-b127-79013ee4b708 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:46.112292 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b3787-e86e-4c1c-b127-79013ee4b708 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:46.112571 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b3787-e86e-4c1c-b127-79013ee4b708 None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:46.113324 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b3787-e86e-4c1c-b127-79013ee4b708 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:46.113627 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b3787-e86e-4c1c-b127-79013ee4b708 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:46.114742 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d0122-7f7f-4438-a09c-37029332de01 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:46.115050 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b3787-e86e-4c1c-b127-79013ee4b708 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:46.132888 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 160/340] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:48:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:46.143942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b3787-e86e-4c1c-b127-79013ee4b708 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:46.389501 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d0122-7f7f-4438-a09c-37029332de01 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:46.418370 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b3787-e86e-4c1c-b127-79013ee4b708 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:46.438164 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:46.493944 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4299a-053c-448d-ab40-d98cfd9bab5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:46.495490 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4299a-053c-448d-ab40-d98cfd9bab5e None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:46.495982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4299a-053c-448d-ab40-d98cfd9bab5e None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:46.496511 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4299a-053c-448d-ab40-d98cfd9bab5e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:46.518522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4299a-053c-448d-ab40-d98cfd9bab5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:46.526583 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-2bd4299a-053c-448d-ab40-d98cfd9bab5e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:48:46.526583 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:46.526583 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:46.526583 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:46.526583 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:46.526583 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:46.526583 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:46.526583 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:46.526583 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:46.526583 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:46.526583 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:46.526583 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:46.526583 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:46.526583 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:46.526583 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:46.526583 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:46.527935 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:46.527935 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:46.527935 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:46.527935 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:46.527935 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:46.527935 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:46.527935 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:46.527935 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:46.527935 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:46.527935 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:46.527935 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:46.527935 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:46.527935 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:46.527935 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:46.527935 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:46.527935 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:46.528758 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:46.528758 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:46.528758 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:46.528758 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:46.528758 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:46.528758 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:46.528758 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:46.528758 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:46.528758 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:46.528758 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:46.528758 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:48:46.528758 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:48:46.535947 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa737573-93dd-463a-81c1-35d1bc852eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:46.537040 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa737573-93dd-463a-81c1-35d1bc852eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:46.537531 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa737573-93dd-463a-81c1-35d1bc852eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:46.538019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa737573-93dd-463a-81c1-35d1bc852eb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:46.540391 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 181/341] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:48:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:48:46.547943 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb48e2-1be8-48eb-b1f6-83e0782c4524 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:46.548483 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb48e2-1be8-48eb-b1f6-83e0782c4524 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:46.548964 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb48e2-1be8-48eb-b1f6-83e0782c4524 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:46.551470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 182/342] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:46.554770 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb48e2-1be8-48eb-b1f6-83e0782c4524 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:46.621444 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:46.763574 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb48e2-1be8-48eb-b1f6-83e0782c4524 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:46.767315 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa737573-93dd-463a-81c1-35d1bc852eb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:46.769900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa737573-93dd-463a-81c1-35d1bc852eb3 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:46.807813 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea37c44-1af5-416f-9bd7-984da0499f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:46.809337 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea37c44-1af5-416f-9bd7-984da0499f12 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:46.809811 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea37c44-1af5-416f-9bd7-984da0499f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:46.810265 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea37c44-1af5-416f-9bd7-984da0499f12 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:46.811195 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea37c44-1af5-416f-9bd7-984da0499f12 None admin] RBAC: Adding query filter params (name=member) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:46.811674 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea37c44-1af5-416f-9bd7-984da0499f12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:46.813295 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea37c44-1af5-416f-9bd7-984da0499f12 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:46.828425 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 183/343] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Aug 2 08:48:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:46.830115 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818de02-e4d2-4904-96ac-5b9e274b433b None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:46.830620 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818de02-e4d2-4904-96ac-5b9e274b433b None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:46.831118 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818de02-e4d2-4904-96ac-5b9e274b433b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:46.851260 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-0818de02-e4d2-4904-96ac-5b9e274b433b None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:46.852593 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-0818de02-e4d2-4904-96ac-5b9e274b433b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:46.890557 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:46.947387 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 184/344] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:46.950394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13c8ff-5710-4605-b6e6-cf6647b8df07 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:46.950717 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13c8ff-5710-4605-b6e6-cf6647b8df07 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:46.950951 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13c8ff-5710-4605-b6e6-cf6647b8df07 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:46.952997 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 185/345] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:46.954416 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13c8ff-5710-4605-b6e6-cf6647b8df07 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:47.009675 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 161/346] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:48:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 866 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 08:48:47.017230 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24d9ad-d7e8-420e-8f5a-33df3e4c02a6 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:47.017230 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24d9ad-d7e8-420e-8f5a-33df3e4c02a6 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:47.017721 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24d9ad-d7e8-420e-8f5a-33df3e4c02a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:47.063889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-9b24d9ad-d7e8-420e-8f5a-33df3e4c02a6 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:47.067141 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-9b24d9ad-d7e8-420e-8f5a-33df3e4c02a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:47.148346 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:47.148539 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13c8ff-5710-4605-b6e6-cf6647b8df07 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:47.181563 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 162/347] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:47.183386 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24d9ad-d7e8-420e-8f5a-33df3e4c02a6 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:47.190785 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318e3df-ac7e-4e06-b898-0f2308997dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:47.191422 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318e3df-ac7e-4e06-b898-0f2308997dab None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:47.191702 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318e3df-ac7e-4e06-b898-0f2308997dab None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:47.191999 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318e3df-ac7e-4e06-b898-0f2308997dab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:47.236085 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:47.298897 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318e3df-ac7e-4e06-b898-0f2308997dab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:47.300668 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318e3df-ac7e-4e06-b898-0f2308997dab None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:47.380634 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24d9ad-d7e8-420e-8f5a-33df3e4c02a6 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:47.456942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd1491-9378-4c5b-8cfe-aa13a87c2c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:47.458259 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd1491-9378-4c5b-8cfe-aa13a87c2c71 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:47.458571 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd1491-9378-4c5b-8cfe-aa13a87c2c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:47.458843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd1491-9378-4c5b-8cfe-aa13a87c2c71 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:47.474175 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd1491-9378-4c5b-8cfe-aa13a87c2c71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:47.481917 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-fddd1491-9378-4c5b-8cfe-aa13a87c2c71 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:48:47.481917 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:47.481917 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:47.481917 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:47.481917 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:47.481917 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:47.481917 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:47.481917 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:47.481917 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:47.481917 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:47.481917 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:47.481917 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:47.481917 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:47.481917 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:47.481917 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:47.481917 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:47.483422 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:47.483422 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:47.483422 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:47.483422 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:47.483422 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:47.483422 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:47.483422 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:47.483422 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:47.483422 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:47.483422 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:47.483422 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:47.483422 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:47.483422 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:47.483422 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:47.483422 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:47.483422 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:47.484977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:47.484977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:47.484977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:47.484977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:47.484977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:47.484977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:47.484977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:47.484977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:47.484977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:47.484977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:47.484977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:48:47.484977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:48:47.484977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 163/348] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:48:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:47.484977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd1491-9378-4c5b-8cfe-aa13a87c2c71 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:47.496151 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 186/349] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:48:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:48:47.497663 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27aeec-d7c3-482f-9eb5-73928a888206 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:47.498048 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27aeec-d7c3-482f-9eb5-73928a888206 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:47.498324 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27aeec-d7c3-482f-9eb5-73928a888206 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:47.499660 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 187/350] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:47.500512 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27aeec-d7c3-482f-9eb5-73928a888206 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:47.560839 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:47.606644 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:47.665717 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27aeec-d7c3-482f-9eb5-73928a888206 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:47.667489 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd1491-9378-4c5b-8cfe-aa13a87c2c71 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:47.707449 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108b32a-f0dc-4f20-b266-37f8dfd7aaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:47.708248 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108b32a-f0dc-4f20-b266-37f8dfd7aaea None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:47.708482 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108b32a-f0dc-4f20-b266-37f8dfd7aaea None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:47.708758 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108b32a-f0dc-4f20-b266-37f8dfd7aaea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:47.719906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56149fec-1335-4de4-9b64-d1ebac1ae3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:47.719906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56149fec-1335-4de4-9b64-d1ebac1ae3a6 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:47.719906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56149fec-1335-4de4-9b64-d1ebac1ae3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:47.719906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56149fec-1335-4de4-9b64-d1ebac1ae3a6 None admin] PATH_INFO: `/v3/projects/c8576b87aecf403699be87362271685d` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:47.722187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56149fec-1335-4de4-9b64-d1ebac1ae3a6 None admin] RBAC: Authorizing `identity:get_project(project_id=c8576b87aecf403699be87362271685d)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:47.725402 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56149fec-1335-4de4-9b64-d1ebac1ae3a6 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:47.735271 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 164/351] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:47 2022] GET /identity/v3/projects/c8576b87aecf403699be87362271685d => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:47.737691 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108b32a-f0dc-4f20-b266-37f8dfd7aaea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:47.738543 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56149fec-1335-4de4-9b64-d1ebac1ae3a6 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:47.745803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-6108b32a-f0dc-4f20-b266-37f8dfd7aaea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:48:47.745803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:47.745803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:47.745803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:47.745803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:47.745803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:47.745803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:47.745803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:47.745803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:47.745803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:47.745803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:47.745803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:47.745803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:47.745803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:47.745803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:47.745803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:47.747291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:47.747291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:47.747291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:47.747291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:47.747291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:47.747291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:47.747291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:47.747291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:47.747291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:47.747291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:47.747291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:47.747291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:47.747291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:47.747291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:47.747291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:47.747291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:47.748209 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:47.748209 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:47.748209 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:47.748209 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:47.748209 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:47.748209 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:47.748209 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:47.748209 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:47.748209 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:47.748209 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:47.748209 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:48:47.748209 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:48:47.748209 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 188/352] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:48:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:47.750074 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108b32a-f0dc-4f20-b266-37f8dfd7aaea None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:47.891853 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108b32a-f0dc-4f20-b266-37f8dfd7aaea None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:47.927795 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56149fec-1335-4de4-9b64-d1ebac1ae3a6 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:47.938025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:47.939392 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:47.956196 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ffb45-913a-4ae8-9dc1-94527d0002ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:47.957341 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ffb45-913a-4ae8-9dc1-94527d0002ac None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:47.961374 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ffb45-913a-4ae8-9dc1-94527d0002ac None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:47.961374 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ffb45-913a-4ae8-9dc1-94527d0002ac None admin] PATH_INFO: `/v3/projects/c8576b87aecf403699be87362271685d` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:47.961374 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ffb45-913a-4ae8-9dc1-94527d0002ac None admin] RBAC: Authorizing `identity:get_project(project_id=c8576b87aecf403699be87362271685d)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:47.964765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ffb45-913a-4ae8-9dc1-94527d0002ac None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:47.967779 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 189/353] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:47 2022] GET /identity/v3/projects/c8576b87aecf403699be87362271685d => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:47.968357 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477b9f0-da53-4df1-9856-5c9402aac4d5 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:47.968643 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477b9f0-da53-4df1-9856-5c9402aac4d5 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:47.968954 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477b9f0-da53-4df1-9856-5c9402aac4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:47.973438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a58ce-47cd-4ad3-be62-63b3b1bc3be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:47.974466 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a58ce-47cd-4ad3-be62-63b3b1bc3be2 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:47.974466 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a58ce-47cd-4ad3-be62-63b3b1bc3be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:47.974722 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a58ce-47cd-4ad3-be62-63b3b1bc3be2 None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:47.975491 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a58ce-47cd-4ad3-be62-63b3b1bc3be2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:47.975797 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a58ce-47cd-4ad3-be62-63b3b1bc3be2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:47.977236 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a58ce-47cd-4ad3-be62-63b3b1bc3be2 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:47.989743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 165/354] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Aug 2 08:48:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:47.992237 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a58ce-47cd-4ad3-be62-63b3b1bc3be2 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:47.998313 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-b477b9f0-da53-4df1-9856-5c9402aac4d5 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:47.998313 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-b477b9f0-da53-4df1-9856-5c9402aac4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:48.087524 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 190/355] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:48.088543 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477b9f0-da53-4df1-9856-5c9402aac4d5 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:48.124455 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a58ce-47cd-4ad3-be62-63b3b1bc3be2 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:48.173378 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a0157-5fdd-488c-9257-6337271692a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:48.174125 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a0157-5fdd-488c-9257-6337271692a3 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:48.174436 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a0157-5fdd-488c-9257-6337271692a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:48.174688 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a0157-5fdd-488c-9257-6337271692a3 None admin] PATH_INFO: `/v3/groups/0b31eb75b5d9470997000dd5ce9fa64d` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:48.185595 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a0157-5fdd-488c-9257-6337271692a3 None admin] RBAC: Authorizing `identity:get_group(group_id=0b31eb75b5d9470997000dd5ce9fa64d)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:48.188586 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a0157-5fdd-488c-9257-6337271692a3 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:48.191871 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 166/356] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Aug 2 08:48:47 2022] GET /identity/v3/groups/0b31eb75b5d9470997000dd5ce9fa64d => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:48.194173 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dab61d-c33d-41a4-99ab-3dc967bcf740 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:48.195146 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dab61d-c33d-41a4-99ab-3dc967bcf740 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:48.195146 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dab61d-c33d-41a4-99ab-3dc967bcf740 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:48.198690 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 167/357] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:48.199765 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dab61d-c33d-41a4-99ab-3dc967bcf740 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:48.259030 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:48.263619 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477b9f0-da53-4df1-9856-5c9402aac4d5 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:48.313792 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:48.334288 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff3fa2-f8f9-4632-b31f-23b28743defa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:48.335500 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff3fa2-f8f9-4632-b31f-23b28743defa None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:48.336035 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff3fa2-f8f9-4632-b31f-23b28743defa None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:48.336454 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff3fa2-f8f9-4632-b31f-23b28743defa None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:48.337658 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff3fa2-f8f9-4632-b31f-23b28743defa None admin] RBAC: Adding query filter params (name=reader) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:48.338356 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff3fa2-f8f9-4632-b31f-23b28743defa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:48.340958 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff3fa2-f8f9-4632-b31f-23b28743defa None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:48.358013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 191/358] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Aug 2 08:48:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:48.359416 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff3fa2-f8f9-4632-b31f-23b28743defa None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:48.398455 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dab61d-c33d-41a4-99ab-3dc967bcf740 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:48.476085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b774d7b-5381-4c9f-9f75-36c9bd9e025e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:48.477086 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b774d7b-5381-4c9f-9f75-36c9bd9e025e None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:48.477411 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b774d7b-5381-4c9f-9f75-36c9bd9e025e None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:48.477886 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b774d7b-5381-4c9f-9f75-36c9bd9e025e None admin] PATH_INFO: `/v3/groups/0b31eb75b5d9470997000dd5ce9fa64d` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:48.480019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b774d7b-5381-4c9f-9f75-36c9bd9e025e None admin] RBAC: Authorizing `identity:get_group(group_id=0b31eb75b5d9470997000dd5ce9fa64d)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:48.482894 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b774d7b-5381-4c9f-9f75-36c9bd9e025e None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:48.486428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 168/359] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Aug 2 08:48:48 2022] GET /identity/v3/groups/0b31eb75b5d9470997000dd5ce9fa64d => generated 226 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:48.487515 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b774d7b-5381-4c9f-9f75-36c9bd9e025e None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:48.551531 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff3fa2-f8f9-4632-b31f-23b28743defa None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:48.608297 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfc15f-734b-4798-84ad-1d2a09f17f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:48.608950 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfc15f-734b-4798-84ad-1d2a09f17f04 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:48.609234 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfc15f-734b-4798-84ad-1d2a09f17f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:48.609513 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfc15f-734b-4798-84ad-1d2a09f17f04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:48.641680 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:48.646070 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b774d7b-5381-4c9f-9f75-36c9bd9e025e None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:48.693842 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:48.714428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21372f9a-b615-4338-9371-b3f7cc88f0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:48.718339 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21372f9a-b615-4338-9371-b3f7cc88f0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:48.718339 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21372f9a-b615-4338-9371-b3f7cc88f0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:48.718339 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21372f9a-b615-4338-9371-b3f7cc88f0d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:48.721000 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debfc15f-734b-4798-84ad-1d2a09f17f04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:48.723215 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debfc15f-734b-4798-84ad-1d2a09f17f04 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:48.739154 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21372f9a-b615-4338-9371-b3f7cc88f0d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:48.744522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-21372f9a-b615-4338-9371-b3f7cc88f0d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:48:48.744522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:48.744522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:48.744522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:48.744522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:48.744522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:48.744522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:48.744522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:48.744522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:48.744522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:48.744522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:48.744522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:48.744522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:48.744522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:48.744522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:48.744522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:48.746203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:48.746203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:48.746203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:48.746203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:48.746203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:48.746203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:48.746203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:48.746203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:48.746203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:48.746203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:48.746203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:48.746203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:48.746203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:48.746203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:48.746203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:48.746203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:48.750040 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:48.750040 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:48.750040 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:48.750040 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:48.750040 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:48.750040 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:48.750040 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:48.750040 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:48.750040 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:48.750040 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:48.750040 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:48:48.750040 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:48:48.752134 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 169/360] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Aug 2 08:48:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:48.753331 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21372f9a-b615-4338-9371-b3f7cc88f0d4 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:48.926290 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 192/361] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:48:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:48:48.928227 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b3696-4433-4137-85c5-69585969e1f8 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:48.929284 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b3696-4433-4137-85c5-69585969e1f8 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:48.929284 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b3696-4433-4137-85c5-69585969e1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:48.948147 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21372f9a-b615-4338-9371-b3f7cc88f0d4 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:48.955828 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-5f7b3696-4433-4137-85c5-69585969e1f8 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:48.957121 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-5f7b3696-4433-4137-85c5-69585969e1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:49.000616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f6042-50d1-4415-9f0f-c8bd0b353480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:49.001308 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f6042-50d1-4415-9f0f-c8bd0b353480 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:49.002060 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f6042-50d1-4415-9f0f-c8bd0b353480 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:49.002060 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f6042-50d1-4415-9f0f-c8bd0b353480 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:49.002769 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f6042-50d1-4415-9f0f-c8bd0b353480 None admin] RBAC: Adding query filter params (group.id=0b31eb75b5d9470997000dd5ce9fa64d, role.id=923eb688fccc4e79b6c3df28d754b6c4, scope.project.id=c8576b87aecf403699be87362271685d) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:49.003086 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f6042-50d1-4415-9f0f-c8bd0b353480 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:49.004941 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f6042-50d1-4415-9f0f-c8bd0b353480 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:49.012452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 170/362] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Aug 2 08:48:48 2022] GET /identity/v3/role_assignments?group.id=0b31eb75b5d9470997000dd5ce9fa64d&scope.project.id=c8576b87aecf403699be87362271685d&role.id=923eb688fccc4e79b6c3df28d754b6c4 => generated 260 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:49.014115 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f6042-50d1-4415-9f0f-c8bd0b353480 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:49.049729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:49.095656 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 193/363] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:49.097077 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b3696-4433-4137-85c5-69585969e1f8 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:49.142507 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:49.188235 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f6042-50d1-4415-9f0f-c8bd0b353480 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:49.252500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f593530-fa26-4615-9039-1d33e3fd3240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:49.253672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f593530-fa26-4615-9039-1d33e3fd3240 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:49.254017 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f593530-fa26-4615-9039-1d33e3fd3240 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:49.254735 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f593530-fa26-4615-9039-1d33e3fd3240 None admin] PATH_INFO: `/v3/users/0a988b45f15b44dab4cf50803484f773` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:49.257002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f593530-fa26-4615-9039-1d33e3fd3240 None admin] RBAC: Authorizing `identity:get_user(user_id=0a988b45f15b44dab4cf50803484f773)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:49.260353 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f593530-fa26-4615-9039-1d33e3fd3240 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:49.268272 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 171/364] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:48:49 2022] GET /identity/v3/users/0a988b45f15b44dab4cf50803484f773 => generated 293 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:49.268272 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f593530-fa26-4615-9039-1d33e3fd3240 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:49.309449 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b3696-4433-4137-85c5-69585969e1f8 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:49.378952 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90a4d3-a9f3-4909-9b93-190c37880c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:49.380416 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90a4d3-a9f3-4909-9b93-190c37880c93 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:49.380921 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90a4d3-a9f3-4909-9b93-190c37880c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:49.381428 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90a4d3-a9f3-4909-9b93-190c37880c93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:49.382689 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90a4d3-a9f3-4909-9b93-190c37880c93 None admin] RBAC: Adding query filter params (group.id=0b31eb75b5d9470997000dd5ce9fa64d, role.id=5fd593d076084fbaa9208dd505b58150, scope.project.id=c8576b87aecf403699be87362271685d) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:49.383260 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90a4d3-a9f3-4909-9b93-190c37880c93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:49.386697 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90a4d3-a9f3-4909-9b93-190c37880c93 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:49.404210 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 194/365] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Aug 2 08:48:49 2022] GET /identity/v3/role_assignments?group.id=0b31eb75b5d9470997000dd5ce9fa64d&scope.project.id=c8576b87aecf403699be87362271685d&role.id=5fd593d076084fbaa9208dd505b58150 => generated 260 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:49.404210 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90a4d3-a9f3-4909-9b93-190c37880c93 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:49.430928 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:49.451000 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f593530-fa26-4615-9039-1d33e3fd3240 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:49.529065 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cffc1c3-7eed-48a7-a203-3eb03b6d44e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:49.532218 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffc1c3-7eed-48a7-a203-3eb03b6d44e2 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:49.532976 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffc1c3-7eed-48a7-a203-3eb03b6d44e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:49.533664 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffc1c3-7eed-48a7-a203-3eb03b6d44e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:49.535525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cffc1c3-7eed-48a7-a203-3eb03b6d44e2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:49.536939 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cffc1c3-7eed-48a7-a203-3eb03b6d44e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:49.539968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cffc1c3-7eed-48a7-a203-3eb03b6d44e2 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:49.561813 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 172/366] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:48:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:49.563302 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cffc1c3-7eed-48a7-a203-3eb03b6d44e2 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:49.596795 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:49.622612 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90a4d3-a9f3-4909-9b93-190c37880c93 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:49.695490 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7d3e1-ba74-4e1b-9389-17bd2032cccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:49.696821 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7d3e1-ba74-4e1b-9389-17bd2032cccf None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:49.697751 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7d3e1-ba74-4e1b-9389-17bd2032cccf None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:49.698025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7d3e1-ba74-4e1b-9389-17bd2032cccf None admin] PATH_INFO: `/v3/projects/2937cdbeb750480e8d69fe400d2cca9e` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:49.699511 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7d3e1-ba74-4e1b-9389-17bd2032cccf None admin] RBAC: Authorizing `identity:get_project(project_id=2937cdbeb750480e8d69fe400d2cca9e)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:49.701452 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7d3e1-ba74-4e1b-9389-17bd2032cccf None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:49.704864 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 195/367] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:49 2022] GET /identity/v3/projects/2937cdbeb750480e8d69fe400d2cca9e => generated 302 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:49.706728 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7d3e1-ba74-4e1b-9389-17bd2032cccf None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:49.764769 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cffc1c3-7eed-48a7-a203-3eb03b6d44e2 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:49.831508 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15c8b0-ddfe-435e-a3fe-e3486111b8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:49.833073 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15c8b0-ddfe-435e-a3fe-e3486111b8ab None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:49.833850 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15c8b0-ddfe-435e-a3fe-e3486111b8ab None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:49.834616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15c8b0-ddfe-435e-a3fe-e3486111b8ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:49.854912 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b15c8b0-ddfe-435e-a3fe-e3486111b8ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:49.864930 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-6b15c8b0-ddfe-435e-a3fe-e3486111b8ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:48:49.864930 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:49.864930 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:49.864930 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:49.864930 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:49.864930 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:49.864930 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:49.864930 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:49.864930 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:49.864930 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:49.864930 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:49.864930 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:49.864930 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:49.864930 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:49.864930 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:49.864930 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:49.866509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:49.866509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:49.866509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:49.866509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:49.866509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:49.866509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:49.866509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:49.866509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:49.866509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:49.866509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:49.866509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:49.866509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:49.866509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:49.866509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:49.866509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:49.866509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:49.867910 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:49.867910 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:49.867910 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:49.867910 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:49.867910 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:49.867910 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:49.867910 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:49.867910 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:49.867910 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:49.867910 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:49.867910 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:48:49.867910 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:48:49.871862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 173/368] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:48:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:49.873481 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15c8b0-ddfe-435e-a3fe-e3486111b8ab None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:49.902657 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:49.923844 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7d3e1-ba74-4e1b-9389-17bd2032cccf None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:49.996867 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a3126-16a6-4b35-bf1f-fa4ff79a0971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:49.998255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a3126-16a6-4b35-bf1f-fa4ff79a0971 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:49.998941 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a3126-16a6-4b35-bf1f-fa4ff79a0971 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:49.999618 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a3126-16a6-4b35-bf1f-fa4ff79a0971 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:50.001606 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a3126-16a6-4b35-bf1f-fa4ff79a0971 None admin] RBAC: Adding query filter params (role.id=6639a392f46d4388a120947fb8da02cc, user.id=0a988b45f15b44dab4cf50803484f773, scope.system=all) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:50.002450 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a3126-16a6-4b35-bf1f-fa4ff79a0971 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:50.005819 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a3126-16a6-4b35-bf1f-fa4ff79a0971 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:50.030732 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 196/369] 10.222.0.20 () {56 vars in 1308 bytes} [Tue Aug 2 08:48:49 2022] GET /identity/v3/role_assignments?user.id=0a988b45f15b44dab4cf50803484f773&scope.system=all&role.id=6639a392f46d4388a120947fb8da02cc => generated 510 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:50.032795 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a3126-16a6-4b35-bf1f-fa4ff79a0971 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:50.064780 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:50.106535 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15c8b0-ddfe-435e-a3fe-e3486111b8ab None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:50.206580 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c342907-cfae-4649-aa7e-dd364dbce889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:50.208075 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c342907-cfae-4649-aa7e-dd364dbce889 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:50.209769 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c342907-cfae-4649-aa7e-dd364dbce889 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:50.210653 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c342907-cfae-4649-aa7e-dd364dbce889 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:50.363799 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a3126-16a6-4b35-bf1f-fa4ff79a0971 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:50.418556 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c342907-cfae-4649-aa7e-dd364dbce889 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:50.421524 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c342907-cfae-4649-aa7e-dd364dbce889 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:50.434153 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4462c9e6-2acf-4772-be15-a5d1af8e850d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:50.435234 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462c9e6-2acf-4772-be15-a5d1af8e850d None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:50.435721 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462c9e6-2acf-4772-be15-a5d1af8e850d None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:50.436223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462c9e6-2acf-4772-be15-a5d1af8e850d None admin] PATH_INFO: `/v3/groups/0b31eb75b5d9470997000dd5ce9fa64d` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:50.437879 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4462c9e6-2acf-4772-be15-a5d1af8e850d None admin] RBAC: Authorizing `identity:get_group(group_id=0b31eb75b5d9470997000dd5ce9fa64d)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:50.439858 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4462c9e6-2acf-4772-be15-a5d1af8e850d None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:50.442899 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 197/370] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Aug 2 08:48:50 2022] GET /identity/v3/groups/0b31eb75b5d9470997000dd5ce9fa64d => generated 226 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:50.444117 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4462c9e6-2acf-4772-be15-a5d1af8e850d None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:50.455326 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:50.605348 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:50.639194 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 174/371] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:48:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 767 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:48:50.644942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c342907-cfae-4649-aa7e-dd364dbce889 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:50.673472 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4462c9e6-2acf-4772-be15-a5d1af8e850d None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:50.726794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c01e3-c1f0-4260-bf03-57d720170f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:50.727543 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c01e3-c1f0-4260-bf03-57d720170f87 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:50.727927 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c01e3-c1f0-4260-bf03-57d720170f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:50.728256 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c01e3-c1f0-4260-bf03-57d720170f87 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:50.729171 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c01e3-c1f0-4260-bf03-57d720170f87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:50.729485 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c01e3-c1f0-4260-bf03-57d720170f87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:50.731312 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c01e3-c1f0-4260-bf03-57d720170f87 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:50.745156 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 198/372] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:48:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:50.746072 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c01e3-c1f0-4260-bf03-57d720170f87 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:50.833118 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c342907-cfae-4649-aa7e-dd364dbce889 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:50.877169 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:50.899136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba5f76-c730-4107-8763-5e487e094f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:50.899644 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba5f76-c730-4107-8763-5e487e094f7e None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:50.900094 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba5f76-c730-4107-8763-5e487e094f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:50.900608 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba5f76-c730-4107-8763-5e487e094f7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:50.901967 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba5f76-c730-4107-8763-5e487e094f7e None admin] RBAC: Adding query filter params (group.id=0b31eb75b5d9470997000dd5ce9fa64d, role.id=5fd593d076084fbaa9208dd505b58150, scope.project.id=2937cdbeb750480e8d69fe400d2cca9e) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:50.902458 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba5f76-c730-4107-8763-5e487e094f7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:50.907062 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba5f76-c730-4107-8763-5e487e094f7e None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:50.918207 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 175/373] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Aug 2 08:48:50 2022] GET /identity/v3/role_assignments?group.id=0b31eb75b5d9470997000dd5ce9fa64d&scope.project.id=2937cdbeb750480e8d69fe400d2cca9e&role.id=5fd593d076084fbaa9208dd505b58150 => generated 260 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:50.919433 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba5f76-c730-4107-8763-5e487e094f7e None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:50.963712 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c01e3-c1f0-4260-bf03-57d720170f87 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:51.035029 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903d3f5-7a76-408d-bfbc-c251f0a3a732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:51.036727 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903d3f5-7a76-408d-bfbc-c251f0a3a732 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:51.037562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903d3f5-7a76-408d-bfbc-c251f0a3a732 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:51.038267 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903d3f5-7a76-408d-bfbc-c251f0a3a732 None admin] PATH_INFO: `/v3/projects/2937cdbeb750480e8d69fe400d2cca9e` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:51.040868 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903d3f5-7a76-408d-bfbc-c251f0a3a732 None admin] RBAC: Authorizing `identity:get_project(project_id=2937cdbeb750480e8d69fe400d2cca9e)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:51.044678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903d3f5-7a76-408d-bfbc-c251f0a3a732 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:51.048468 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 199/374] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:50 2022] GET /identity/v3/projects/2937cdbeb750480e8d69fe400d2cca9e => generated 302 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:51.058633 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903d3f5-7a76-408d-bfbc-c251f0a3a732 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:51.067581 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:51.147891 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba5f76-c730-4107-8763-5e487e094f7e None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:51.233741 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b16cc-b881-4858-a50f-021600db08e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:51.235584 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b16cc-b881-4858-a50f-021600db08e4 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:51.236481 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b16cc-b881-4858-a50f-021600db08e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:51.237249 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b16cc-b881-4858-a50f-021600db08e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:51.347100 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903d3f5-7a76-408d-bfbc-c251f0a3a732 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:51.357658 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:51.418571 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b16cc-b881-4858-a50f-021600db08e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:51.423199 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b16cc-b881-4858-a50f-021600db08e4 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:51.437325 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c7649-08e6-4519-8c04-30ae9755399f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:51.438487 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c7649-08e6-4519-8c04-30ae9755399f None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:51.438987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c7649-08e6-4519-8c04-30ae9755399f None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:51.439450 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c7649-08e6-4519-8c04-30ae9755399f None admin] PATH_INFO: `/v3/groups/0b31eb75b5d9470997000dd5ce9fa64d` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:51.443605 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c7649-08e6-4519-8c04-30ae9755399f None admin] RBAC: Authorizing `identity:get_group(group_id=0b31eb75b5d9470997000dd5ce9fa64d)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:51.447153 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c7649-08e6-4519-8c04-30ae9755399f None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:51.449902 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 200/375] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Aug 2 08:48:51 2022] GET /identity/v3/groups/0b31eb75b5d9470997000dd5ce9fa64d => generated 226 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:48:51.462619 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c7649-08e6-4519-8c04-30ae9755399f None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:51.628456 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:51.680770 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c7649-08e6-4519-8c04-30ae9755399f None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:51.758803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d79b74-3700-4b66-b7af-8c7177c851b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:51.760699 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d79b74-3700-4b66-b7af-8c7177c851b0 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:51.761436 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d79b74-3700-4b66-b7af-8c7177c851b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:51.761938 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d79b74-3700-4b66-b7af-8c7177c851b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:51.763780 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d79b74-3700-4b66-b7af-8c7177c851b0 None admin] RBAC: Adding query filter params (group.id=0b31eb75b5d9470997000dd5ce9fa64d, role.id=923eb688fccc4e79b6c3df28d754b6c4, scope.project.id=2937cdbeb750480e8d69fe400d2cca9e) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:51.764383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d79b74-3700-4b66-b7af-8c7177c851b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:51.767686 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d79b74-3700-4b66-b7af-8c7177c851b0 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:51.784285 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 201/376] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Aug 2 08:48:51 2022] GET /identity/v3/role_assignments?group.id=0b31eb75b5d9470997000dd5ce9fa64d&scope.project.id=2937cdbeb750480e8d69fe400d2cca9e&role.id=923eb688fccc4e79b6c3df28d754b6c4 => generated 260 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:51.786702 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a1fe0-830b-4463-80bb-0222c58ed19e None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:51.787271 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a1fe0-830b-4463-80bb-0222c58ed19e None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:51.787790 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a1fe0-830b-4463-80bb-0222c58ed19e None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:51.794202 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 202/377] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:51 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:51.802966 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd98d78-3cec-4b48-81d2-893cbe1cb32d None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:51.803468 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd98d78-3cec-4b48-81d2-893cbe1cb32d None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:51.803965 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd98d78-3cec-4b48-81d2-893cbe1cb32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:51.811270 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 176/378] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:48:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 893 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:48:51.821925 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b16cc-b881-4858-a50f-021600db08e4 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:51.865058 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-6dd98d78-3cec-4b48-81d2-893cbe1cb32d None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:51.867163 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-6dd98d78-3cec-4b48-81d2-893cbe1cb32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:52.044644 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:52.089469 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b16cc-b881-4858-a50f-021600db08e4 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:52.116451 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 203/379] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:52.149280 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd98d78-3cec-4b48-81d2-893cbe1cb32d None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:52.160683 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a7a3e-fc06-4f5a-911f-8e571a7ef4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:52.161785 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a7a3e-fc06-4f5a-911f-8e571a7ef4fd None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:52.162274 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a7a3e-fc06-4f5a-911f-8e571a7ef4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:52.162759 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a7a3e-fc06-4f5a-911f-8e571a7ef4fd None admin] PATH_INFO: `/v3/projects/4075c06a81874f9ca4b42e16828b98cd` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:52.164907 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a7a3e-fc06-4f5a-911f-8e571a7ef4fd None admin] RBAC: Authorizing `identity:get_project(project_id=4075c06a81874f9ca4b42e16828b98cd)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:52.168210 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a7a3e-fc06-4f5a-911f-8e571a7ef4fd None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:52.176329 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 177/380] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:51 2022] GET /identity/v3/projects/4075c06a81874f9ca4b42e16828b98cd => generated 344 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:48:52.180453 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a7a3e-fc06-4f5a-911f-8e571a7ef4fd None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:52.309394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:52.378536 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd98d78-3cec-4b48-81d2-893cbe1cb32d None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:52.393850 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a7a3e-fc06-4f5a-911f-8e571a7ef4fd None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:52.444351 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fba12a-0af9-4a18-ad1c-5eca186188a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:52.445501 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fba12a-0af9-4a18-ad1c-5eca186188a5 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:52.446003 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fba12a-0af9-4a18-ad1c-5eca186188a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:52.446503 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fba12a-0af9-4a18-ad1c-5eca186188a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:52.464938 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48855d9-b764-4244-9eaf-db475420068a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:52.466039 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48855d9-b764-4244-9eaf-db475420068a None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:52.466538 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48855d9-b764-4244-9eaf-db475420068a None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:52.467021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48855d9-b764-4244-9eaf-db475420068a None admin] PATH_INFO: `/v3/groups/8a06e6a5ce1f4e4187aaf8ff8670cfcc` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:52.467126 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fba12a-0af9-4a18-ad1c-5eca186188a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:52.476952 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48855d9-b764-4244-9eaf-db475420068a None admin] RBAC: Authorizing `identity:get_group(group_id=8a06e6a5ce1f4e4187aaf8ff8670cfcc)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:52.477170 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-21fba12a-0af9-4a18-ad1c-5eca186188a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:48:52.477170 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:52.477170 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:52.477170 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:52.477170 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:52.477170 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:52.477170 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:52.477170 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:52.477170 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:52.477170 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:52.477170 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:52.477170 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:52.477170 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:52.477170 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:52.477170 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:52.477170 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:52.477984 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:52.477984 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:52.477984 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:52.477984 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:52.477984 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:52.477984 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:52.477984 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:52.477984 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:52.477984 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:52.477984 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:52.477984 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:52.477984 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:52.477984 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:52.477984 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:52.477984 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:52.477984 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:52.479443 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:52.479443 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:52.479443 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:52.479443 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:52.479443 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:52.479443 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:52.479443 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:52.479443 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:52.479443 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:52.479443 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:52.479443 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:48:52.479443 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:48:52.480581 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48855d9-b764-4244-9eaf-db475420068a None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:52.485627 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 204/381] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Aug 2 08:48:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:52.485627 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb04139-b9bb-44f5-bf16-a9e7eef09786 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:52.485627 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb04139-b9bb-44f5-bf16-a9e7eef09786 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:52.485627 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb04139-b9bb-44f5-bf16-a9e7eef09786 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:52.487117 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 205/383] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:52.488291 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 178/383] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Aug 2 08:48:52 2022] GET /identity/v3/groups/8a06e6a5ce1f4e4187aaf8ff8670cfcc => generated 229 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:48:52.490284 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb04139-b9bb-44f5-bf16-a9e7eef09786 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:52.495306 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48855d9-b764-4244-9eaf-db475420068a None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:52.522952 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:52.694127 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb04139-b9bb-44f5-bf16-a9e7eef09786 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:52.704942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48855d9-b764-4244-9eaf-db475420068a None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:52.763281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:52.767535 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29785d4-d776-4633-85eb-c6c739988ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:52.768647 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29785d4-d776-4633-85eb-c6c739988ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:52.769231 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29785d4-d776-4633-85eb-c6c739988ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:52.769707 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29785d4-d776-4633-85eb-c6c739988ec9 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:52.770847 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29785d4-d776-4633-85eb-c6c739988ec9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:52.771429 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29785d4-d776-4633-85eb-c6c739988ec9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:52.773384 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29785d4-d776-4633-85eb-c6c739988ec9 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:52.784592 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fd0b8-1d3b-418a-bf20-412d7a06f08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:52.785734 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fd0b8-1d3b-418a-bf20-412d7a06f08f None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:52.786233 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fd0b8-1d3b-418a-bf20-412d7a06f08f None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:52.786731 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fd0b8-1d3b-418a-bf20-412d7a06f08f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:52.788352 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5fd0b8-1d3b-418a-bf20-412d7a06f08f None admin] RBAC: Adding query filter params (group.id=8a06e6a5ce1f4e4187aaf8ff8670cfcc, role.id=b5477d3c4e5a4514b64211ec2452d1d8, scope.project.id=4075c06a81874f9ca4b42e16828b98cd) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:52.788932 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5fd0b8-1d3b-418a-bf20-412d7a06f08f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:52.792458 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5fd0b8-1d3b-418a-bf20-412d7a06f08f None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:52.796149 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 206/384] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:48:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:52.798431 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc83b7-15a9-4b4e-8ebc-cd542e65c9db None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:52.798874 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc83b7-15a9-4b4e-8ebc-cd542e65c9db None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:52.799322 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc83b7-15a9-4b4e-8ebc-cd542e65c9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:52.812393 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 179/385] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Aug 2 08:48:52 2022] GET /identity/v3/role_assignments?group.id=8a06e6a5ce1f4e4187aaf8ff8670cfcc&scope.project.id=4075c06a81874f9ca4b42e16828b98cd&role.id=b5477d3c4e5a4514b64211ec2452d1d8 => generated 260 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:52.814141 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fd0b8-1d3b-418a-bf20-412d7a06f08f None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:52.833687 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-f0cc83b7-15a9-4b4e-8ebc-cd542e65c9db None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:52.835868 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-f0cc83b7-15a9-4b4e-8ebc-cd542e65c9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:52.976471 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 207/386] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:53.029319 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:53.032206 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc83b7-15a9-4b4e-8ebc-cd542e65c9db None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:53.063776 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fd0b8-1d3b-418a-bf20-412d7a06f08f None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:53.106287 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5f82c-027a-4859-9f32-46a6267423b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:53.106960 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5f82c-027a-4859-9f32-46a6267423b0 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:53.107242 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5f82c-027a-4859-9f32-46a6267423b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:53.107520 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5f82c-027a-4859-9f32-46a6267423b0 None admin] PATH_INFO: `/v3/groups/0b31eb75b5d9470997000dd5ce9fa64d` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:53.108785 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5f82c-027a-4859-9f32-46a6267423b0 None admin] RBAC: Authorizing `identity:get_group(group_id=0b31eb75b5d9470997000dd5ce9fa64d)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:53.110436 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5f82c-027a-4859-9f32-46a6267423b0 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:53.112613 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 180/387] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Aug 2 08:48:52 2022] GET /identity/v3/groups/0b31eb75b5d9470997000dd5ce9fa64d => generated 226 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:53.118062 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5f82c-027a-4859-9f32-46a6267423b0 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:53.241031 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5f82c-027a-4859-9f32-46a6267423b0 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:53.284034 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29931b6-6087-4712-9afc-1e7f9c51bc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:53.287602 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29931b6-6087-4712-9afc-1e7f9c51bc78 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:53.287602 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29931b6-6087-4712-9afc-1e7f9c51bc78 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:53.287602 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29931b6-6087-4712-9afc-1e7f9c51bc78 None admin] PATH_INFO: `/v3/projects/c8576b87aecf403699be87362271685d` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:53.287602 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29931b6-6087-4712-9afc-1e7f9c51bc78 None admin] RBAC: Authorizing `identity:get_project(project_id=c8576b87aecf403699be87362271685d)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:53.289433 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29931b6-6087-4712-9afc-1e7f9c51bc78 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:53.296636 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 181/388] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:53 2022] GET /identity/v3/projects/c8576b87aecf403699be87362271685d => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:53.299485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29931b6-6087-4712-9afc-1e7f9c51bc78 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:53.332545 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:53.340919 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc83b7-15a9-4b4e-8ebc-cd542e65c9db None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:53.387882 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:53.429472 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d360972-7296-4a10-92ca-4ca1e68883c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:53.430246 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d360972-7296-4a10-92ca-4ca1e68883c5 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:53.430533 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d360972-7296-4a10-92ca-4ca1e68883c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:53.430811 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d360972-7296-4a10-92ca-4ca1e68883c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:53.458496 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d360972-7296-4a10-92ca-4ca1e68883c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:53.476281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-5d360972-7296-4a10-92ca-4ca1e68883c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:48:53.476281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:53.476281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:53.476281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:53.476281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:53.476281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:53.476281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:53.476281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:53.476281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:53.476281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:53.476281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:53.476281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:53.476281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:53.476281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:53.476281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:53.476281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:53.478066 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:53.478066 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:53.478066 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:53.478066 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:53.478066 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:53.478066 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:53.478066 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:53.478066 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:53.478066 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:53.478066 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:53.478066 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:53.478066 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:53.478066 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:53.478066 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:53.478066 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:53.478066 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:53.480182 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:53.480182 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:53.480182 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:53.480182 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:53.480182 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:53.480182 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:53.480182 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:53.480182 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:53.480182 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:53.480182 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:53.480182 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:48:53.480182 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:48:53.480182 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 208/389] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:48:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 447 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:53.498030 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d360972-7296-4a10-92ca-4ca1e68883c5 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:53.578398 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29931b6-6087-4712-9afc-1e7f9c51bc78 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:53.661184 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbe532-19bf-423e-aa9a-f4a9361bbbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:53.662992 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbe532-19bf-423e-aa9a-f4a9361bbbab None admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:53.663493 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbe532-19bf-423e-aa9a-f4a9361bbbab None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:53.664861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbe532-19bf-423e-aa9a-f4a9361bbbab None admin] PATH_INFO: `/v3/projects/c8576b87aecf403699be87362271685d/groups/0b31eb75b5d9470997000dd5ce9fa64d/roles/923eb688fccc4e79b6c3df28d754b6c4` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:53.670259 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cbe532-19bf-423e-aa9a-f4a9361bbbab None admin] RBAC: Authorizing `identity:create_grant(project_id=c8576b87aecf403699be87362271685d, group_id=0b31eb75b5d9470997000dd5ce9fa64d, role_id=923eb688fccc4e79b6c3df28d754b6c4)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:53.673611 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cbe532-19bf-423e-aa9a-f4a9361bbbab None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:53.694195 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d360972-7296-4a10-92ca-4ca1e68883c5 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:53.752180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 182/390] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Aug 2 08:48:53 2022] PUT /identity/v3/projects/c8576b87aecf403699be87362271685d/groups/0b31eb75b5d9470997000dd5ce9fa64d/roles/923eb688fccc4e79b6c3df28d754b6c4 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:48:53.760504 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf915b7-1ce0-4359-b29e-d6a76e3e4740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:53.761739 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf915b7-1ce0-4359-b29e-d6a76e3e4740 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:53.762370 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf915b7-1ce0-4359-b29e-d6a76e3e4740 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:53.766804 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf915b7-1ce0-4359-b29e-d6a76e3e4740 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:53.766804 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf915b7-1ce0-4359-b29e-d6a76e3e4740 None admin] RBAC: Adding query filter params (name=member) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:53.766804 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf915b7-1ce0-4359-b29e-d6a76e3e4740 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:53.766804 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf915b7-1ce0-4359-b29e-d6a76e3e4740 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:53.783286 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 209/391] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Aug 2 08:48:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:48:53.787078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbe532-19bf-423e-aa9a-f4a9361bbbab None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:53.878681 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:53.919411 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbe532-19bf-423e-aa9a-f4a9361bbbab None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:53.939124 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b67b3-3f93-4d3a-8f12-de31aaf21828 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:53.939753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b67b3-3f93-4d3a-8f12-de31aaf21828 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:53.940293 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b67b3-3f93-4d3a-8f12-de31aaf21828 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:53.942203 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 210/392] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:48:53.949141 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd6178-d647-46b5-96dd-79f0fa0741af None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:53.949427 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd6178-d647-46b5-96dd-79f0fa0741af None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:53.949853 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd6178-d647-46b5-96dd-79f0fa0741af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:53.988950 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee2f47-ce0c-405f-a7cc-7370413bca76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:53.989702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee2f47-ce0c-405f-a7cc-7370413bca76 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:53.989981 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee2f47-ce0c-405f-a7cc-7370413bca76 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:53.990288 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee2f47-ce0c-405f-a7cc-7370413bca76 None admin] PATH_INFO: `/v3/groups/0b31eb75b5d9470997000dd5ce9fa64d` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:53.991724 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee2f47-ce0c-405f-a7cc-7370413bca76 None admin] RBAC: Authorizing `identity:get_group(group_id=0b31eb75b5d9470997000dd5ce9fa64d)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:53.992902 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-73cd6178-d647-46b5-96dd-79f0fa0741af None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:53.995325 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-73cd6178-d647-46b5-96dd-79f0fa0741af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:53.999415 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee2f47-ce0c-405f-a7cc-7370413bca76 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:54.001430 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 183/393] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Aug 2 08:48:53 2022] GET /identity/v3/groups/0b31eb75b5d9470997000dd5ce9fa64d => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:48:54.016079 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee2f47-ce0c-405f-a7cc-7370413bca76 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:54.088815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:54.140277 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 211/394] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:48:54.169909 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd6178-d647-46b5-96dd-79f0fa0741af None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:54.240547 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee2f47-ce0c-405f-a7cc-7370413bca76 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:54.298708 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd6178-d647-46b5-96dd-79f0fa0741af None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:54.323522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5870c-f167-4163-b5ac-de80c622243c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:54.324717 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5870c-f167-4163-b5ac-de80c622243c None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:54.325218 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5870c-f167-4163-b5ac-de80c622243c None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:54.325706 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5870c-f167-4163-b5ac-de80c622243c None admin] PATH_INFO: `/v3/projects/c8576b87aecf403699be87362271685d` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:54.333671 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed5870c-f167-4163-b5ac-de80c622243c None admin] RBAC: Authorizing `identity:get_project(project_id=c8576b87aecf403699be87362271685d)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:54.336530 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed5870c-f167-4163-b5ac-de80c622243c None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:54.340397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 184/395] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:54 2022] GET /identity/v3/projects/c8576b87aecf403699be87362271685d => generated 298 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:54.350879 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5870c-f167-4163-b5ac-de80c622243c None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:54.359851 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc236d-1ee7-46e9-9089-e8783327a569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:54.360999 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc236d-1ee7-46e9-9089-e8783327a569 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:54.361477 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc236d-1ee7-46e9-9089-e8783327a569 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:54.361972 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc236d-1ee7-46e9-9089-e8783327a569 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:54.381674 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:54.404225 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc236d-1ee7-46e9-9089-e8783327a569 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:54.418235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-17fc236d-1ee7-46e9-9089-e8783327a569 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:48:54.418235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:54.418235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:54.418235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:54.418235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:54.418235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:54.418235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:54.418235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:54.418235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:54.418235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:54.418235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:54.418235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:54.418235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:54.418235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:54.418235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:54.418235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:54.419990 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:54.419990 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:54.419990 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:54.419990 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:54.419990 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:54.419990 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:54.419990 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:54.419990 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:54.419990 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:54.419990 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:54.419990 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:54.419990 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:54.419990 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:54.419990 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:54.419990 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:54.419990 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:54.421579 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:54.421579 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:54.421579 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:54.421579 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:54.421579 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:54.421579 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:54.421579 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:54.421579 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:54.421579 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:54.421579 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:54.421579 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:48:54.421579 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:48:54.433104 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 212/396] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:48:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:54.440401 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc236d-1ee7-46e9-9089-e8783327a569 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:54.498991 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:54.618410 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc236d-1ee7-46e9-9089-e8783327a569 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:54.696683 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5870c-f167-4163-b5ac-de80c622243c None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:54.720207 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d63cd4-3ebb-4eff-b873-f42cb80737ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:54.720207 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d63cd4-3ebb-4eff-b873-f42cb80737ec None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:54.720207 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d63cd4-3ebb-4eff-b873-f42cb80737ec None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:54.720207 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d63cd4-3ebb-4eff-b873-f42cb80737ec None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:54.721246 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d63cd4-3ebb-4eff-b873-f42cb80737ec None admin] RBAC: Adding query filter params (name=member) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:54.721246 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d63cd4-3ebb-4eff-b873-f42cb80737ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:54.725358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d63cd4-3ebb-4eff-b873-f42cb80737ec None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:54.745464 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 213/397] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Aug 2 08:48:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:48:54.751793 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d63cd4-3ebb-4eff-b873-f42cb80737ec None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:54.770346 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fba7d4-e9da-41ba-8dc5-f0fd79722d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:54.771073 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fba7d4-e9da-41ba-8dc5-f0fd79722d84 None admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:54.771485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fba7d4-e9da-41ba-8dc5-f0fd79722d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:54.771774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fba7d4-e9da-41ba-8dc5-f0fd79722d84 None admin] PATH_INFO: `/v3/projects/c8576b87aecf403699be87362271685d/groups/0b31eb75b5d9470997000dd5ce9fa64d/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:54.777840 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fba7d4-e9da-41ba-8dc5-f0fd79722d84 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8576b87aecf403699be87362271685d, group_id=0b31eb75b5d9470997000dd5ce9fa64d, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:54.779371 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fba7d4-e9da-41ba-8dc5-f0fd79722d84 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:54.876373 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 185/398] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Aug 2 08:48:54 2022] PUT /identity/v3/projects/c8576b87aecf403699be87362271685d/groups/0b31eb75b5d9470997000dd5ce9fa64d/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:48:54.892662 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:54.904425 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d63cd4-3ebb-4eff-b873-f42cb80737ec None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:54.953855 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1edef-4bfe-4aee-967b-e5bea76d1f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:54.955070 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1edef-4bfe-4aee-967b-e5bea76d1f85 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:54.955601 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1edef-4bfe-4aee-967b-e5bea76d1f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:54.956091 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1edef-4bfe-4aee-967b-e5bea76d1f85 None admin] PATH_INFO: `/v3/groups/0b31eb75b5d9470997000dd5ce9fa64d` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:54.961197 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1edef-4bfe-4aee-967b-e5bea76d1f85 None admin] RBAC: Authorizing `identity:get_group(group_id=0b31eb75b5d9470997000dd5ce9fa64d)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:54.963220 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1edef-4bfe-4aee-967b-e5bea76d1f85 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:54.965937 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 214/399] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Aug 2 08:48:54 2022] GET /identity/v3/groups/0b31eb75b5d9470997000dd5ce9fa64d => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:54.972835 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fba7d4-e9da-41ba-8dc5-f0fd79722d84 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:54.986216 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cdd1c-9890-4c41-b62a-51c79ca05583 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:54.986590 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cdd1c-9890-4c41-b62a-51c79ca05583 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:54.986880 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cdd1c-9890-4c41-b62a-51c79ca05583 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:54.988839 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 215/400] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:48:54.995773 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811897f-1393-4da3-ad20-41d0e8434e3a None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:54.996175 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811897f-1393-4da3-ad20-41d0e8434e3a None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:54.996510 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811897f-1393-4da3-ad20-41d0e8434e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:55.020026 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-6811897f-1393-4da3-ad20-41d0e8434e3a None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:55.021316 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-6811897f-1393-4da3-ad20-41d0e8434e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:55.148596 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 216/401] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:48:55.175300 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:55.194769 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811897f-1393-4da3-ad20-41d0e8434e3a None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:55.255568 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fba7d4-e9da-41ba-8dc5-f0fd79722d84 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:55.373442 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193c589-36d4-4a63-b99e-fc1f379cb370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:55.374584 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193c589-36d4-4a63-b99e-fc1f379cb370 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:55.375094 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193c589-36d4-4a63-b99e-fc1f379cb370 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:55.375603 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193c589-36d4-4a63-b99e-fc1f379cb370 None admin] PATH_INFO: `/v3/projects/2937cdbeb750480e8d69fe400d2cca9e` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:55.383925 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193c589-36d4-4a63-b99e-fc1f379cb370 None admin] RBAC: Authorizing `identity:get_project(project_id=2937cdbeb750480e8d69fe400d2cca9e)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:55.387457 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193c589-36d4-4a63-b99e-fc1f379cb370 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:55.390958 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 186/402] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:54 2022] GET /identity/v3/projects/2937cdbeb750480e8d69fe400d2cca9e => generated 302 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:55.402512 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193c589-36d4-4a63-b99e-fc1f379cb370 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:55.471806 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:55.499565 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811897f-1393-4da3-ad20-41d0e8434e3a None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:55.631544 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f779f-1203-4426-b127-bb1b1b6b9e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:55.632708 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f779f-1203-4426-b127-bb1b1b6b9e81 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:55.633207 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f779f-1203-4426-b127-bb1b1b6b9e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:55.633695 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f779f-1203-4426-b127-bb1b1b6b9e81 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:55.641461 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193c589-36d4-4a63-b99e-fc1f379cb370 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:55.690008 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f779f-1203-4426-b127-bb1b1b6b9e81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:55.700402 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-627f779f-1203-4426-b127-bb1b1b6b9e81 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:48:55.700402 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:55.700402 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:55.700402 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:55.700402 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:55.700402 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:55.700402 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:55.700402 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:55.700402 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:55.700402 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:55.700402 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:55.700402 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:55.700402 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:55.700402 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:55.700402 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:55.700402 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:55.701357 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:55.701357 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:55.701357 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:55.701357 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:55.701357 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:55.701357 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:55.701357 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:55.701357 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:55.701357 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:55.701357 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:55.701357 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:55.701357 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:55.701357 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:55.701357 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:55.701357 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:55.701357 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:55.702166 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:55.702166 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:55.702166 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:55.702166 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:55.702166 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:55.702166 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:55.702166 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:55.702166 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:55.702166 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:55.702166 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:55.702166 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:48:55.702166 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:48:55.708909 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 217/403] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Aug 2 08:48:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 514 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:48:55.733214 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f779f-1203-4426-b127-bb1b1b6b9e81 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:55.747384 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb775cce-9470-4cdc-a8d5-1518661b9530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:55.748628 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb775cce-9470-4cdc-a8d5-1518661b9530 None admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:55.749109 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb775cce-9470-4cdc-a8d5-1518661b9530 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:55.749620 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb775cce-9470-4cdc-a8d5-1518661b9530 None admin] PATH_INFO: `/v3/projects/2937cdbeb750480e8d69fe400d2cca9e/groups/0b31eb75b5d9470997000dd5ce9fa64d/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:55.753483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb775cce-9470-4cdc-a8d5-1518661b9530 None admin] RBAC: Authorizing `identity:create_grant(project_id=2937cdbeb750480e8d69fe400d2cca9e, group_id=0b31eb75b5d9470997000dd5ce9fa64d, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:55.756605 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb775cce-9470-4cdc-a8d5-1518661b9530 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:55.761708 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:55.904030 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 187/404] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Aug 2 08:48:55 2022] PUT /identity/v3/projects/2937cdbeb750480e8d69fe400d2cca9e/groups/0b31eb75b5d9470997000dd5ce9fa64d/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:48:55.976406 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f779f-1203-4426-b127-bb1b1b6b9e81 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:56.070236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ff5c5-5b1d-4b6c-b797-f17f0506819a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:56.071376 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ff5c5-5b1d-4b6c-b797-f17f0506819a None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:56.072447 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ff5c5-5b1d-4b6c-b797-f17f0506819a None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:56.072990 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ff5c5-5b1d-4b6c-b797-f17f0506819a None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:56.074268 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ff5c5-5b1d-4b6c-b797-f17f0506819a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:56.074786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ff5c5-5b1d-4b6c-b797-f17f0506819a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:56.081717 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ff5c5-5b1d-4b6c-b797-f17f0506819a None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:56.100416 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 218/405] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:48:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:48:56.109826 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb775cce-9470-4cdc-a8d5-1518661b9530 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:56.304006 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb775cce-9470-4cdc-a8d5-1518661b9530 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:56.372015 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1abdf9-b07c-44c2-bca4-f25bc584f03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:56.372713 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1abdf9-b07c-44c2-bca4-f25bc584f03d None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:56.373063 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1abdf9-b07c-44c2-bca4-f25bc584f03d None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:56.373399 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1abdf9-b07c-44c2-bca4-f25bc584f03d None admin] PATH_INFO: `/v3/groups/0b31eb75b5d9470997000dd5ce9fa64d` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:56.374693 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1abdf9-b07c-44c2-bca4-f25bc584f03d None admin] RBAC: Authorizing `identity:get_group(group_id=0b31eb75b5d9470997000dd5ce9fa64d)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:56.376194 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1abdf9-b07c-44c2-bca4-f25bc584f03d None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:56.378240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 188/406] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Aug 2 08:48:56 2022] GET /identity/v3/groups/0b31eb75b5d9470997000dd5ce9fa64d => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:56.388098 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ff5c5-5b1d-4b6c-b797-f17f0506819a None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:56.438877 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:56.654272 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ff5c5-5b1d-4b6c-b797-f17f0506819a None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:56.684622 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01542fe-62de-41a6-823c-204e59ba7be7 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:56.685058 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01542fe-62de-41a6-823c-204e59ba7be7 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:56.685244 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01542fe-62de-41a6-823c-204e59ba7be7 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:56.686856 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 189/407] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:48:56.692477 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19daf78-86a6-483a-92db-01ad19d0337d None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:56.692864 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19daf78-86a6-483a-92db-01ad19d0337d None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:56.693017 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19daf78-86a6-483a-92db-01ad19d0337d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:56.729549 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14919284-7a86-4bee-afa9-a080aaba6687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:56.731166 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14919284-7a86-4bee-afa9-a080aaba6687 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:56.731960 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14919284-7a86-4bee-afa9-a080aaba6687 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:56.732821 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14919284-7a86-4bee-afa9-a080aaba6687 None admin] PATH_INFO: `/v3/projects/2937cdbeb750480e8d69fe400d2cca9e` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:56.735343 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14919284-7a86-4bee-afa9-a080aaba6687 None admin] RBAC: Authorizing `identity:get_project(project_id=2937cdbeb750480e8d69fe400d2cca9e)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:56.739327 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14919284-7a86-4bee-afa9-a080aaba6687 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:56.743511 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 219/408] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:56 2022] GET /identity/v3/projects/2937cdbeb750480e8d69fe400d2cca9e => generated 302 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:56.754700 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14919284-7a86-4bee-afa9-a080aaba6687 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:56.765029 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-a19daf78-86a6-483a-92db-01ad19d0337d None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:56.767090 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-a19daf78-86a6-483a-92db-01ad19d0337d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:56.852746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:56.864357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 190/409] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:48:56.897555 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19daf78-86a6-483a-92db-01ad19d0337d None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:56.944876 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:56.968945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14919284-7a86-4bee-afa9-a080aaba6687 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:57.014362 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece6e47-ab6c-4390-ac6e-82f5821009cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:57.015070 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece6e47-ab6c-4390-ac6e-82f5821009cf None admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:57.015350 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece6e47-ab6c-4390-ac6e-82f5821009cf None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:57.015626 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece6e47-ab6c-4390-ac6e-82f5821009cf None admin] PATH_INFO: `/v3/projects/2937cdbeb750480e8d69fe400d2cca9e/groups/0b31eb75b5d9470997000dd5ce9fa64d/roles/923eb688fccc4e79b6c3df28d754b6c4` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:57.018133 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece6e47-ab6c-4390-ac6e-82f5821009cf None admin] RBAC: Authorizing `identity:create_grant(project_id=2937cdbeb750480e8d69fe400d2cca9e, group_id=0b31eb75b5d9470997000dd5ce9fa64d, role_id=923eb688fccc4e79b6c3df28d754b6c4)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:57.019627 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece6e47-ab6c-4390-ac6e-82f5821009cf None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:57.112003 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 220/410] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Aug 2 08:48:56 2022] PUT /identity/v3/projects/2937cdbeb750480e8d69fe400d2cca9e/groups/0b31eb75b5d9470997000dd5ce9fa64d/roles/923eb688fccc4e79b6c3df28d754b6c4 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:48:57.130554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19daf78-86a6-483a-92db-01ad19d0337d None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:57.221381 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875c4dd-0c8c-4639-a355-57ead58cd7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:57.222411 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875c4dd-0c8c-4639-a355-57ead58cd7b7 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:57.222912 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875c4dd-0c8c-4639-a355-57ead58cd7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:57.223394 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875c4dd-0c8c-4639-a355-57ead58cd7b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:57.252240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875c4dd-0c8c-4639-a355-57ead58cd7b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:57.263110 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-4875c4dd-0c8c-4639-a355-57ead58cd7b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:48:57.263110 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:57.263110 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:57.263110 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:57.263110 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:57.263110 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:57.263110 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:57.263110 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:57.263110 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:57.263110 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:57.263110 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:57.263110 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:57.263110 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:57.263110 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:57.263110 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:57.263110 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:57.264106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:57.264106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:57.264106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:57.264106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:57.264106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:57.264106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:57.264106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:57.264106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:57.264106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:57.264106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:57.264106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:57.264106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:57.264106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:57.264106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:57.264106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:57.264106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:57.264933 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:57.264933 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:57.264933 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:57.264933 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:57.264933 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:57.264933 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:57.264933 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:57.264933 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:57.264933 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:57.264933 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:57.264933 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:48:57.264933 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:48:57.266095 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 191/411] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:48:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:48:57.275204 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece6e47-ab6c-4390-ac6e-82f5821009cf None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:57.371304 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b7f33-4fec-4247-96a0-a704a21de73f None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:57.371801 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b7f33-4fec-4247-96a0-a704a21de73f None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:57.372321 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b7f33-4fec-4247-96a0-a704a21de73f None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:57.375438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 192/412] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:57.404715 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616a8ca-68b9-451c-bc05-4cbe592135eb None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:57.405210 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616a8ca-68b9-451c-bc05-4cbe592135eb None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:57.405653 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616a8ca-68b9-451c-bc05-4cbe592135eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:57.449706 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-d616a8ca-68b9-451c-bc05-4cbe592135eb None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:57.451929 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-d616a8ca-68b9-451c-bc05-4cbe592135eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:57.551785 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:57.551958 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece6e47-ab6c-4390-ac6e-82f5821009cf None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:57.607742 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 193/413] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:48:57.626454 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d56c42-b5f7-442c-aba4-14e575f16870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:57.627106 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d56c42-b5f7-442c-aba4-14e575f16870 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:57.627388 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d56c42-b5f7-442c-aba4-14e575f16870 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:57.627754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d56c42-b5f7-442c-aba4-14e575f16870 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:57.628524 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d56c42-b5f7-442c-aba4-14e575f16870 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:57.629101 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d56c42-b5f7-442c-aba4-14e575f16870 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:57.630609 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d56c42-b5f7-442c-aba4-14e575f16870 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:57.647732 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616a8ca-68b9-451c-bc05-4cbe592135eb None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:57.648376 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 221/414] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:48:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:57.656941 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d56c42-b5f7-442c-aba4-14e575f16870 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:57.661155 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:57.893385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d56c42-b5f7-442c-aba4-14e575f16870 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:57.914991 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616a8ca-68b9-451c-bc05-4cbe592135eb None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:57.983743 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce16f6-41d9-4dd9-b4ca-4dc030f2ec6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:57.985049 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce16f6-41d9-4dd9-b4ca-4dc030f2ec6d None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:57.985614 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce16f6-41d9-4dd9-b4ca-4dc030f2ec6d None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:57.986023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce16f6-41d9-4dd9-b4ca-4dc030f2ec6d None admin] PATH_INFO: `/v3/groups/8a06e6a5ce1f4e4187aaf8ff8670cfcc` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:57.987900 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce16f6-41d9-4dd9-b4ca-4dc030f2ec6d None admin] RBAC: Authorizing `identity:get_group(group_id=8a06e6a5ce1f4e4187aaf8ff8670cfcc)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:57.990942 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce16f6-41d9-4dd9-b4ca-4dc030f2ec6d None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:57.999609 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad6110-20ee-4ccb-aa24-dcd5e1632db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:57.999811 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 222/415] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Aug 2 08:48:57 2022] GET /identity/v3/groups/8a06e6a5ce1f4e4187aaf8ff8670cfcc => generated 229 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:48:57.999811 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2663f27-821c-4c65-bc9a-7a24133114ec None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:57.999811 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2663f27-821c-4c65-bc9a-7a24133114ec None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:57.999811 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2663f27-821c-4c65-bc9a-7a24133114ec None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:58.001157 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad6110-20ee-4ccb-aa24-dcd5e1632db7 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:58.001636 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 223/416] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:58.001922 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad6110-20ee-4ccb-aa24-dcd5e1632db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:58.002397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad6110-20ee-4ccb-aa24-dcd5e1632db7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:58.003032 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2663f27-821c-4c65-bc9a-7a24133114ec None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:58.023822 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad6110-20ee-4ccb-aa24-dcd5e1632db7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:58.033640 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-eaad6110-20ee-4ccb-aa24-dcd5e1632db7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:48:58.033640 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:58.033640 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:58.033640 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:58.033640 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:58.033640 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:58.033640 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:58.033640 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:58.033640 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:58.033640 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:58.033640 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:58.033640 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:58.033640 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:58.033640 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:58.033640 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:58.033640 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:58.034743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:58.034743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:58.034743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:58.034743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:58.034743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:58.034743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:58.034743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:58.034743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:58.034743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:58.034743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:58.034743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:58.034743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:58.034743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:58.034743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:58.034743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:58.034743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:58.035540 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:58.035540 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:58.035540 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:58.035540 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:58.035540 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:58.035540 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:58.035540 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:58.035540 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:58.035540 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:58.035540 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:58.035540 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:48:58.035540 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:48:58.041516 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 194/417] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Aug 2 08:48:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:58.043385 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061a3c2-83a1-45a8-a9fd-f63c5f05cf06 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:58.043876 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061a3c2-83a1-45a8-a9fd-f63c5f05cf06 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:58.044401 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061a3c2-83a1-45a8-a9fd-f63c5f05cf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:58.077907 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-8061a3c2-83a1-45a8-a9fd-f63c5f05cf06 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:58.080093 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-8061a3c2-83a1-45a8-a9fd-f63c5f05cf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:48:58.117135 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:58.148145 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:58.164594 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2663f27-821c-4c65-bc9a-7a24133114ec None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:58.219284 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad412b0-1a29-4c06-a0f4-c9084e6de744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:58.219690 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 195/418] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:48:58.220772 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061a3c2-83a1-45a8-a9fd-f63c5f05cf06 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:58.221374 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad412b0-1a29-4c06-a0f4-c9084e6de744 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:58.222186 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad412b0-1a29-4c06-a0f4-c9084e6de744 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:58.222882 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad412b0-1a29-4c06-a0f4-c9084e6de744 None admin] PATH_INFO: `/v3/projects/4075c06a81874f9ca4b42e16828b98cd` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:58.227387 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad412b0-1a29-4c06-a0f4-c9084e6de744 None admin] RBAC: Authorizing `identity:get_project(project_id=4075c06a81874f9ca4b42e16828b98cd)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:58.231126 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad412b0-1a29-4c06-a0f4-c9084e6de744 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:58.236892 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 224/419] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:58 2022] GET /identity/v3/projects/4075c06a81874f9ca4b42e16828b98cd => generated 344 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:58.248351 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad412b0-1a29-4c06-a0f4-c9084e6de744 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:58.364631 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061a3c2-83a1-45a8-a9fd-f63c5f05cf06 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:58.432192 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4831086-1c75-4473-a01b-e8db9350143c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:58.433211 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4831086-1c75-4473-a01b-e8db9350143c None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:58.433745 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4831086-1c75-4473-a01b-e8db9350143c None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:58.434281 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4831086-1c75-4473-a01b-e8db9350143c None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:58.435539 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4831086-1c75-4473-a01b-e8db9350143c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:58.436148 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4831086-1c75-4473-a01b-e8db9350143c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:58.438537 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4831086-1c75-4473-a01b-e8db9350143c None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:58.452453 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 196/420] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:48:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:48:58.453582 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4831086-1c75-4473-a01b-e8db9350143c None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:58.487773 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad412b0-1a29-4c06-a0f4-c9084e6de744 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:58.504825 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:58.531654 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff59f28-57e4-4089-a768-55dc2d4df270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:58.532684 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff59f28-57e4-4089-a768-55dc2d4df270 None admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:58.533208 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff59f28-57e4-4089-a768-55dc2d4df270 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:58.533636 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff59f28-57e4-4089-a768-55dc2d4df270 None admin] PATH_INFO: `/v3/projects/4075c06a81874f9ca4b42e16828b98cd/groups/8a06e6a5ce1f4e4187aaf8ff8670cfcc/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:58.536248 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff59f28-57e4-4089-a768-55dc2d4df270 None admin] RBAC: Authorizing `identity:create_grant(project_id=4075c06a81874f9ca4b42e16828b98cd, group_id=8a06e6a5ce1f4e4187aaf8ff8670cfcc, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:58.538046 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff59f28-57e4-4089-a768-55dc2d4df270 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:58.603661 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:58.616053 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 225/421] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Aug 2 08:48:58 2022] PUT /identity/v3/projects/4075c06a81874f9ca4b42e16828b98cd/groups/8a06e6a5ce1f4e4187aaf8ff8670cfcc/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:48:58.617526 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff59f28-57e4-4089-a768-55dc2d4df270 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:58.649165 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4831086-1c75-4473-a01b-e8db9350143c None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:58.743379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa474aa4-b58d-4c0c-a3ec-a60527b89c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:58.746676 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa474aa4-b58d-4c0c-a3ec-a60527b89c2b None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:58.746964 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa474aa4-b58d-4c0c-a3ec-a60527b89c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:58.747219 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa474aa4-b58d-4c0c-a3ec-a60527b89c2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:58.783314 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa474aa4-b58d-4c0c-a3ec-a60527b89c2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:48:58.794248 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-aa474aa4-b58d-4c0c-a3ec-a60527b89c2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:48:58.794248 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:48:58.794248 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:48:58.794248 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:48:58.794248 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:48:58.794248 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:48:58.794248 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:48:58.794248 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:48:58.794248 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:48:58.794248 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:48:58.794248 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:48:58.794248 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:48:58.794248 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:48:58.794248 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:48:58.794248 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:48:58.794248 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:48:58.795239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:48:58.795239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:48:58.795239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:48:58.795239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:48:58.795239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:48:58.795239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:48:58.795239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:48:58.795239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:48:58.795239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:48:58.795239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:48:58.795239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:48:58.795239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:48:58.795239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:48:58.795239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:48:58.795239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:48:58.795239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:48:58.796074 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:48:58.796074 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:48:58.796074 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:48:58.796074 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:48:58.796074 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:48:58.796074 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:48:58.796074 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:48:58.796074 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:48:58.796074 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:48:58.796074 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:48:58.796074 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:48:58.796074 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:48:58.804613 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 197/422] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:48:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:48:58.820228 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa474aa4-b58d-4c0c-a3ec-a60527b89c2b None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:58.872350 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff59f28-57e4-4089-a768-55dc2d4df270 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:58.927287 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f76b6-84c3-4305-9c6a-33a3c1f2295c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:58.928909 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f76b6-84c3-4305-9c6a-33a3c1f2295c None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:58.929450 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f76b6-84c3-4305-9c6a-33a3c1f2295c None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:58.929986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f76b6-84c3-4305-9c6a-33a3c1f2295c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:58.998475 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:59.008252 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa474aa4-b58d-4c0c-a3ec-a60527b89c2b None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:59.054915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65983d-89be-4cb0-a4dc-7306fbb373f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:59.055995 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65983d-89be-4cb0-a4dc-7306fbb373f0 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:59.057153 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65983d-89be-4cb0-a4dc-7306fbb373f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:59.057637 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65983d-89be-4cb0-a4dc-7306fbb373f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:59.058692 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65983d-89be-4cb0-a4dc-7306fbb373f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:48:59.059350 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65983d-89be-4cb0-a4dc-7306fbb373f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:59.060988 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65983d-89be-4cb0-a4dc-7306fbb373f0 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:59.076734 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 198/423] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Aug 2 08:48:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:48:59.079860 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:59.085295 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f76b6-84c3-4305-9c6a-33a3c1f2295c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:59.086920 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65983d-89be-4cb0-a4dc-7306fbb373f0 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:59.090668 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f76b6-84c3-4305-9c6a-33a3c1f2295c None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:59.403449 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 226/424] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:48:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 786 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:48:59.412848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f76b6-84c3-4305-9c6a-33a3c1f2295c None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:59.442777 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65983d-89be-4cb0-a4dc-7306fbb373f0 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:59.527599 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd79435-1505-4dd6-a1c3-d0139c178771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:59.528663 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd79435-1505-4dd6-a1c3-d0139c178771 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:59.529155 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd79435-1505-4dd6-a1c3-d0139c178771 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:59.529634 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd79435-1505-4dd6-a1c3-d0139c178771 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:59.568651 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:59.657778 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd79435-1505-4dd6-a1c3-d0139c178771 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:59.660607 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd79435-1505-4dd6-a1c3-d0139c178771 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:59.667948 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:48:59.675867 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f76b6-84c3-4305-9c6a-33a3c1f2295c None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:48:59.753067 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f22bb-f5cd-4810-ae96-973f8d7afa38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:48:59.755037 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f22bb-f5cd-4810-ae96-973f8d7afa38 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:59.755907 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f22bb-f5cd-4810-ae96-973f8d7afa38 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:59.756648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f22bb-f5cd-4810-ae96-973f8d7afa38 None admin] PATH_INFO: `/v3/projects/c8576b87aecf403699be87362271685d` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:59.759426 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f22bb-f5cd-4810-ae96-973f8d7afa38 None admin] RBAC: Authorizing `identity:get_project(project_id=c8576b87aecf403699be87362271685d)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:48:59.762793 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f22bb-f5cd-4810-ae96-973f8d7afa38 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:48:59.767114 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 227/425] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:48:59 2022] GET /identity/v3/projects/c8576b87aecf403699be87362271685d => generated 298 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:48:59.769786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7fad6-0245-4dc8-b224-f63f2f978b97 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:59.770625 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7fad6-0245-4dc8-b224-f63f2f978b97 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:59.771334 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7fad6-0245-4dc8-b224-f63f2f978b97 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:59.780323 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 228/426] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:48:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:48:59.782398 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7fad6-0245-4dc8-b224-f63f2f978b97 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:48:59.876351 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 199/427] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:48:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 783 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 08:48:59.879087 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092656e-0ef2-49fd-86e1-de0edbd44bfb None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:48:59.879583 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092656e-0ef2-49fd-86e1-de0edbd44bfb None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:48:59.880071 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092656e-0ef2-49fd-86e1-de0edbd44bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:48:59.912961 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-7092656e-0ef2-49fd-86e1-de0edbd44bfb None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:48:59.915011 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-7092656e-0ef2-49fd-86e1-de0edbd44bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:00.009761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7fad6-0245-4dc8-b224-f63f2f978b97 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:00.020473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:00.063159 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 200/428] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:48:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:49:00.063159 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7092656e-0ef2-49fd-86e1-de0edbd44bfb None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:00.121499 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475472c7-00fd-4531-8854-9c0177993085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:00.122393 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475472c7-00fd-4531-8854-9c0177993085 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:00.123311 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475472c7-00fd-4531-8854-9c0177993085 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:00.123606 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475472c7-00fd-4531-8854-9c0177993085 None admin] PATH_INFO: `/v3/groups/0b31eb75b5d9470997000dd5ce9fa64d` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:00.125627 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475472c7-00fd-4531-8854-9c0177993085 None admin] RBAC: Authorizing `identity:get_group(group_id=0b31eb75b5d9470997000dd5ce9fa64d)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:00.127420 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475472c7-00fd-4531-8854-9c0177993085 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:00.131761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 229/429] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Aug 2 08:48:59 2022] GET /identity/v3/groups/0b31eb75b5d9470997000dd5ce9fa64d => generated 226 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:00.133268 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73497252-c0bf-420d-b341-d18169be472c None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:00.133566 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73497252-c0bf-420d-b341-d18169be472c None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:00.133819 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73497252-c0bf-420d-b341-d18169be472c None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:00.140746 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 230/430] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:00.142833 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73497252-c0bf-420d-b341-d18169be472c None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:00.220790 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:00.255867 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7092656e-0ef2-49fd-86e1-de0edbd44bfb None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:00.313888 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbe46c-cf44-4d6f-9515-6cb68ad31325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:00.314709 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbe46c-cf44-4d6f-9515-6cb68ad31325 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:00.315038 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbe46c-cf44-4d6f-9515-6cb68ad31325 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:00.315315 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbe46c-cf44-4d6f-9515-6cb68ad31325 None admin] PATH_INFO: `/v3/projects/c8576b87aecf403699be87362271685d` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:00.316573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dbe46c-cf44-4d6f-9515-6cb68ad31325 None admin] RBAC: Authorizing `identity:get_project(project_id=c8576b87aecf403699be87362271685d)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:00.318054 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dbe46c-cf44-4d6f-9515-6cb68ad31325 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:00.319968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 201/431] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:49:00 2022] GET /identity/v3/projects/c8576b87aecf403699be87362271685d => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:00.320793 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbe46c-cf44-4d6f-9515-6cb68ad31325 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:00.350536 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73497252-c0bf-420d-b341-d18169be472c None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:00.392852 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:00.424945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187910c-d0f9-4d98-82db-c66ffe92441c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:00.426033 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187910c-d0f9-4d98-82db-c66ffe92441c None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:00.426592 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187910c-d0f9-4d98-82db-c66ffe92441c None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:00.427081 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187910c-d0f9-4d98-82db-c66ffe92441c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:00.428014 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187910c-d0f9-4d98-82db-c66ffe92441c None admin] RBAC: Adding query filter params (group.id=0b31eb75b5d9470997000dd5ce9fa64d, role.id=923eb688fccc4e79b6c3df28d754b6c4, scope.project.id=c8576b87aecf403699be87362271685d) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:00.428504 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187910c-d0f9-4d98-82db-c66ffe92441c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:00.431891 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187910c-d0f9-4d98-82db-c66ffe92441c None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:00.448580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 231/432] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Aug 2 08:49:00 2022] GET /identity/v3/role_assignments?group.id=0b31eb75b5d9470997000dd5ce9fa64d&scope.project.id=c8576b87aecf403699be87362271685d&role.id=923eb688fccc4e79b6c3df28d754b6c4 => generated 611 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:00.450651 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614ecd2-0ed6-4222-b340-d46dc1645056 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:00.451153 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614ecd2-0ed6-4222-b340-d46dc1645056 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:00.451664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614ecd2-0ed6-4222-b340-d46dc1645056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:00.453499 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbe46c-cf44-4d6f-9515-6cb68ad31325 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:00.486358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-b614ecd2-0ed6-4222-b340-d46dc1645056 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:00.487889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-b614ecd2-0ed6-4222-b340-d46dc1645056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:00.534631 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14102a8a-c439-47f2-a1a4-8d5503479514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:00.535377 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14102a8a-c439-47f2-a1a4-8d5503479514 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:00.535672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14102a8a-c439-47f2-a1a4-8d5503479514 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:00.535955 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14102a8a-c439-47f2-a1a4-8d5503479514 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:00.551183 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14102a8a-c439-47f2-a1a4-8d5503479514 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:49:00.560629 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-14102a8a-c439-47f2-a1a4-8d5503479514 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:49:00.560629 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:00.560629 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:00.560629 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:00.560629 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:00.560629 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:00.560629 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:00.560629 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:00.560629 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:00.560629 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:00.560629 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:00.560629 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:00.560629 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:49:00.560629 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:49:00.560629 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:49:00.560629 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:49:00.562262 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:49:00.562262 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:49:00.562262 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:49:00.562262 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:49:00.562262 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:00.562262 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:00.562262 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:00.562262 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:00.562262 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:00.562262 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:00.562262 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:00.562262 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:00.562262 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:00.562262 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:00.562262 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:00.562262 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:00.563677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:00.563677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:00.563677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:00.563677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:00.563677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:49:00.563677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:49:00.563677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:49:00.563677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:49:00.563677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:49:00.563677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:49:00.563677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:49:00.563677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:00.566975 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 202/433] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:49:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:00.568263 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14102a8a-c439-47f2-a1a4-8d5503479514 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:00.627169 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 232/434] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:49:00.627169 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614ecd2-0ed6-4222-b340-d46dc1645056 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:00.662846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:00.756046 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14102a8a-c439-47f2-a1a4-8d5503479514 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:00.777034 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:00.802136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaff298-aaa3-46f1-b267-b3cc6e9762ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:00.802802 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaff298-aaa3-46f1-b267-b3cc6e9762ad None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:00.803084 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaff298-aaa3-46f1-b267-b3cc6e9762ad None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:00.803399 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaff298-aaa3-46f1-b267-b3cc6e9762ad None admin] PATH_INFO: `/v3/groups/0b31eb75b5d9470997000dd5ce9fa64d` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:00.804614 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaff298-aaa3-46f1-b267-b3cc6e9762ad None admin] RBAC: Authorizing `identity:get_group(group_id=0b31eb75b5d9470997000dd5ce9fa64d)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:00.806128 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaff298-aaa3-46f1-b267-b3cc6e9762ad None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:00.807298 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614ecd2-0ed6-4222-b340-d46dc1645056 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:00.807881 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 203/435] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Aug 2 08:49:00 2022] GET /identity/v3/groups/0b31eb75b5d9470997000dd5ce9fa64d => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:00.808705 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaff298-aaa3-46f1-b267-b3cc6e9762ad None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:00.861068 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba16eeb-e340-4668-9845-419555ddb71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:00.861880 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba16eeb-e340-4668-9845-419555ddb71a None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:00.862542 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba16eeb-e340-4668-9845-419555ddb71a None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:00.862905 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba16eeb-e340-4668-9845-419555ddb71a None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:00.863775 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba16eeb-e340-4668-9845-419555ddb71a None admin] RBAC: Adding query filter params (name=member) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:00.864249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba16eeb-e340-4668-9845-419555ddb71a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:00.866346 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba16eeb-e340-4668-9845-419555ddb71a None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:00.883929 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 233/436] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Aug 2 08:49:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:00.884845 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba16eeb-e340-4668-9845-419555ddb71a None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:00.966197 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaff298-aaa3-46f1-b267-b3cc6e9762ad None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:01.011392 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b7a95-3018-4183-a7fe-ed5df18b17b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:01.012547 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b7a95-3018-4183-a7fe-ed5df18b17b8 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:01.013243 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b7a95-3018-4183-a7fe-ed5df18b17b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:01.013583 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b7a95-3018-4183-a7fe-ed5df18b17b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:01.028732 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b7a95-3018-4183-a7fe-ed5df18b17b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:49:01.033844 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:01.036942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-173b7a95-3018-4183-a7fe-ed5df18b17b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:49:01.036942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:01.036942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:01.036942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:01.036942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:01.036942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:01.036942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:01.036942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:01.036942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:01.036942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:01.036942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:01.036942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:01.036942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:49:01.036942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:49:01.036942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:49:01.036942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:49:01.038653 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:49:01.038653 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:49:01.038653 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:49:01.038653 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:49:01.038653 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:01.038653 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:01.038653 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:01.038653 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:01.038653 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:01.038653 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:01.038653 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:01.038653 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:01.038653 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:01.038653 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:01.038653 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:01.038653 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:01.040240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:01.040240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:01.040240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:01.040240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:01.040240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:49:01.040240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:49:01.040240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:49:01.040240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:49:01.040240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:49:01.040240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:49:01.040240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:49:01.040240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:01.040240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 204/437] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Aug 2 08:49:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:01.040240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b7a95-3018-4183-a7fe-ed5df18b17b8 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:01.055806 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba16eeb-e340-4668-9845-419555ddb71a None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:01.098925 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:01.118412 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f00063-e2c1-4322-9383-65965966f311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:01.122644 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f00063-e2c1-4322-9383-65965966f311 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:01.122644 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f00063-e2c1-4322-9383-65965966f311 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:01.122644 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f00063-e2c1-4322-9383-65965966f311 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:01.122644 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f00063-e2c1-4322-9383-65965966f311 None admin] RBAC: Adding query filter params (group.id=0b31eb75b5d9470997000dd5ce9fa64d, role.id=5fd593d076084fbaa9208dd505b58150, scope.project.id=c8576b87aecf403699be87362271685d) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:01.122644 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f00063-e2c1-4322-9383-65965966f311 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:01.123606 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f00063-e2c1-4322-9383-65965966f311 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:01.130389 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 234/438] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Aug 2 08:49:00 2022] GET /identity/v3/role_assignments?group.id=0b31eb75b5d9470997000dd5ce9fa64d&scope.project.id=c8576b87aecf403699be87362271685d&role.id=5fd593d076084fbaa9208dd505b58150 => generated 611 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:01.137287 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f00063-e2c1-4322-9383-65965966f311 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:01.227799 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b7a95-3018-4183-a7fe-ed5df18b17b8 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:01.307583 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47d3bc-f6ca-4c80-8a85-20f61b4bcc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:01.308819 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47d3bc-f6ca-4c80-8a85-20f61b4bcc12 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:01.309370 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47d3bc-f6ca-4c80-8a85-20f61b4bcc12 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:01.309912 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47d3bc-f6ca-4c80-8a85-20f61b4bcc12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:01.339888 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f00063-e2c1-4322-9383-65965966f311 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:01.425042 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e690c44-e172-4b8a-94e8-95eee49ae505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:01.425853 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e690c44-e172-4b8a-94e8-95eee49ae505 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:01.426550 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e690c44-e172-4b8a-94e8-95eee49ae505 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:01.426907 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e690c44-e172-4b8a-94e8-95eee49ae505 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:01.427834 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e690c44-e172-4b8a-94e8-95eee49ae505 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:01.428319 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e690c44-e172-4b8a-94e8-95eee49ae505 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:01.430061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e690c44-e172-4b8a-94e8-95eee49ae505 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:01.446060 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 235/439] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:49:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:01.454755 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e690c44-e172-4b8a-94e8-95eee49ae505 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:01.466550 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47d3bc-f6ca-4c80-8a85-20f61b4bcc12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:01.469492 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47d3bc-f6ca-4c80-8a85-20f61b4bcc12 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:01.487891 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:01.561967 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:01.667051 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e690c44-e172-4b8a-94e8-95eee49ae505 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:01.670406 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 205/440] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:49:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:49:01.674599 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46730104-a413-4d80-a6e5-f21fb9074bf3 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:01.675452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46730104-a413-4d80-a6e5-f21fb9074bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:01.675625 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46730104-a413-4d80-a6e5-f21fb9074bf3 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:01.678272 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 206/441] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:01.679727 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46730104-a413-4d80-a6e5-f21fb9074bf3 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:01.730578 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980115e-d474-453c-ad38-4b9afc46cf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:01.731655 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980115e-d474-453c-ad38-4b9afc46cf7a None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:01.732200 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980115e-d474-453c-ad38-4b9afc46cf7a None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:01.732813 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980115e-d474-453c-ad38-4b9afc46cf7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:01.849945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980115e-d474-453c-ad38-4b9afc46cf7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:01.853383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980115e-d474-453c-ad38-4b9afc46cf7a None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:01.874275 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46730104-a413-4d80-a6e5-f21fb9074bf3 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:01.893319 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:01.938318 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea4efe-789c-47d1-a5a9-7ca0aa31911d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:01.938994 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea4efe-789c-47d1-a5a9-7ca0aa31911d None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:01.939279 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea4efe-789c-47d1-a5a9-7ca0aa31911d None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:01.939594 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea4efe-789c-47d1-a5a9-7ca0aa31911d None admin] PATH_INFO: `/v3/projects/2937cdbeb750480e8d69fe400d2cca9e` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:01.940898 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea4efe-789c-47d1-a5a9-7ca0aa31911d None admin] RBAC: Authorizing `identity:get_project(project_id=2937cdbeb750480e8d69fe400d2cca9e)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:01.942360 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea4efe-789c-47d1-a5a9-7ca0aa31911d None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:01.944109 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 207/442] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:49:01 2022] GET /identity/v3/projects/2937cdbeb750480e8d69fe400d2cca9e => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:01.945520 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4544b6-ece2-461c-bbe0-d3e0fe7d8985 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:01.945805 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4544b6-ece2-461c-bbe0-d3e0fe7d8985 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:01.946089 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4544b6-ece2-461c-bbe0-d3e0fe7d8985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:01.966189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-da4544b6-ece2-461c-bbe0-d3e0fe7d8985 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:01.967441 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-da4544b6-ece2-461c-bbe0-d3e0fe7d8985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:01.970604 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:02.037727 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 236/443] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:49:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:49:02.039543 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980115e-d474-453c-ad38-4b9afc46cf7a None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:02.052076 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 208/444] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:49:02.055718 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4544b6-ece2-461c-bbe0-d3e0fe7d8985 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:02.202050 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980115e-d474-453c-ad38-4b9afc46cf7a None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:02.212041 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4544b6-ece2-461c-bbe0-d3e0fe7d8985 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:02.226928 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:02.252921 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b168a7-f181-4e97-b8de-183aa532a568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:02.254008 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b168a7-f181-4e97-b8de-183aa532a568 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:02.254482 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b168a7-f181-4e97-b8de-183aa532a568 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:02.254869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b168a7-f181-4e97-b8de-183aa532a568 None admin] PATH_INFO: `/v3/groups/0b31eb75b5d9470997000dd5ce9fa64d` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:02.256254 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ec448-22cd-44fc-8ce5-4b27b3ec0d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:02.256475 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b168a7-f181-4e97-b8de-183aa532a568 None admin] RBAC: Authorizing `identity:get_group(group_id=0b31eb75b5d9470997000dd5ce9fa64d)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:02.256932 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ec448-22cd-44fc-8ce5-4b27b3ec0d92 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:02.257213 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ec448-22cd-44fc-8ce5-4b27b3ec0d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:02.257486 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ec448-22cd-44fc-8ce5-4b27b3ec0d92 None admin] PATH_INFO: `/v3/projects/2937cdbeb750480e8d69fe400d2cca9e` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:02.258149 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b168a7-f181-4e97-b8de-183aa532a568 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:02.258735 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ec448-22cd-44fc-8ce5-4b27b3ec0d92 None admin] RBAC: Authorizing `identity:get_project(project_id=2937cdbeb750480e8d69fe400d2cca9e)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:02.261136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ec448-22cd-44fc-8ce5-4b27b3ec0d92 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:02.261667 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 237/445] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Aug 2 08:49:02 2022] GET /identity/v3/groups/0b31eb75b5d9470997000dd5ce9fa64d => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:02.263228 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 209/446] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:49:02 2022] GET /identity/v3/projects/2937cdbeb750480e8d69fe400d2cca9e => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:02.263520 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b168a7-f181-4e97-b8de-183aa532a568 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:02.268485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ec448-22cd-44fc-8ce5-4b27b3ec0d92 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:02.283206 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:02.409279 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b168a7-f181-4e97-b8de-183aa532a568 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:02.410114 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ec448-22cd-44fc-8ce5-4b27b3ec0d92 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:02.449623 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1749fa0-ae6f-4b98-8f3d-f20fa6566936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:02.450253 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1749fa0-ae6f-4b98-8f3d-f20fa6566936 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:02.450538 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1749fa0-ae6f-4b98-8f3d-f20fa6566936 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:02.450818 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1749fa0-ae6f-4b98-8f3d-f20fa6566936 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:02.451630 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1749fa0-ae6f-4b98-8f3d-f20fa6566936 None admin] RBAC: Adding query filter params (group.id=0b31eb75b5d9470997000dd5ce9fa64d, role.id=5fd593d076084fbaa9208dd505b58150, scope.project.id=2937cdbeb750480e8d69fe400d2cca9e) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:02.451941 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1749fa0-ae6f-4b98-8f3d-f20fa6566936 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:02.453533 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1749fa0-ae6f-4b98-8f3d-f20fa6566936 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:02.459830 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 210/447] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Aug 2 08:49:02 2022] GET /identity/v3/role_assignments?group.id=0b31eb75b5d9470997000dd5ce9fa64d&scope.project.id=2937cdbeb750480e8d69fe400d2cca9e&role.id=5fd593d076084fbaa9208dd505b58150 => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:49:02.460725 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1749fa0-ae6f-4b98-8f3d-f20fa6566936 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:02.482981 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b6048-6d2f-4ce3-b809-42c20c4cc6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:02.483761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b6048-6d2f-4ce3-b809-42c20c4cc6bb None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:02.484064 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b6048-6d2f-4ce3-b809-42c20c4cc6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:02.484425 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b6048-6d2f-4ce3-b809-42c20c4cc6bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:02.499818 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b6048-6d2f-4ce3-b809-42c20c4cc6bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:49:02.505383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-e34b6048-6d2f-4ce3-b809-42c20c4cc6bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:49:02.505383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:02.505383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:02.505383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:02.505383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:02.505383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:02.505383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:02.505383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:02.505383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:02.505383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:02.505383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:02.505383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:02.505383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:49:02.505383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:49:02.505383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:49:02.505383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:49:02.506889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:49:02.506889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:49:02.506889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:49:02.506889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:49:02.506889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:02.506889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:02.506889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:02.506889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:02.506889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:02.506889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:02.506889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:02.506889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:02.506889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:02.506889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:02.506889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:02.506889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:02.508457 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:02.508457 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:02.508457 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:02.508457 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:02.508457 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:49:02.508457 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:49:02.508457 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:49:02.508457 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:49:02.508457 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:49:02.508457 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:49:02.508457 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:49:02.508457 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:02.508457 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 238/448] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:49:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:02.513818 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b6048-6d2f-4ce3-b809-42c20c4cc6bb None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:02.579252 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:02.590295 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:02.636437 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1749fa0-ae6f-4b98-8f3d-f20fa6566936 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:02.680490 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b6048-6d2f-4ce3-b809-42c20c4cc6bb None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:02.702917 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0f164-7543-4fc0-b45c-b0777035f960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:02.703889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0f164-7543-4fc0-b45c-b0777035f960 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:02.704574 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0f164-7543-4fc0-b45c-b0777035f960 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:02.704574 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0f164-7543-4fc0-b45c-b0777035f960 None admin] PATH_INFO: `/v3/groups/0b31eb75b5d9470997000dd5ce9fa64d` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:02.706148 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0f164-7543-4fc0-b45c-b0777035f960 None admin] RBAC: Authorizing `identity:get_group(group_id=0b31eb75b5d9470997000dd5ce9fa64d)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:02.708254 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0f164-7543-4fc0-b45c-b0777035f960 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:02.710638 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 211/449] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Aug 2 08:49:02 2022] GET /identity/v3/groups/0b31eb75b5d9470997000dd5ce9fa64d => generated 226 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:02.722562 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0f164-7543-4fc0-b45c-b0777035f960 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:02.739343 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d7985-7cb6-4264-911d-9c4da02322d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:02.740433 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d7985-7cb6-4264-911d-9c4da02322d2 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:02.740904 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d7985-7cb6-4264-911d-9c4da02322d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:02.741355 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d7985-7cb6-4264-911d-9c4da02322d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:02.742229 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d7985-7cb6-4264-911d-9c4da02322d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:02.742714 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d7985-7cb6-4264-911d-9c4da02322d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:02.745201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d7985-7cb6-4264-911d-9c4da02322d2 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:02.758467 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 239/450] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:49:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:49:02.765443 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d7985-7cb6-4264-911d-9c4da02322d2 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:02.893078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0f164-7543-4fc0-b45c-b0777035f960 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:02.938168 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d7985-7cb6-4264-911d-9c4da02322d2 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:02.942171 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b054b-1e47-429e-b0bf-20abf3d1f98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:02.942816 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b054b-1e47-429e-b0bf-20abf3d1f98f None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:02.943093 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b054b-1e47-429e-b0bf-20abf3d1f98f None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:02.943366 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b054b-1e47-429e-b0bf-20abf3d1f98f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:02.944316 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b054b-1e47-429e-b0bf-20abf3d1f98f None admin] RBAC: Adding query filter params (group.id=0b31eb75b5d9470997000dd5ce9fa64d, role.id=923eb688fccc4e79b6c3df28d754b6c4, scope.project.id=2937cdbeb750480e8d69fe400d2cca9e) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:02.944626 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b054b-1e47-429e-b0bf-20abf3d1f98f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:02.946386 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b054b-1e47-429e-b0bf-20abf3d1f98f None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:02.952729 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:02.954029 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 212/451] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Aug 2 08:49:02 2022] GET /identity/v3/role_assignments?group.id=0b31eb75b5d9470997000dd5ce9fa64d&scope.project.id=2937cdbeb750480e8d69fe400d2cca9e&role.id=923eb688fccc4e79b6c3df28d754b6c4 => generated 611 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:49:03.002192 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bcb5a7-dfa9-4200-9aaa-1e9eb4741616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:03.003291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcb5a7-dfa9-4200-9aaa-1e9eb4741616 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:03.004052 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcb5a7-dfa9-4200-9aaa-1e9eb4741616 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:03.004601 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcb5a7-dfa9-4200-9aaa-1e9eb4741616 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:03.141093 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bcb5a7-dfa9-4200-9aaa-1e9eb4741616 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:03.142937 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bcb5a7-dfa9-4200-9aaa-1e9eb4741616 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:03.301078 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 240/452] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:49:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:49:03.313151 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b054b-1e47-429e-b0bf-20abf3d1f98f None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:03.317923 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:03.451517 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b054b-1e47-429e-b0bf-20abf3d1f98f None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:03.496664 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0cb018-b24b-48ae-acb2-6254110c5fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:03.497766 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cb018-b24b-48ae-acb2-6254110c5fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:03.498232 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cb018-b24b-48ae-acb2-6254110c5fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:03.498612 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cb018-b24b-48ae-acb2-6254110c5fc2 None admin] PATH_INFO: `/v3/projects/4075c06a81874f9ca4b42e16828b98cd` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:03.499992 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0cb018-b24b-48ae-acb2-6254110c5fc2 None admin] RBAC: Authorizing `identity:get_project(project_id=4075c06a81874f9ca4b42e16828b98cd)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:03.501505 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0cb018-b24b-48ae-acb2-6254110c5fc2 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:03.503622 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 213/453] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:49:03 2022] GET /identity/v3/projects/4075c06a81874f9ca4b42e16828b98cd => generated 344 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:03.513255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bcb5a7-dfa9-4200-9aaa-1e9eb4741616 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:03.521940 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:03.648529 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bcb5a7-dfa9-4200-9aaa-1e9eb4741616 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:03.693170 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a1e19-5f6b-4fc7-9570-d130eb1852e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:03.693828 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a1e19-5f6b-4fc7-9570-d130eb1852e4 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:03.694135 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a1e19-5f6b-4fc7-9570-d130eb1852e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:03.694403 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a1e19-5f6b-4fc7-9570-d130eb1852e4 None admin] PATH_INFO: `/v3/groups/8a06e6a5ce1f4e4187aaf8ff8670cfcc` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:03.695578 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a1e19-5f6b-4fc7-9570-d130eb1852e4 None admin] RBAC: Authorizing `identity:get_group(group_id=8a06e6a5ce1f4e4187aaf8ff8670cfcc)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:03.698309 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a1e19-5f6b-4fc7-9570-d130eb1852e4 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:03.699997 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 241/454] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Aug 2 08:49:03 2022] GET /identity/v3/groups/8a06e6a5ce1f4e4187aaf8ff8670cfcc => generated 229 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:03.706133 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0cb018-b24b-48ae-acb2-6254110c5fc2 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:03.788823 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:03.825673 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0cb018-b24b-48ae-acb2-6254110c5fc2 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:03.864243 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c2c1f-be1f-406f-95e5-da4ae4ed1ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:03.864884 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c2c1f-be1f-406f-95e5-da4ae4ed1ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:03.865165 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c2c1f-be1f-406f-95e5-da4ae4ed1ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:03.865442 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c2c1f-be1f-406f-95e5-da4ae4ed1ef4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:03.866238 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c2c1f-be1f-406f-95e5-da4ae4ed1ef4 None admin] RBAC: Adding query filter params (group.id=8a06e6a5ce1f4e4187aaf8ff8670cfcc, role.id=b5477d3c4e5a4514b64211ec2452d1d8, scope.project.id=4075c06a81874f9ca4b42e16828b98cd) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:03.866545 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c2c1f-be1f-406f-95e5-da4ae4ed1ef4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:03.867997 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c2c1f-be1f-406f-95e5-da4ae4ed1ef4 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:03.876141 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 214/455] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Aug 2 08:49:03 2022] GET /identity/v3/role_assignments?group.id=8a06e6a5ce1f4e4187aaf8ff8670cfcc&scope.project.id=4075c06a81874f9ca4b42e16828b98cd&role.id=b5477d3c4e5a4514b64211ec2452d1d8 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:07.019281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99651e-1cf6-4f76-a3ff-7b6b6a6d73d8 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:07.019281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99651e-1cf6-4f76-a3ff-7b6b6a6d73d8 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:07.019281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99651e-1cf6-4f76-a3ff-7b6b6a6d73d8 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:07.028671 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 242/456] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:07 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:07.038735 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6658a-947c-4883-8590-a809debd919b None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:07.039632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6658a-947c-4883-8590-a809debd919b None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:07.039870 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6658a-947c-4883-8590-a809debd919b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:07.081679 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-09c6658a-947c-4883-8590-a809debd919b None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:07.083876 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-09c6658a-947c-4883-8590-a809debd919b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:07.150402 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87842724-9dca-4019-a79a-b5a5e1359db3 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:07.150965 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87842724-9dca-4019-a79a-b5a5e1359db3 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:07.151213 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87842724-9dca-4019-a79a-b5a5e1359db3 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:07.153624 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 243/457] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:49:07.159989 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfba2da-9ada-4d08-9d22-be344eb9bd6f None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:07.160481 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfba2da-9ada-4d08-9d22-be344eb9bd6f None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:07.160954 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfba2da-9ada-4d08-9d22-be344eb9bd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:07.217855 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-5dfba2da-9ada-4d08-9d22-be344eb9bd6f None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:07.219625 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-5dfba2da-9ada-4d08-9d22-be344eb9bd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:07.239476 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 215/458] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:49:07.351082 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6658a-947c-4883-8590-a809debd919b None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:07.390955 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 244/459] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:49:07.417293 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfba2da-9ada-4d08-9d22-be344eb9bd6f None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:07.423050 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:07.570142 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:07.643227 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfba2da-9ada-4d08-9d22-be344eb9bd6f None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:07.665711 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6658a-947c-4883-8590-a809debd919b None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:07.723911 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f49f1d-b55c-4f12-8529-476788f03382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:07.724667 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f49f1d-b55c-4f12-8529-476788f03382 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:07.725035 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f49f1d-b55c-4f12-8529-476788f03382 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:07.725310 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f49f1d-b55c-4f12-8529-476788f03382 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:07.749368 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e37bd-1fae-4751-9c9e-a5a1a8e23395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:07.750131 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e37bd-1fae-4751-9c9e-a5a1a8e23395 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:07.750408 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e37bd-1fae-4751-9c9e-a5a1a8e23395 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:07.750729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e37bd-1fae-4751-9c9e-a5a1a8e23395 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:07.751915 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f49f1d-b55c-4f12-8529-476788f03382 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:07.756241 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f49f1d-b55c-4f12-8529-476788f03382 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:07.765272 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e37bd-1fae-4751-9c9e-a5a1a8e23395 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:07.766999 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e37bd-1fae-4751-9c9e-a5a1a8e23395 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:07.786625 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-df9e37bd-1fae-4751-9c9e-a5a1a8e23395 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:07.786625 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:07.786625 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:07.786625 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:07.786625 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:07.786625 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:07.786625 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:07.786625 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:07.786625 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:07.786625 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:07.786625 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:07.786625 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:07.786625 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:07.786625 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:07.786625 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:07.788342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:07.788342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:07.788342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:07.788342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:07.788342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:07.788342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:07.788342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:07.788342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:07.788342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:07.788342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:07.788342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:07.788342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:07.788342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:07.788342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:07.788342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:07.788342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:07.788342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:07.790701 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:07.790701 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:07.790701 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:07.790701 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:07.794241 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 216/460] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 438 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:49:07.795751 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22a201-62b9-41e5-89d3-53a126c0eb42 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:07.796034 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22a201-62b9-41e5-89d3-53a126c0eb42 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:07.796330 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22a201-62b9-41e5-89d3-53a126c0eb42 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:07.799477 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 217/461] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:07.800000 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-a0f49f1d-b55c-4f12-8529-476788f03382 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:07.800000 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:07.800000 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:07.800000 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:07.800000 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:07.800000 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:07.800000 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:07.800000 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:07.800000 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:07.800000 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:07.800000 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:07.800000 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:07.800000 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:07.800000 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:07.800000 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:07.801690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:07.801690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:07.801690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:07.801690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:07.801690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:07.801690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:07.801690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:07.801690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:07.801690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:07.801690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:07.801690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:07.801690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:07.801690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:07.801690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:07.801690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:07.801690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:07.801690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:07.803460 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:07.803460 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:07.803460 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:07.803460 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:07.803905 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22a201-62b9-41e5-89d3-53a126c0eb42 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:07.808491 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 245/462] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:07.812277 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56909fec-2915-48d8-8a91-c227dfd10ed0 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:07.813038 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56909fec-2915-48d8-8a91-c227dfd10ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:07.813724 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56909fec-2915-48d8-8a91-c227dfd10ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:07.856865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-56909fec-2915-48d8-8a91-c227dfd10ed0 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:07.859336 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-56909fec-2915-48d8-8a91-c227dfd10ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:07.961982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:07.974283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22a201-62b9-41e5-89d3-53a126c0eb42 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:07.985954 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 246/463] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:49:07.992977 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56909fec-2915-48d8-8a91-c227dfd10ed0 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:08.018972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:08.058997 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe90af-b570-481e-b961-3df76007081d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:08.061114 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe90af-b570-481e-b961-3df76007081d None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:08.061896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe90af-b570-481e-b961-3df76007081d None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:08.062631 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe90af-b570-481e-b961-3df76007081d None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:08.064319 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe90af-b570-481e-b961-3df76007081d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:08.065107 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe90af-b570-481e-b961-3df76007081d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:08.068362 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe90af-b570-481e-b961-3df76007081d None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:08.107079 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 218/464] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:08.109083 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe90af-b570-481e-b961-3df76007081d None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:08.146872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56909fec-2915-48d8-8a91-c227dfd10ed0 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:08.190487 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03f870-cde2-4c4b-82f9-0956f49f16c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:08.191131 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03f870-cde2-4c4b-82f9-0956f49f16c6 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:08.191412 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03f870-cde2-4c4b-82f9-0956f49f16c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:08.191783 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03f870-cde2-4c4b-82f9-0956f49f16c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:08.192536 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03f870-cde2-4c4b-82f9-0956f49f16c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:08.192839 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03f870-cde2-4c4b-82f9-0956f49f16c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:08.194348 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03f870-cde2-4c4b-82f9-0956f49f16c6 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:08.207994 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 247/465] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:08.208865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03f870-cde2-4c4b-82f9-0956f49f16c6 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:08.269530 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:08.329898 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe90af-b570-481e-b961-3df76007081d None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:08.354247 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03f870-cde2-4c4b-82f9-0956f49f16c6 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:08.397195 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5c3b9-79f1-45c3-8ed3-ddd78f1f8df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:08.398161 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5c3b9-79f1-45c3-8ed3-ddd78f1f8df9 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:08.398608 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5c3b9-79f1-45c3-8ed3-ddd78f1f8df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:08.399049 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5c3b9-79f1-45c3-8ed3-ddd78f1f8df9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:08.400599 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff339d44-623c-4717-a3c4-bd82f65f60fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:08.401721 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff339d44-623c-4717-a3c4-bd82f65f60fe None admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:08.402016 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff339d44-623c-4717-a3c4-bd82f65f60fe None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:08.402797 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff339d44-623c-4717-a3c4-bd82f65f60fe None admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:08.403550 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff339d44-623c-4717-a3c4-bd82f65f60fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:08.405424 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff339d44-623c-4717-a3c4-bd82f65f60fe None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:08.411116 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5c3b9-79f1-45c3-8ed3-ddd78f1f8df9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:08.412660 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5c3b9-79f1-45c3-8ed3-ddd78f1f8df9 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:08.432837 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-abf5c3b9-79f1-45c3-8ed3-ddd78f1f8df9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:08.432837 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:08.432837 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:08.432837 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:08.432837 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:08.432837 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:08.432837 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:08.432837 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:08.432837 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:08.432837 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:08.432837 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:08.432837 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:08.432837 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:08.432837 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:08.432837 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:08.434755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:08.434755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:08.434755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:08.434755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:08.434755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:08.434755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:08.434755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:08.434755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:08.434755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:08.434755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:08.434755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:08.434755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:08.434755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:08.434755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:08.434755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:08.434755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:08.434755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:08.436918 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:08.436918 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:08.436918 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:08.436918 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:08.436918 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 219/466] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:08.436918 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275c399-4446-4157-b435-3b273c29d9dc None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:08.436918 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275c399-4446-4157-b435-3b273c29d9dc None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:08.436918 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275c399-4446-4157-b435-3b273c29d9dc None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:08.440665 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 220/467] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:08.440665 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275c399-4446-4157-b435-3b273c29d9dc None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:08.481280 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:08.528218 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 248/468] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Aug 2 08:49:08 2022] POST /identity/v3/users => generated 246 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:49:08.528218 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff339d44-623c-4717-a3c4-bd82f65f60fe None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:08.632420 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275c399-4446-4157-b435-3b273c29d9dc None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:08.705186 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea77ff-d704-4356-9d5b-8bac41e334be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:08.706651 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea77ff-d704-4356-9d5b-8bac41e334be None admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:08.707119 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea77ff-d704-4356-9d5b-8bac41e334be None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:08.707548 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea77ff-d704-4356-9d5b-8bac41e334be None admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:08.709141 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea77ff-d704-4356-9d5b-8bac41e334be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:08.714299 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea77ff-d704-4356-9d5b-8bac41e334be None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:08.740739 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff339d44-623c-4717-a3c4-bd82f65f60fe None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:08.743777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:08.803883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c1344-db5d-4b6c-ace0-907c720ee968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:08.804655 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c1344-db5d-4b6c-ace0-907c720ee968 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:08.804949 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c1344-db5d-4b6c-ace0-907c720ee968 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:08.805202 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c1344-db5d-4b6c-ace0-907c720ee968 None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:08.806005 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c1344-db5d-4b6c-ace0-907c720ee968 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:08.806407 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c1344-db5d-4b6c-ace0-907c720ee968 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:08.807856 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c1344-db5d-4b6c-ace0-907c720ee968 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:08.809269 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 221/469] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Aug 2 08:49:08 2022] POST /identity/v3/users => generated 248 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:49:08.810425 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c242d82-0201-4263-8478-8503dd288981 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:08.814662 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c242d82-0201-4263-8478-8503dd288981 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:08.814662 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c242d82-0201-4263-8478-8503dd288981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:08.823719 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 249/470] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:08.825267 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8f25f-5edf-4e90-9a77-5ec10920df33 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:08.825567 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8f25f-5edf-4e90-9a77-5ec10920df33 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:08.825847 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8f25f-5edf-4e90-9a77-5ec10920df33 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:08.827777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 250/471] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:08.833449 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8f25f-5edf-4e90-9a77-5ec10920df33 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:08.840138 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-3c242d82-0201-4263-8478-8503dd288981 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:08.845397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-3c242d82-0201-4263-8478-8503dd288981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:08.985062 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 222/472] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:49:08.986530 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f68a2f-89ee-4565-990d-7e01ef1ee4b9 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:08.986822 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f68a2f-89ee-4565-990d-7e01ef1ee4b9 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:08.987093 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f68a2f-89ee-4565-990d-7e01ef1ee4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:08.992520 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8f25f-5edf-4e90-9a77-5ec10920df33 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:09.008662 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-a7f68a2f-89ee-4565-990d-7e01ef1ee4b9 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:09.009964 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-a7f68a2f-89ee-4565-990d-7e01ef1ee4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:09.023880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:09.038189 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d7a28-fe46-43e4-b1b5-0f9dc966fb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:09.039779 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d7a28-fe46-43e4-b1b5-0f9dc966fb56 None admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:09.039779 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d7a28-fe46-43e4-b1b5-0f9dc966fb56 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:09.039779 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d7a28-fe46-43e4-b1b5-0f9dc966fb56 None admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:09.041097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d7a28-fe46-43e4-b1b5-0f9dc966fb56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:09.042709 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d7a28-fe46-43e4-b1b5-0f9dc966fb56 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:09.104085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 223/473] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:49:09.105801 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f68a2f-89ee-4565-990d-7e01ef1ee4b9 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:09.147659 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 251/474] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Aug 2 08:49:08 2022] POST /identity/v3/users => generated 248 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:49:09.153580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d7a28-fe46-43e4-b1b5-0f9dc966fb56 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:09.211882 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:09.307979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f68a2f-89ee-4565-990d-7e01ef1ee4b9 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:09.353653 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c68190-4f2e-479e-a007-ea9e381d470f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:09.354352 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c68190-4f2e-479e-a007-ea9e381d470f None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:09.354639 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c68190-4f2e-479e-a007-ea9e381d470f None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:09.354921 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c68190-4f2e-479e-a007-ea9e381d470f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:09.367867 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c68190-4f2e-479e-a007-ea9e381d470f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:09.374949 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c68190-4f2e-479e-a007-ea9e381d470f None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:09.377519 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d7a28-fe46-43e4-b1b5-0f9dc966fb56 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:09.389942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:09.400266 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-49c68190-4f2e-479e-a007-ea9e381d470f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:09.400266 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:09.400266 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:09.400266 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:09.400266 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:09.400266 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:09.400266 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:09.400266 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:09.400266 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:09.400266 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:09.400266 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:09.400266 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:09.400266 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:09.400266 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:09.400266 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:09.403171 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:09.403171 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:09.403171 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:09.403171 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:09.403171 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:09.403171 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:09.403171 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:09.403171 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:09.403171 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:09.403171 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:09.403171 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:09.403171 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:09.403171 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:09.403171 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:09.403171 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:09.403171 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:09.403171 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:09.404277 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:09.404277 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:09.404277 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:09.404277 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:09.404277 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 224/475] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:09.417181 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c68190-4f2e-479e-a007-ea9e381d470f None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:09.473508 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6adb975-de6d-45ad-9501-847a96210d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:09.475940 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adb975-de6d-45ad-9501-847a96210d18 None admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:09.476490 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adb975-de6d-45ad-9501-847a96210d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:09.476995 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adb975-de6d-45ad-9501-847a96210d18 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:09.478426 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6adb975-de6d-45ad-9501-847a96210d18 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:09.480826 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6adb975-de6d-45ad-9501-847a96210d18 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:09.513346 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.sql.core [None req-d6adb975-de6d-45ad-9501-847a96210d18 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 02 08:49:09.513346 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 02 08:49:09.513346 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [parameters: {'id': '3359a1d6ba5d420f9889e3efc865c7fc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 02 08:49:09.513346 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80406) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 02 08:49:09.549335 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-d6adb975-de6d-45ad-9501-847a96210d18 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 02 08:49:09.549335 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:09.549335 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 08:49:09.549335 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 08:49:09.549335 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 08:49:09.549335 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 08:49:09.549335 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 08:49:09.549335 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 08:49:09.549335 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 08:49:09.549335 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application conn.query(q) Aug 02 08:49:09.549335 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 08:49:09.549335 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 08:49:09.549335 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 08:49:09.549335 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application result.read() Aug 02 08:49:09.549335 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 08:49:09.550475 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 08:49:09.550475 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 08:49:09.550475 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 08:49:09.550475 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 08:49:09.550475 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 08:49:09.550475 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 08:49:09.550475 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 08:49:09.550475 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 02 08:49:09.550475 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:09.550475 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 02 08:49:09.550475 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:09.550475 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:09.550475 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 02 08:49:09.550475 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 02 08:49:09.550475 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 02 08:49:09.550475 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return ref.to_dict() Aug 02 08:49:09.550475 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 08:49:09.550475 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application next(self.gen) Aug 02 08:49:09.551597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 02 08:49:09.551597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application yield resource Aug 02 08:49:09.551597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 08:49:09.551597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application next(self.gen) Aug 02 08:49:09.551597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 02 08:49:09.551597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self.session.rollback() Aug 02 08:49:09.551597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 08:49:09.551597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self.force_reraise() Aug 02 08:49:09.551597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 08:49:09.551597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise self.value Aug 02 08:49:09.551597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 02 08:49:09.551597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 02 08:49:09.551597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 02 08:49:09.551597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application session.commit() Aug 02 08:49:09.551597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 02 08:49:09.551597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 02 08:49:09.551597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 02 08:49:09.552777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._prepare_impl() Aug 02 08:49:09.552777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 02 08:49:09.552777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self.session.flush() Aug 02 08:49:09.552777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 02 08:49:09.552777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._flush(objects) Aug 02 08:49:09.552777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 02 08:49:09.552777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 02 08:49:09.552777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 02 08:49:09.552777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application compat.raise_( Aug 02 08:49:09.552777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 08:49:09.552777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception Aug 02 08:49:09.552777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 02 08:49:09.552777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application flush_context.execute() Aug 02 08:49:09.552777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 02 08:49:09.552777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rec.execute(self) Aug 02 08:49:09.552777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 02 08:49:09.552777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 02 08:49:09.554816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 02 08:49:09.554816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 02 08:49:09.554816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 02 08:49:09.554816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 02 08:49:09.554816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 02 08:49:09.554816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 02 08:49:09.554816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 02 08:49:09.554816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 02 08:49:09.554816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 02 08:49:09.554816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 02 08:49:09.554816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 02 08:49:09.554816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 02 08:49:09.554816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 02 08:49:09.554816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 02 08:49:09.554816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 08:49:09.554816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception Aug 02 08:49:09.556687 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 08:49:09.556687 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 08:49:09.556687 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 08:49:09.556687 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 08:49:09.556687 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 08:49:09.556687 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 08:49:09.556687 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 08:49:09.556687 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application conn.query(q) Aug 02 08:49:09.556687 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 08:49:09.556687 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 08:49:09.556687 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 08:49:09.556687 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application result.read() Aug 02 08:49:09.556687 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 08:49:09.556687 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 08:49:09.556687 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 08:49:09.556687 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 08:49:09.557678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 08:49:09.557678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 08:49:09.557678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 08:49:09.557678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 08:49:09.557678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 02 08:49:09.557678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 02 08:49:09.557678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [parameters: {'id': '3359a1d6ba5d420f9889e3efc865c7fc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 02 08:49:09.557678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 02 08:49:09.557678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:09.557678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:49:09.557678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:09.557678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:09.557678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:09.557678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:09.557678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:09.557678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:09.565648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:09.565648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:09.565648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:09.565648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:09.565648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:09.565648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:09.565648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 02 08:49:09.565648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 02 08:49:09.565648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:09.565648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:09.565648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 02 08:49:09.565648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 02 08:49:09.565648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 02 08:49:09.565648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 02 08:49:09.565648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 02 08:49:09.565648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:09.567769 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 252/476] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Aug 2 08:49:09 2022] POST /identity/v3/roles => generated 144 bytes in 399 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:09.567769 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6adb975-de6d-45ad-9501-847a96210d18 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:09.580262 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c68190-4f2e-479e-a007-ea9e381d470f None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:09.673190 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c513636-c2c9-490e-bca0-20c2bc98cce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:09.674268 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c513636-c2c9-490e-bca0-20c2bc98cce7 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:09.674810 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c513636-c2c9-490e-bca0-20c2bc98cce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:09.675296 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c513636-c2c9-490e-bca0-20c2bc98cce7 None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:09.676656 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c513636-c2c9-490e-bca0-20c2bc98cce7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:09.677198 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c513636-c2c9-490e-bca0-20c2bc98cce7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:09.679874 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c513636-c2c9-490e-bca0-20c2bc98cce7 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:09.702209 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:09.709731 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 225/477] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:09.719679 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c513636-c2c9-490e-bca0-20c2bc98cce7 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:09.741267 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6adb975-de6d-45ad-9501-847a96210d18 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:09.845231 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d20393-6bdb-4f0d-b8b9-a1bcd05bf996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:09.846806 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d20393-6bdb-4f0d-b8b9-a1bcd05bf996 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:09.847589 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d20393-6bdb-4f0d-b8b9-a1bcd05bf996 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:09.848355 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d20393-6bdb-4f0d-b8b9-a1bcd05bf996 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:09.869338 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d20393-6bdb-4f0d-b8b9-a1bcd05bf996 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:49:09.879667 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-23d20393-6bdb-4f0d-b8b9-a1bcd05bf996 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:49:09.879667 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:09.879667 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:09.879667 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:09.879667 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:09.879667 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:09.879667 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:09.879667 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:09.879667 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:09.879667 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:09.879667 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:09.879667 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:09.879667 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:49:09.879667 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:49:09.879667 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:49:09.879667 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:49:09.881460 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:49:09.881460 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:49:09.881460 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:49:09.881460 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:49:09.881460 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:09.881460 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:09.881460 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:09.881460 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:09.881460 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:09.881460 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:09.881460 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:09.881460 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:09.881460 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:09.881460 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:09.881460 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:09.881460 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:09.883102 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:09.883102 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:09.883102 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:09.883102 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:09.883102 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:49:09.883102 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:49:09.883102 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:49:09.883102 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:49:09.883102 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:49:09.883102 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:49:09.883102 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:49:09.883102 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:09.888678 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:09.889245 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 253/478] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Aug 2 08:49:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:49:09.905863 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d20393-6bdb-4f0d-b8b9-a1bcd05bf996 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:10.010530 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c513636-c2c9-490e-bca0-20c2bc98cce7 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:10.141257 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c8834-7f1e-469c-83c4-46c8b5dca543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:10.143551 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c8834-7f1e-469c-83c4-46c8b5dca543 None admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:10.144318 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c8834-7f1e-469c-83c4-46c8b5dca543 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:10.145077 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c8834-7f1e-469c-83c4-46c8b5dca543 None admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:10.146536 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c8834-7f1e-469c-83c4-46c8b5dca543 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:10.149452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c8834-7f1e-469c-83c4-46c8b5dca543 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:10.156215 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d20393-6bdb-4f0d-b8b9-a1bcd05bf996 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:10.218026 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a971f-f8ed-4766-995c-f6bda83fe3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:10.219032 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a971f-f8ed-4766-995c-f6bda83fe3fb None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:10.219519 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a971f-f8ed-4766-995c-f6bda83fe3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:10.220002 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a971f-f8ed-4766-995c-f6bda83fe3fb None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:10.221519 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a971f-f8ed-4766-995c-f6bda83fe3fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:10.222058 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a971f-f8ed-4766-995c-f6bda83fe3fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:10.224611 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a971f-f8ed-4766-995c-f6bda83fe3fb None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:10.241546 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 254/479] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:49:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:10.282553 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 226/480] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Aug 2 08:49:09 2022] POST /identity/v3/users => generated 249 bytes in 564 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:49:11.706663 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887e564-1f61-404a-9471-56898c4b3bc4 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:11.707226 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887e564-1f61-404a-9471-56898c4b3bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:11.707330 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887e564-1f61-404a-9471-56898c4b3bc4 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:11.708991 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 255/481] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:11.716203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d3bed-578f-4bf9-925f-4546ed519471 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:11.717140 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d3bed-578f-4bf9-925f-4546ed519471 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:11.717140 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d3bed-578f-4bf9-925f-4546ed519471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:11.742026 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-8b6d3bed-578f-4bf9-925f-4546ed519471 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:11.743647 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-8b6d3bed-578f-4bf9-925f-4546ed519471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:11.852066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 227/482] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:49:11.887096 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887e564-1f61-404a-9471-56898c4b3bc4 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:11.891369 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:11.975588 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23eacc-5001-4228-88ce-43f599382ce4 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:11.975944 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23eacc-5001-4228-88ce-43f599382ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:11.976141 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23eacc-5001-4228-88ce-43f599382ce4 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:11.978538 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 228/483] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:11.984463 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5a891-ab36-413b-bc13-e480625c78cf None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:11.984783 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5a891-ab36-413b-bc13-e480625c78cf None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:11.985037 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5a891-ab36-413b-bc13-e480625c78cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:12.019051 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-4ff5a891-ab36-413b-bc13-e480625c78cf None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:12.020501 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-4ff5a891-ab36-413b-bc13-e480625c78cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:12.062696 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887e564-1f61-404a-9471-56898c4b3bc4 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:12.090083 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:12.125443 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0576a8e-7321-47df-bd5a-66f2a3b79290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:12.126771 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0576a8e-7321-47df-bd5a-66f2a3b79290 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:12.127264 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0576a8e-7321-47df-bd5a-66f2a3b79290 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:12.128237 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0576a8e-7321-47df-bd5a-66f2a3b79290 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:12.151104 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0576a8e-7321-47df-bd5a-66f2a3b79290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:49:12.159664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-f0576a8e-7321-47df-bd5a-66f2a3b79290 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:12.159664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:12.159664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:12.159664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:12.159664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:12.159664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:12.159664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:12.159664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:12.159664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:12.159664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:12.159664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:12.159664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:12.159664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:49:12.159664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:49:12.159664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:49:12.159664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:49:12.161786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:49:12.161786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:49:12.161786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:49:12.161786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:49:12.161786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:12.161786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:12.161786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:12.161786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:12.161786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:12.161786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:12.161786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:12.161786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:12.161786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:12.161786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:12.161786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:12.161786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:12.162821 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:12.162821 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:12.162821 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:12.162821 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:12.162821 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:49:12.162821 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:49:12.162821 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:49:12.162821 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:49:12.162821 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:49:12.162821 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:49:12.162821 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:12.162821 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:12.162821 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 256/484] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Aug 2 08:49:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:12.166493 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 229/485] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:49:12.172907 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0576a8e-7321-47df-bd5a-66f2a3b79290 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:12.237231 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5a891-ab36-413b-bc13-e480625c78cf None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:12.251944 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:12.387293 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0576a8e-7321-47df-bd5a-66f2a3b79290 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:12.495907 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a37240-2757-4948-90d8-ddf798c45b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:12.496895 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a37240-2757-4948-90d8-ddf798c45b7f None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:12.497392 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a37240-2757-4948-90d8-ddf798c45b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:12.497877 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a37240-2757-4948-90d8-ddf798c45b7f None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:12.499284 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a37240-2757-4948-90d8-ddf798c45b7f None admin] RBAC: Adding query filter params (name=service) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:12.499820 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a37240-2757-4948-90d8-ddf798c45b7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:12.502682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a37240-2757-4948-90d8-ddf798c45b7f None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:12.520923 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 257/486] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Aug 2 08:49:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:12.526520 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a37240-2757-4948-90d8-ddf798c45b7f None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:12.570242 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5a891-ab36-413b-bc13-e480625c78cf None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:12.625531 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73600b-3a92-4d2e-b82b-3d392fad7230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:12.631909 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73600b-3a92-4d2e-b82b-3d392fad7230 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:12.632879 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73600b-3a92-4d2e-b82b-3d392fad7230 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:12.634223 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73600b-3a92-4d2e-b82b-3d392fad7230 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:12.667396 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73600b-3a92-4d2e-b82b-3d392fad7230 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:49:12.679436 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-eb73600b-3a92-4d2e-b82b-3d392fad7230 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:12.679436 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:12.679436 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:12.679436 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:12.679436 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:12.679436 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:12.679436 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:12.679436 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:12.679436 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:12.679436 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:12.679436 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:12.679436 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:12.679436 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:49:12.679436 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:49:12.679436 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:49:12.679436 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:49:12.681847 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:49:12.681847 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:49:12.681847 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:49:12.681847 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:49:12.681847 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:12.681847 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:12.681847 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:12.681847 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:12.681847 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:12.681847 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:12.681847 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:12.681847 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:12.681847 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:12.681847 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:12.681847 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:12.681847 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:12.684494 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:12.684494 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:12.684494 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:12.684494 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:12.684494 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:49:12.684494 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:49:12.684494 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:49:12.684494 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:49:12.684494 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:49:12.684494 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:49:12.684494 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:12.684494 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:12.689187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 230/487] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Aug 2 08:49:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 452 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:49:12.714369 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73600b-3a92-4d2e-b82b-3d392fad7230 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:12.826271 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a37240-2757-4948-90d8-ddf798c45b7f None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:12.836694 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:12.878672 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:12.895168 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd18f1-c3b8-486d-9610-b6d7f7317e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:12.896039 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd18f1-c3b8-486d-9610-b6d7f7317e76 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:12.896399 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd18f1-c3b8-486d-9610-b6d7f7317e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:12.900261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd18f1-c3b8-486d-9610-b6d7f7317e76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:12.914614 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd18f1-c3b8-486d-9610-b6d7f7317e76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:12.917684 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd18f1-c3b8-486d-9610-b6d7f7317e76 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:12.925397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73600b-3a92-4d2e-b82b-3d392fad7230 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:12.950596 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-9ccd18f1-c3b8-486d-9610-b6d7f7317e76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:12.950596 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:12.950596 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:12.950596 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:12.950596 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:12.950596 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:12.950596 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:12.950596 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:12.950596 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:12.950596 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:12.950596 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:12.950596 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:12.950596 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:12.950596 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:12.950596 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:12.951504 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:12.951504 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:12.951504 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:12.951504 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:12.951504 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:12.951504 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:12.951504 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:12.951504 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:12.951504 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:12.951504 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:12.951504 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:12.951504 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:12.951504 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:12.951504 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:12.951504 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:12.951504 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:12.951504 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:12.952434 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:12.952434 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:12.952434 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:12.952434 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:12.954287 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 258/488] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:49:12.955724 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15f7fb-d9de-4bc1-a761-204cfb2f73e3 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:12.956266 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15f7fb-d9de-4bc1-a761-204cfb2f73e3 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:12.956774 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15f7fb-d9de-4bc1-a761-204cfb2f73e3 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:12.960051 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 259/489] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:12.961643 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15f7fb-d9de-4bc1-a761-204cfb2f73e3 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:12.977800 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846802d-32e3-43c1-ae23-cf7a2820b435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:12.978492 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846802d-32e3-43c1-ae23-cf7a2820b435 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:12.978774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846802d-32e3-43c1-ae23-cf7a2820b435 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:12.979775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846802d-32e3-43c1-ae23-cf7a2820b435 None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:12.980806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5846802d-32e3-43c1-ae23-cf7a2820b435 None admin] RBAC: Adding query filter params (name=service) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:12.981123 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5846802d-32e3-43c1-ae23-cf7a2820b435 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:12.982679 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5846802d-32e3-43c1-ae23-cf7a2820b435 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:12.996299 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 231/490] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Aug 2 08:49:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:12.998804 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32d06e-9952-4410-b48f-c29380b80a83 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:12.999315 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32d06e-9952-4410-b48f-c29380b80a83 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:12.999808 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32d06e-9952-4410-b48f-c29380b80a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:13.039258 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-cb32d06e-9952-4410-b48f-c29380b80a83 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:13.042523 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-cb32d06e-9952-4410-b48f-c29380b80a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:13.146364 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15f7fb-d9de-4bc1-a761-204cfb2f73e3 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:13.189489 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 232/491] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:49:13.191154 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32d06e-9952-4410-b48f-c29380b80a83 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:13.197404 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f307e25-1a66-46d6-b070-e6b10950ae9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:13.198320 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f307e25-1a66-46d6-b070-e6b10950ae9c None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:13.198862 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f307e25-1a66-46d6-b070-e6b10950ae9c None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:13.199363 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f307e25-1a66-46d6-b070-e6b10950ae9c None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:13.200300 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f307e25-1a66-46d6-b070-e6b10950ae9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:13.200610 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f307e25-1a66-46d6-b070-e6b10950ae9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:13.203499 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f307e25-1a66-46d6-b070-e6b10950ae9c None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:13.220498 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 260/492] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:49:13.229324 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f307e25-1a66-46d6-b070-e6b10950ae9c None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:13.281226 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:13.312389 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:13.394674 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32d06e-9952-4410-b48f-c29380b80a83 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:13.436629 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f307e25-1a66-46d6-b070-e6b10950ae9c None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:13.439906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37908f1c-43c0-4225-b9e5-cfe326d7b4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:13.440723 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37908f1c-43c0-4225-b9e5-cfe326d7b4ec None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:13.441113 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37908f1c-43c0-4225-b9e5-cfe326d7b4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:13.441737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37908f1c-43c0-4225-b9e5-cfe326d7b4ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:13.455054 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37908f1c-43c0-4225-b9e5-cfe326d7b4ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:13.456954 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37908f1c-43c0-4225-b9e5-cfe326d7b4ec None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:13.475755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-37908f1c-43c0-4225-b9e5-cfe326d7b4ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:13.475755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:13.475755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:13.475755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:13.475755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:13.475755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:13.475755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:13.475755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:13.475755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:13.475755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:13.475755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:13.475755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:13.475755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:13.475755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:13.475755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:13.476717 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:13.476717 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:13.476717 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:13.476717 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:13.476717 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:13.476717 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:13.476717 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:13.476717 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:13.476717 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:13.476717 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:13.476717 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:13.476717 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:13.476717 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:13.476717 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:13.476717 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:13.476717 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:13.476717 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:13.477854 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:13.477854 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:13.477854 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:13.477854 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:13.485077 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 233/493] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:13.486430 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37908f1c-43c0-4225-b9e5-cfe326d7b4ec None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:13.509316 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3bb1ef-e163-441c-89a2-a1458822c05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:13.510658 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bb1ef-e163-441c-89a2-a1458822c05b None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:13.511170 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bb1ef-e163-441c-89a2-a1458822c05b None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:13.511734 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bb1ef-e163-441c-89a2-a1458822c05b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:13.528039 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3bb1ef-e163-441c-89a2-a1458822c05b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:13.530844 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3bb1ef-e163-441c-89a2-a1458822c05b None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:13.560175 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-6f3bb1ef-e163-441c-89a2-a1458822c05b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 02 08:49:13.560175 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:13.560175 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:13.560175 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:13.560175 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:13.560175 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:13.560175 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:13.560175 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:13.560175 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:13.560175 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:13.560175 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:13.560175 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:13.560175 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:49:13.560175 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:49:13.560175 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:49:13.560175 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:49:13.562223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:13.562223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:13.562223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:49:13.562223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:13.562223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:49:13.562223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:13.562223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:13.562223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:13.562223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:13.562223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:13.562223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:13.562223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:13.562223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:13.562223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:13.562223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:13.562223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:13.562223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:13.562223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:13.564255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:13.564255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:13.564255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:49:13.564255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:49:13.564255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:49:13.564255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:49:13.564255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:49:13.564255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:49:13.564255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 02 08:49:13.564255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:13.568387 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 261/494] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:49:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:13.572181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3bb1ef-e163-441c-89a2-a1458822c05b None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:13.599514 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:13.629354 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37908f1c-43c0-4225-b9e5-cfe326d7b4ec None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:13.687005 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d990b-5a96-4984-b95e-0161f3b5d9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:13.687936 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d990b-5a96-4984-b95e-0161f3b5d9da None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:13.688429 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d990b-5a96-4984-b95e-0161f3b5d9da None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:13.688884 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d990b-5a96-4984-b95e-0161f3b5d9da None admin] PATH_INFO: `/v3/roles/service` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:13.706123 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d990b-5a96-4984-b95e-0161f3b5d9da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:49:13.716598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-755d990b-5a96-4984-b95e-0161f3b5d9da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:13.716598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:13.716598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:13.716598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:13.716598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:13.716598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:13.716598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:13.716598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:13.716598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:13.716598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:13.716598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:13.716598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:13.716598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:49:13.716598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:49:13.716598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:49:13.716598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:49:13.718539 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:49:13.718539 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:49:13.718539 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:49:13.718539 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:49:13.718539 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:13.718539 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:13.718539 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:13.718539 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:13.718539 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:13.718539 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:13.718539 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:13.718539 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:13.718539 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:13.718539 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:13.718539 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:13.718539 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:13.719543 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:13.719543 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:13.719543 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:13.719543 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:13.719543 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:49:13.719543 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:49:13.719543 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:49:13.719543 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:49:13.719543 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:49:13.719543 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:49:13.719543 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:13.719543 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:13.719543 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 234/495] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Aug 2 08:49:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:13.721185 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0730e47-c5a9-4c82-af64-b64788f55bfb None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:13.721185 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0730e47-c5a9-4c82-af64-b64788f55bfb None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:13.721467 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0730e47-c5a9-4c82-af64-b64788f55bfb None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:13.728232 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 235/496] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:13.728232 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0730e47-c5a9-4c82-af64-b64788f55bfb None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:13.758240 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:13.763879 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3bb1ef-e163-441c-89a2-a1458822c05b None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:13.810010 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6e4fb-d856-4ef3-b5ed-45a37ea04743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:13.810811 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6e4fb-d856-4ef3-b5ed-45a37ea04743 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:13.811225 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6e4fb-d856-4ef3-b5ed-45a37ea04743 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:13.811581 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6e4fb-d856-4ef3-b5ed-45a37ea04743 None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:13.812496 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa6e4fb-d856-4ef3-b5ed-45a37ea04743 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:13.812883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa6e4fb-d856-4ef3-b5ed-45a37ea04743 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:13.814841 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa6e4fb-d856-4ef3-b5ed-45a37ea04743 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:13.831114 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 262/497] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:13.833371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e026312-9ced-4d8c-8620-d9f16dd97eff None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:13.833857 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e026312-9ced-4d8c-8620-d9f16dd97eff None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:13.834336 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e026312-9ced-4d8c-8620-d9f16dd97eff None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:13.837002 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 263/498] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:13.840359 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e026312-9ced-4d8c-8620-d9f16dd97eff None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:13.882483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0730e47-c5a9-4c82-af64-b64788f55bfb None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:13.935542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33471bf-3579-4955-8e64-5d799bc097c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:13.936209 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33471bf-3579-4955-8e64-5d799bc097c2 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:13.936477 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33471bf-3579-4955-8e64-5d799bc097c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:13.936968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33471bf-3579-4955-8e64-5d799bc097c2 None admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:13.937902 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33471bf-3579-4955-8e64-5d799bc097c2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:13.938224 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33471bf-3579-4955-8e64-5d799bc097c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:13.940230 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33471bf-3579-4955-8e64-5d799bc097c2 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:13.960846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:13.986611 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 236/499] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Aug 2 08:49:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:13.989354 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9837d1-41a1-4c16-950b-3f500c641041 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:13.989845 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9837d1-41a1-4c16-950b-3f500c641041 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:13.990335 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9837d1-41a1-4c16-950b-3f500c641041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:14.001347 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e026312-9ced-4d8c-8620-d9f16dd97eff None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:14.020583 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-dc9837d1-41a1-4c16-950b-3f500c641041 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:14.022401 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-dc9837d1-41a1-4c16-950b-3f500c641041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:14.044659 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da20fa1-e3f8-490b-8703-400bd6168154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:14.045303 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da20fa1-e3f8-490b-8703-400bd6168154 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:14.045585 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da20fa1-e3f8-490b-8703-400bd6168154 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:14.045890 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da20fa1-e3f8-490b-8703-400bd6168154 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:14.046623 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da20fa1-e3f8-490b-8703-400bd6168154 None admin] RBAC: Adding query filter params (name=service) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:14.046931 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da20fa1-e3f8-490b-8703-400bd6168154 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:14.048399 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da20fa1-e3f8-490b-8703-400bd6168154 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:14.060609 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 264/500] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Aug 2 08:49:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:14.061557 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da20fa1-e3f8-490b-8703-400bd6168154 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:14.089071 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:14.123477 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 237/501] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:49:14.125661 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8f657-00d0-47ae-8b12-c04586c65648 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:14.126228 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8f657-00d0-47ae-8b12-c04586c65648 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:14.126720 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8f657-00d0-47ae-8b12-c04586c65648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:14.158791 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-8de8f657-00d0-47ae-8b12-c04586c65648 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:14.160939 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-8de8f657-00d0-47ae-8b12-c04586c65648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:14.229471 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da20fa1-e3f8-490b-8703-400bd6168154 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:14.264688 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 238/502] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:49:14.269322 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8f657-00d0-47ae-8b12-c04586c65648 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:14.288205 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ee06e-5ed3-4745-ad88-bca35a3661e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:14.290412 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ee06e-5ed3-4745-ad88-bca35a3661e7 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:14.290857 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ee06e-5ed3-4745-ad88-bca35a3661e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:14.291402 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ee06e-5ed3-4745-ad88-bca35a3661e7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:14.311091 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ee06e-5ed3-4745-ad88-bca35a3661e7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:14.312333 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ee06e-5ed3-4745-ad88-bca35a3661e7 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:14.327815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-580ee06e-5ed3-4745-ad88-bca35a3661e7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:49:14.327815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:14.327815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:14.327815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:14.327815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:14.327815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:14.327815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:14.327815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:14.327815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:14.327815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:14.327815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:14.327815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:14.327815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:49:14.327815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:49:14.327815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:49:14.327815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:49:14.329761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:14.329761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:14.329761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:49:14.329761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:14.329761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:49:14.329761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:14.329761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:14.329761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:14.329761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:14.329761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:14.329761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:14.329761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:14.329761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:14.329761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:14.329761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:14.329761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:14.329761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:14.329761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:14.332116 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:14.332116 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:14.332116 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:49:14.332116 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:49:14.332116 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:49:14.332116 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:49:14.332116 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:49:14.332116 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:49:14.332116 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:49:14.332116 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:14.332116 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 265/503] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Aug 2 08:49:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:14.332116 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ee06e-5ed3-4745-ad88-bca35a3661e7 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:14.356441 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:14.416795 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8f657-00d0-47ae-8b12-c04586c65648 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:14.440712 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:14.457965 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6e32a-6ee6-4cce-83d2-4e7d0e08c871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:14.458725 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6e32a-6ee6-4cce-83d2-4e7d0e08c871 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:14.458877 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6e32a-6ee6-4cce-83d2-4e7d0e08c871 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:14.459153 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6e32a-6ee6-4cce-83d2-4e7d0e08c871 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:14.477010 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ee06e-5ed3-4745-ad88-bca35a3661e7 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:14.520646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea11feb-bf84-454d-b3b7-97cf60b8031d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:14.521254 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea11feb-bf84-454d-b3b7-97cf60b8031d None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:14.521542 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea11feb-bf84-454d-b3b7-97cf60b8031d None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:14.521950 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea11feb-bf84-454d-b3b7-97cf60b8031d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:14.534372 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea11feb-bf84-454d-b3b7-97cf60b8031d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:14.535862 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea11feb-bf84-454d-b3b7-97cf60b8031d None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:14.554061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-aea11feb-bf84-454d-b3b7-97cf60b8031d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:14.554061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:14.554061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:14.554061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:14.554061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:14.554061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:14.554061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:14.554061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:14.554061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:14.554061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:14.554061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:14.554061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:14.554061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:14.554061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:14.554061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:14.556249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:14.556249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:14.556249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:14.556249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:14.556249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:14.556249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:14.556249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:14.556249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:14.556249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:14.556249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:14.556249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:14.556249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:14.556249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:14.556249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:14.556249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:14.556249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:14.556249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:14.557330 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:14.557330 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:14.557330 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:14.557330 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:14.557330 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 266/504] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:14.557330 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea11feb-bf84-454d-b3b7-97cf60b8031d None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:14.562896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6e32a-6ee6-4cce-83d2-4e7d0e08c871 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:14.564627 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6e32a-6ee6-4cce-83d2-4e7d0e08c871 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:14.634774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:14.682473 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea11feb-bf84-454d-b3b7-97cf60b8031d None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:14.706353 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 239/505] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:49:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:49:14.707246 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6e32a-6ee6-4cce-83d2-4e7d0e08c871 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:14.730107 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:14.737997 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e223ea-238d-4bc8-8872-8037464c7be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:14.738974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e223ea-238d-4bc8-8872-8037464c7be6 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:14.739423 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e223ea-238d-4bc8-8872-8037464c7be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:14.739864 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e223ea-238d-4bc8-8872-8037464c7be6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:14.761025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e223ea-238d-4bc8-8872-8037464c7be6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:49:14.766987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-a1e223ea-238d-4bc8-8872-8037464c7be6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:14.766987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:14.766987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:14.766987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:14.766987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:14.766987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:14.766987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:14.766987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:14.766987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:14.766987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:14.766987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:14.766987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:14.766987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:49:14.766987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:49:14.766987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:49:14.766987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:49:14.769109 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:49:14.769109 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:49:14.769109 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:49:14.769109 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:49:14.769109 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:14.769109 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:14.769109 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:14.769109 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:14.769109 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:14.769109 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:14.769109 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:14.769109 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:14.769109 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:14.769109 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:14.769109 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:14.769109 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:14.770948 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:14.770948 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:14.770948 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:14.770948 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:14.770948 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:49:14.770948 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:49:14.770948 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:49:14.770948 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:49:14.770948 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:49:14.770948 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:49:14.770948 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:14.770948 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:14.770948 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 267/506] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Aug 2 08:49:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:14.770948 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e223ea-238d-4bc8-8872-8037464c7be6 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:14.862568 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6e32a-6ee6-4cce-83d2-4e7d0e08c871 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:14.912275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e223ea-238d-4bc8-8872-8037464c7be6 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:14.916744 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec640fb-000a-45d4-9944-63c2f8fd9b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:14.917610 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec640fb-000a-45d4-9944-63c2f8fd9b32 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:14.917610 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec640fb-000a-45d4-9944-63c2f8fd9b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:14.918006 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec640fb-000a-45d4-9944-63c2f8fd9b32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:14.934429 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec640fb-000a-45d4-9944-63c2f8fd9b32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:14.937078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec640fb-000a-45d4-9944-63c2f8fd9b32 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:14.962896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-2ec640fb-000a-45d4-9944-63c2f8fd9b32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:14.962896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:14.962896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:14.962896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:14.962896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:14.962896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:14.962896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:14.962896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:14.962896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:14.962896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:14.962896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:14.962896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:14.962896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:14.962896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:14.962896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:14.964002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:14.964002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:14.964002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:14.964002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:14.964002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:14.964002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:14.964002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:14.964002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:14.964002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:14.964002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:14.964002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:14.964002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:14.964002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:14.964002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:14.964002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:14.964002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:14.964002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:14.965208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:14.965208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:14.965208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:14.965208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:14.965420 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d2bb6-263d-4e1c-ac61-8d673ac1fcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:14.965420 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d2bb6-263d-4e1c-ac61-8d673ac1fcf5 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:14.965420 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d2bb6-263d-4e1c-ac61-8d673ac1fcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:14.965420 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d2bb6-263d-4e1c-ac61-8d673ac1fcf5 None admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:14.965769 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 240/507] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:14.966468 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d2bb6-263d-4e1c-ac61-8d673ac1fcf5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:14.966769 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec640fb-000a-45d4-9944-63c2f8fd9b32 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:14.966968 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d2bb6-263d-4e1c-ac61-8d673ac1fcf5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:14.969534 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d2bb6-263d-4e1c-ac61-8d673ac1fcf5 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:14.986371 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:15.022968 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 268/508] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Aug 2 08:49:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:15.023732 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d2bb6-263d-4e1c-ac61-8d673ac1fcf5 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:15.090616 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:15.118415 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec640fb-000a-45d4-9944-63c2f8fd9b32 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:15.161415 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99dc22-60cb-4745-8efc-0174b918fb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:15.162545 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99dc22-60cb-4745-8efc-0174b918fb29 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:15.163088 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99dc22-60cb-4745-8efc-0174b918fb29 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:15.163542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99dc22-60cb-4745-8efc-0174b918fb29 None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:15.165387 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99dc22-60cb-4745-8efc-0174b918fb29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:15.165738 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99dc22-60cb-4745-8efc-0174b918fb29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:15.168086 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99dc22-60cb-4745-8efc-0174b918fb29 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:15.184492 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d2bb6-263d-4e1c-ac61-8d673ac1fcf5 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:15.194122 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 241/509] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:15.194122 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99dc22-60cb-4745-8efc-0174b918fb29 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:15.233917 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054947af-4fcb-4dbf-8248-3d4a2867b239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:15.234708 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054947af-4fcb-4dbf-8248-3d4a2867b239 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:15.235112 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054947af-4fcb-4dbf-8248-3d4a2867b239 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:15.235498 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054947af-4fcb-4dbf-8248-3d4a2867b239 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:15.250334 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054947af-4fcb-4dbf-8248-3d4a2867b239 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:15.252253 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054947af-4fcb-4dbf-8248-3d4a2867b239 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:15.272753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-054947af-4fcb-4dbf-8248-3d4a2867b239 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:15.272753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:15.272753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:15.272753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:15.272753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:15.272753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:15.272753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:15.272753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:15.272753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:15.272753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:15.272753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:15.272753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:15.272753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:15.272753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:15.272753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:15.275377 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:15.275377 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:15.275377 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:15.275377 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:15.275377 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:15.275377 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:15.275377 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:15.275377 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:15.275377 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:15.275377 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:15.275377 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:15.275377 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:15.275377 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:15.275377 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:15.275377 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:15.275377 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:15.275377 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:15.277856 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:15.277856 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:15.277856 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:15.277856 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:15.277856 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 269/510] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:15.277856 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054947af-4fcb-4dbf-8248-3d4a2867b239 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:15.291947 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:15.338979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99dc22-60cb-4745-8efc-0174b918fb29 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:15.384316 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00c321-5668-4997-ba33-04e5aeb2b088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:15.385120 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00c321-5668-4997-ba33-04e5aeb2b088 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:15.385519 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00c321-5668-4997-ba33-04e5aeb2b088 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:15.385985 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00c321-5668-4997-ba33-04e5aeb2b088 None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:15.387276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00c321-5668-4997-ba33-04e5aeb2b088 None admin] RBAC: Adding query filter params (name=service) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:15.387739 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00c321-5668-4997-ba33-04e5aeb2b088 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:15.390193 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00c321-5668-4997-ba33-04e5aeb2b088 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:15.404529 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 242/511] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Aug 2 08:49:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:15.406033 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00c321-5668-4997-ba33-04e5aeb2b088 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:15.439447 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054947af-4fcb-4dbf-8248-3d4a2867b239 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:15.441693 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:15.490034 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154d991-ad7a-4c1e-a603-3e727a04d238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:15.491100 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154d991-ad7a-4c1e-a603-3e727a04d238 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:15.491553 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154d991-ad7a-4c1e-a603-3e727a04d238 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:15.492034 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154d991-ad7a-4c1e-a603-3e727a04d238 None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:15.493835 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154d991-ad7a-4c1e-a603-3e727a04d238 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:15.494390 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154d991-ad7a-4c1e-a603-3e727a04d238 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:15.497094 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154d991-ad7a-4c1e-a603-3e727a04d238 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:15.519367 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 270/512] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:15.521509 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154d991-ad7a-4c1e-a603-3e727a04d238 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:15.554486 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00c321-5668-4997-ba33-04e5aeb2b088 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:15.599777 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:15.608078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f7011-6306-4ba7-8562-39e9dd7fbd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:15.608885 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f7011-6306-4ba7-8562-39e9dd7fbd18 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:15.610236 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f7011-6306-4ba7-8562-39e9dd7fbd18 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:15.610236 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f7011-6306-4ba7-8562-39e9dd7fbd18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:15.659298 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154d991-ad7a-4c1e-a603-3e727a04d238 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:15.707433 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f7011-6306-4ba7-8562-39e9dd7fbd18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:15.709109 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f7011-6306-4ba7-8562-39e9dd7fbd18 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:15.718561 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7a6f9-840d-44f3-ae43-2f96243973f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:15.719683 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7a6f9-840d-44f3-ae43-2f96243973f9 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:15.720187 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7a6f9-840d-44f3-ae43-2f96243973f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:15.720695 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7a6f9-840d-44f3-ae43-2f96243973f9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:15.736034 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7a6f9-840d-44f3-ae43-2f96243973f9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:15.738883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7a6f9-840d-44f3-ae43-2f96243973f9 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:15.762597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-55f7a6f9-840d-44f3-ae43-2f96243973f9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 08:49:15.762597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:15.762597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:15.762597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:15.762597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:15.762597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:15.762597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:15.762597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:15.762597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:15.762597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:15.762597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:15.762597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:15.762597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:49:15.762597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:49:15.762597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:49:15.762597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:49:15.763754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:15.763754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:15.763754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:49:15.763754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:15.763754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:49:15.763754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:15.763754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:15.763754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:15.763754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:15.763754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:15.763754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:15.763754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:15.763754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:15.763754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:15.763754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:15.763754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:15.763754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:15.763754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:15.764830 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:15.764830 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:15.764830 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:49:15.764830 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:49:15.764830 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:49:15.764830 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:49:15.764830 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:49:15.764830 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:49:15.764830 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 08:49:15.764830 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:15.764830 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 271/513] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:49:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:15.765402 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7a6f9-840d-44f3-ae43-2f96243973f9 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:15.798347 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:15.843761 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 243/514] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:49:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:49:15.843761 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f7011-6306-4ba7-8562-39e9dd7fbd18 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:15.893946 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:15.897419 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7a6f9-840d-44f3-ae43-2f96243973f9 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:15.954567 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b2359-2a52-481e-b21e-05818c0ebd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:15.955631 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b2359-2a52-481e-b21e-05818c0ebd52 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:15.956138 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b2359-2a52-481e-b21e-05818c0ebd52 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:15.956661 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b2359-2a52-481e-b21e-05818c0ebd52 None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:15.957990 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b2359-2a52-481e-b21e-05818c0ebd52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:15.958433 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b2359-2a52-481e-b21e-05818c0ebd52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:15.960848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b2359-2a52-481e-b21e-05818c0ebd52 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:15.979965 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 272/515] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:15.980241 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f7011-6306-4ba7-8562-39e9dd7fbd18 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:15.981286 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b2359-2a52-481e-b21e-05818c0ebd52 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:16.028704 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a55857-8f54-4536-a172-87c461829fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:16.029370 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a55857-8f54-4536-a172-87c461829fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:16.029710 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a55857-8f54-4536-a172-87c461829fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:16.029918 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a55857-8f54-4536-a172-87c461829fc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:16.043037 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a55857-8f54-4536-a172-87c461829fc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:16.044617 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a55857-8f54-4536-a172-87c461829fc9 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:16.061803 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-24a55857-8f54-4536-a172-87c461829fc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:16.061803 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:16.061803 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:16.061803 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:16.061803 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:16.061803 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:16.061803 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:16.061803 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:16.061803 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:16.061803 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:16.061803 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:16.061803 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:16.061803 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:16.061803 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:16.061803 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:16.062899 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:16.062899 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:16.062899 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:16.062899 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:16.062899 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:16.062899 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:16.062899 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:16.062899 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:16.062899 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:16.062899 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:16.062899 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:16.062899 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:16.062899 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:16.062899 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:16.062899 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:16.062899 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:16.062899 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:16.064570 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:16.064570 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:16.064570 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:16.064570 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:16.064570 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 244/516] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:16.064570 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a55857-8f54-4536-a172-87c461829fc9 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:16.140630 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:16.171382 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b2359-2a52-481e-b21e-05818c0ebd52 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:16.185561 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:16.206643 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a55857-8f54-4536-a172-87c461829fc9 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:16.230659 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89c99c-d81b-4164-936e-ac6271acc2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:16.231442 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89c99c-d81b-4164-936e-ac6271acc2e2 None admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:16.231733 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89c99c-d81b-4164-936e-ac6271acc2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:16.232018 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89c99c-d81b-4164-936e-ac6271acc2e2 None admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:16.232799 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d89c99c-d81b-4164-936e-ac6271acc2e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:16.234327 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d89c99c-d81b-4164-936e-ac6271acc2e2 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:16.266450 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05425d6f-6215-4649-9938-1f96cbbe5b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:16.267104 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05425d6f-6215-4649-9938-1f96cbbe5b2a None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:16.267371 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05425d6f-6215-4649-9938-1f96cbbe5b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:16.267767 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05425d6f-6215-4649-9938-1f96cbbe5b2a None admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:16.268512 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05425d6f-6215-4649-9938-1f96cbbe5b2a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:16.268932 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05425d6f-6215-4649-9938-1f96cbbe5b2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:16.270421 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05425d6f-6215-4649-9938-1f96cbbe5b2a None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:16.293547 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 245/517] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Aug 2 08:49:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:16.294629 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05425d6f-6215-4649-9938-1f96cbbe5b2a None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:16.350868 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 273/518] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Aug 2 08:49:15 2022] POST /identity/v3/users => generated 247 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:49:16.351929 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89c99c-d81b-4164-936e-ac6271acc2e2 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:16.467812 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05425d6f-6215-4649-9938-1f96cbbe5b2a None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:16.523865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89c99c-d81b-4164-936e-ac6271acc2e2 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:16.527602 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf37f4-c34f-4ae8-a706-5045ad4e72da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:16.528977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf37f4-c34f-4ae8-a706-5045ad4e72da None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:16.529559 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf37f4-c34f-4ae8-a706-5045ad4e72da None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:16.529793 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf37f4-c34f-4ae8-a706-5045ad4e72da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:16.547774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:16.552031 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf37f4-c34f-4ae8-a706-5045ad4e72da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:16.555042 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf37f4-c34f-4ae8-a706-5045ad4e72da None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:16.576656 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e9866-f786-47d2-9890-874793da7b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:16.577610 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e9866-f786-47d2-9890-874793da7b14 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:16.577968 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e9866-f786-47d2-9890-874793da7b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:16.578238 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e9866-f786-47d2-9890-874793da7b14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:16.586035 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-dccf37f4-c34f-4ae8-a706-5045ad4e72da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:16.586035 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:16.586035 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:16.586035 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:16.586035 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:16.586035 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:16.586035 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:16.586035 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:16.586035 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:16.586035 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:16.586035 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:16.586035 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:16.586035 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:16.586035 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:16.586035 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:16.587846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:16.587846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:16.587846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:16.587846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:16.587846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:16.587846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:16.587846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:16.587846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:16.587846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:16.587846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:16.587846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:16.587846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:16.587846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:16.587846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:16.587846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:16.587846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:16.587846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:16.588719 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:16.588719 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:16.588719 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:16.588719 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:16.589480 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 246/519] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:16.590801 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e9866-f786-47d2-9890-874793da7b14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:16.591021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf37f4-c34f-4ae8-a706-5045ad4e72da None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:16.596226 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e9866-f786-47d2-9890-874793da7b14 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:16.600633 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:16.620872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-c65e9866-f786-47d2-9890-874793da7b14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:16.620872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:16.620872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:16.620872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:16.620872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:16.620872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:16.620872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:16.620872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:16.620872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:16.620872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:16.620872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:16.620872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:16.620872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:49:16.620872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:49:16.620872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:49:16.621982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:49:16.621982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:16.621982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:16.621982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:16.621982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:16.621982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:16.621982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:16.621982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:16.621982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:16.621982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:16.621982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:16.621982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:16.621982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:16.621982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:16.621982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:16.621982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:16.621982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:16.623415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:49:16.623415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:49:16.623415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:49:16.623415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:49:16.623415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:49:16.623415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:49:16.623415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:16.623415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:16.623415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 274/520] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:49:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:16.624432 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e9866-f786-47d2-9890-874793da7b14 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:16.825510 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e9866-f786-47d2-9890-874793da7b14 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:16.852011 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf37f4-c34f-4ae8-a706-5045ad4e72da None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:16.882713 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94883c-09a1-42b0-b991-04e9ed30e0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:16.884960 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94883c-09a1-42b0-b991-04e9ed30e0ac None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:16.885302 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94883c-09a1-42b0-b991-04e9ed30e0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:16.885629 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94883c-09a1-42b0-b991-04e9ed30e0ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:16.938079 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937d2a7-c845-43a9-9d2f-4215c4a2fced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:16.938806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937d2a7-c845-43a9-9d2f-4215c4a2fced None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:16.939164 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937d2a7-c845-43a9-9d2f-4215c4a2fced None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:16.940256 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937d2a7-c845-43a9-9d2f-4215c4a2fced None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:16.941158 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9937d2a7-c845-43a9-9d2f-4215c4a2fced None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:16.941532 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9937d2a7-c845-43a9-9d2f-4215c4a2fced None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:16.943348 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9937d2a7-c845-43a9-9d2f-4215c4a2fced None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:16.965328 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 247/521] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:16.968352 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937d2a7-c845-43a9-9d2f-4215c4a2fced None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:17.050547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:17.061940 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94883c-09a1-42b0-b991-04e9ed30e0ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:17.066736 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94883c-09a1-42b0-b991-04e9ed30e0ac None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:17.078755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:17.155958 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937d2a7-c845-43a9-9d2f-4215c4a2fced None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:17.214316 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a48546-b56a-4f72-b931-48fa3214ac3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:17.215123 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a48546-b56a-4f72-b931-48fa3214ac3e None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:17.215522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a48546-b56a-4f72-b931-48fa3214ac3e None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:17.215916 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a48546-b56a-4f72-b931-48fa3214ac3e None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:17.217047 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a48546-b56a-4f72-b931-48fa3214ac3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:17.219050 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a48546-b56a-4f72-b931-48fa3214ac3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:17.220212 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a48546-b56a-4f72-b931-48fa3214ac3e None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:17.246905 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 248/522] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:17.246905 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a48546-b56a-4f72-b931-48fa3214ac3e None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:17.287060 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 275/523] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:49:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:49:17.287060 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94883c-09a1-42b0-b991-04e9ed30e0ac None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:17.455891 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a48546-b56a-4f72-b931-48fa3214ac3e None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:17.478859 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:17.519898 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0bbe79-ae2e-454f-91b6-915e4fe5be3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:17.520545 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bbe79-ae2e-454f-91b6-915e4fe5be3f None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:17.521051 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bbe79-ae2e-454f-91b6-915e4fe5be3f None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:17.522973 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bbe79-ae2e-454f-91b6-915e4fe5be3f None admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:17.526305 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0bbe79-ae2e-454f-91b6-915e4fe5be3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:17.526980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0bbe79-ae2e-454f-91b6-915e4fe5be3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:17.529814 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0bbe79-ae2e-454f-91b6-915e4fe5be3f None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:17.531058 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:17.537385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94883c-09a1-42b0-b991-04e9ed30e0ac None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:17.565379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 249/524] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:49:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:17.567467 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0bbe79-ae2e-454f-91b6-915e4fe5be3f None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:17.619348 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdcf78-8e38-4aae-9d36-e0cbf2151778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:17.620665 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdcf78-8e38-4aae-9d36-e0cbf2151778 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:17.621171 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdcf78-8e38-4aae-9d36-e0cbf2151778 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:17.621653 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdcf78-8e38-4aae-9d36-e0cbf2151778 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:17.634003 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbdcf78-8e38-4aae-9d36-e0cbf2151778 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:17.636237 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbdcf78-8e38-4aae-9d36-e0cbf2151778 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:17.655269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-6bbdcf78-8e38-4aae-9d36-e0cbf2151778 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 08:49:17.655269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:17.655269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:17.655269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:17.655269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:17.655269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:17.655269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:17.655269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:17.655269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:17.655269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:17.655269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:17.655269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:17.655269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:49:17.655269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:49:17.655269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:49:17.655269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:49:17.657223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:17.657223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:17.657223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:49:17.657223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:17.657223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:49:17.657223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:17.657223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:17.657223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:17.657223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:17.657223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:17.657223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:17.657223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:17.657223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:17.657223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:17.657223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:17.657223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:17.657223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:17.657223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:17.660716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:17.660716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:17.660716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:49:17.660716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:49:17.660716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:49:17.660716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:49:17.660716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:49:17.660716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:49:17.660716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 08:49:17.660716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:17.660716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 276/525] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Aug 2 08:49:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:17.660716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdcf78-8e38-4aae-9d36-e0cbf2151778 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:17.771230 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0bbe79-ae2e-454f-91b6-915e4fe5be3f None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:17.829049 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4348b-007a-48dc-97ee-6109aed0af6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:17.830126 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4348b-007a-48dc-97ee-6109aed0af6c None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:17.830411 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4348b-007a-48dc-97ee-6109aed0af6c None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:17.830686 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4348b-007a-48dc-97ee-6109aed0af6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:17.839561 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4348b-007a-48dc-97ee-6109aed0af6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:17.841119 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4348b-007a-48dc-97ee-6109aed0af6c None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:17.862149 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-50b4348b-007a-48dc-97ee-6109aed0af6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:17.862149 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:17.862149 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:17.862149 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:17.862149 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:17.862149 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:17.862149 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:17.862149 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:17.862149 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:17.862149 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:17.862149 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:17.862149 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:17.862149 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:49:17.862149 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:49:17.862149 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:49:17.863737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:49:17.863737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:17.863737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:17.863737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:17.863737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:17.863737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:17.863737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:17.863737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:17.863737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:17.863737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:17.863737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:17.863737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:17.863737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:17.863737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:17.863737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:17.863737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:17.863737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:17.865428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:49:17.865428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:49:17.865428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:49:17.865428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:49:17.865428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:49:17.865428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:49:17.865428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:17.865428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:17.865428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 250/526] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:49:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:17.868399 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4348b-007a-48dc-97ee-6109aed0af6c None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:17.884402 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdcf78-8e38-4aae-9d36-e0cbf2151778 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:17.921158 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:17.952351 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14915e61-ccd5-4c5b-aa6f-9b77ef257209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:17.953545 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14915e61-ccd5-4c5b-aa6f-9b77ef257209 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:17.954056 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14915e61-ccd5-4c5b-aa6f-9b77ef257209 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:17.954556 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14915e61-ccd5-4c5b-aa6f-9b77ef257209 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:17.977472 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14915e61-ccd5-4c5b-aa6f-9b77ef257209 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:17.980821 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14915e61-ccd5-4c5b-aa6f-9b77ef257209 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:18.011343 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-14915e61-ccd5-4c5b-aa6f-9b77ef257209 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:18.011343 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:18.011343 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:18.011343 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:18.011343 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:18.011343 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:18.011343 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:18.011343 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:18.011343 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:18.011343 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:18.011343 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:18.011343 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:18.011343 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:18.011343 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:18.011343 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:18.013104 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:18.013104 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:18.013104 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:18.013104 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:18.013104 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:18.013104 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:18.013104 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:18.013104 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:18.013104 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:18.013104 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:18.013104 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:18.013104 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:18.013104 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:18.013104 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:18.013104 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:18.013104 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:18.013104 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:18.014786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:18.014786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:18.014786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:18.014786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:18.014786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 277/527] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:18.016404 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14915e61-ccd5-4c5b-aa6f-9b77ef257209 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:18.043452 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:18.064660 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4348b-007a-48dc-97ee-6109aed0af6c None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:18.129141 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934c6fb-6448-41d2-bab8-06c00728406d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:18.131383 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934c6fb-6448-41d2-bab8-06c00728406d None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:18.132925 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934c6fb-6448-41d2-bab8-06c00728406d None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:18.132925 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934c6fb-6448-41d2-bab8-06c00728406d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:18.134796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934c6fb-6448-41d2-bab8-06c00728406d None admin] RBAC: Adding query filter params (role.id=bc21bdc3d9dd4091a04f1e2fef77a8c3, scope.project.id=6910e69702854607889bab124edd60c9, user.id=bca8afe2c10f4db58716aacfd373504b) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:18.135366 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934c6fb-6448-41d2-bab8-06c00728406d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:18.138238 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934c6fb-6448-41d2-bab8-06c00728406d None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:18.149956 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 251/528] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:49:17 2022] GET /identity/v3/role_assignments?user.id=bca8afe2c10f4db58716aacfd373504b&scope.project.id=6910e69702854607889bab124edd60c9&role.id=bc21bdc3d9dd4091a04f1e2fef77a8c3 => generated 259 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:18.151126 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934c6fb-6448-41d2-bab8-06c00728406d None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:18.219199 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14915e61-ccd5-4c5b-aa6f-9b77ef257209 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:18.296992 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487de91d-f702-464e-a88d-48772219db28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:18.298189 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487de91d-f702-464e-a88d-48772219db28 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:18.298720 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487de91d-f702-464e-a88d-48772219db28 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:18.299212 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487de91d-f702-464e-a88d-48772219db28 None admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:18.300416 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487de91d-f702-464e-a88d-48772219db28 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:18.300982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487de91d-f702-464e-a88d-48772219db28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:18.302763 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487de91d-f702-464e-a88d-48772219db28 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:18.339461 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:18.343132 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 278/529] 10.222.0.20 () {56 vars in 1139 bytes} [Tue Aug 2 08:49:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:18.345566 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487de91d-f702-464e-a88d-48772219db28 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:18.347786 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934c6fb-6448-41d2-bab8-06c00728406d None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:18.392508 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587d82e-459a-4375-af3f-6a5cbec3b001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:18.393159 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587d82e-459a-4375-af3f-6a5cbec3b001 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:18.393460 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587d82e-459a-4375-af3f-6a5cbec3b001 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:18.393766 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587d82e-459a-4375-af3f-6a5cbec3b001 None admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:18.394688 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b587d82e-459a-4375-af3f-6a5cbec3b001 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:18.395000 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b587d82e-459a-4375-af3f-6a5cbec3b001 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:18.396591 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b587d82e-459a-4375-af3f-6a5cbec3b001 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:18.410869 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 252/530] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:49:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:18.411743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587d82e-459a-4375-af3f-6a5cbec3b001 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:18.446702 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:18.487358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487de91d-f702-464e-a88d-48772219db28 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:18.535230 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582406d6-377e-4e5f-9001-43dc2f95da81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:18.535877 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582406d6-377e-4e5f-9001-43dc2f95da81 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:18.536184 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582406d6-377e-4e5f-9001-43dc2f95da81 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:18.536472 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582406d6-377e-4e5f-9001-43dc2f95da81 None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:18.537188 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582406d6-377e-4e5f-9001-43dc2f95da81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:18.537499 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582406d6-377e-4e5f-9001-43dc2f95da81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:18.539143 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582406d6-377e-4e5f-9001-43dc2f95da81 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:18.540154 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587d82e-459a-4375-af3f-6a5cbec3b001 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:18.554447 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 279/531] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:18.555727 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582406d6-377e-4e5f-9001-43dc2f95da81 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:18.587091 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf6272-57de-4fff-b70e-f53b4e95c1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:18.588135 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf6272-57de-4fff-b70e-f53b4e95c1f4 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:18.588445 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf6272-57de-4fff-b70e-f53b4e95c1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:18.588720 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf6272-57de-4fff-b70e-f53b4e95c1f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:18.618906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:18.671314 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf6272-57de-4fff-b70e-f53b4e95c1f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:18.673433 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf6272-57de-4fff-b70e-f53b4e95c1f4 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:18.689275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582406d6-377e-4e5f-9001-43dc2f95da81 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:18.723189 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:18.734444 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0fea35-bbf9-4253-9791-09e04de9e368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:18.735091 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0fea35-bbf9-4253-9791-09e04de9e368 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:18.735381 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0fea35-bbf9-4253-9791-09e04de9e368 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:18.735654 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0fea35-bbf9-4253-9791-09e04de9e368 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:18.736489 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0fea35-bbf9-4253-9791-09e04de9e368 None admin] RBAC: Adding query filter params (role.id=bc21bdc3d9dd4091a04f1e2fef77a8c3, scope.project.id=6910e69702854607889bab124edd60c9, user.id=7bfcddefa71546d28078a38325c723a9) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:18.737359 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0fea35-bbf9-4253-9791-09e04de9e368 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:18.738627 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0fea35-bbf9-4253-9791-09e04de9e368 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:18.752901 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 280/532] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:49:18 2022] GET /identity/v3/role_assignments?user.id=7bfcddefa71546d28078a38325c723a9&scope.project.id=6910e69702854607889bab124edd60c9&role.id=bc21bdc3d9dd4091a04f1e2fef77a8c3 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:18.754101 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0fea35-bbf9-4253-9791-09e04de9e368 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:18.798061 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 253/533] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:49:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:49:18.813867 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf6272-57de-4fff-b70e-f53b4e95c1f4 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:18.918130 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:18.939629 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0fea35-bbf9-4253-9791-09e04de9e368 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:18.988242 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1e021-1ea3-4865-9463-0e02c2840b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:18.988941 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1e021-1ea3-4865-9463-0e02c2840b4f None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:18.989220 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1e021-1ea3-4865-9463-0e02c2840b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:18.989496 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1e021-1ea3-4865-9463-0e02c2840b4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:18.998769 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1e021-1ea3-4865-9463-0e02c2840b4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:19.000634 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1e021-1ea3-4865-9463-0e02c2840b4f None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:19.016650 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-25d1e021-1ea3-4865-9463-0e02c2840b4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:19.016650 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:19.016650 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:19.016650 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:19.016650 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:19.016650 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:19.016650 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:19.016650 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:19.016650 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:19.016650 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:19.016650 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:19.016650 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:19.016650 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:49:19.016650 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:49:19.016650 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:49:19.018336 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:49:19.018336 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:19.018336 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:19.018336 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:19.018336 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:19.018336 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:19.018336 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:19.018336 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:19.018336 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:19.018336 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:19.018336 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:19.018336 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:19.018336 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:19.018336 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:19.018336 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:19.018336 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:19.018336 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:19.020033 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:49:19.020033 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:49:19.020033 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:49:19.020033 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:49:19.020033 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:49:19.020033 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:49:19.020033 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:19.020033 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:19.020033 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 281/534] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:49:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:19.025474 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1e021-1ea3-4865-9463-0e02c2840b4f None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:19.085589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf6272-57de-4fff-b70e-f53b4e95c1f4 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:19.101158 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:19.150226 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5316db3-65fb-4a88-ba56-4a9d119322a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:19.151777 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5316db3-65fb-4a88-ba56-4a9d119322a9 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:19.152080 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5316db3-65fb-4a88-ba56-4a9d119322a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:19.152405 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5316db3-65fb-4a88-ba56-4a9d119322a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:19.171282 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5316db3-65fb-4a88-ba56-4a9d119322a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:19.172973 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5316db3-65fb-4a88-ba56-4a9d119322a9 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:19.185973 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1e021-1ea3-4865-9463-0e02c2840b4f None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:19.196094 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-e5316db3-65fb-4a88-ba56-4a9d119322a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:19.196094 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:19.196094 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:19.196094 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:19.196094 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:19.196094 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:19.196094 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:19.196094 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:19.196094 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:19.196094 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:19.196094 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:19.196094 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:19.196094 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:19.196094 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:19.196094 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:19.197251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:19.197251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:19.197251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:19.197251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:19.197251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:19.197251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:19.197251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:19.197251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:19.197251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:19.197251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:19.197251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:19.197251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:19.197251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:19.197251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:19.197251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:19.197251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:19.197251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:19.198101 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:19.198101 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:19.198101 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:19.198101 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:19.204627 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 254/535] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:19.207271 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e30804-5a89-4a01-844e-6832f40281ef None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:19.207688 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e30804-5a89-4a01-844e-6832f40281ef None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:19.208077 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e30804-5a89-4a01-844e-6832f40281ef None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:19.210370 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 255/536] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:19.210976 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e30804-5a89-4a01-844e-6832f40281ef None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:19.272933 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7f45d-9ba2-428c-8dcb-eb1b942278f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:19.275163 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7f45d-9ba2-428c-8dcb-eb1b942278f4 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:19.276019 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7f45d-9ba2-428c-8dcb-eb1b942278f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:19.277700 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7f45d-9ba2-428c-8dcb-eb1b942278f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:19.279594 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7f45d-9ba2-428c-8dcb-eb1b942278f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:19.281510 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7f45d-9ba2-428c-8dcb-eb1b942278f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:19.284855 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7f45d-9ba2-428c-8dcb-eb1b942278f4 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:19.339659 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 282/537] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:49:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:19.339659 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225646bb-8662-4012-b030-d0fdccff9a0c None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:19.339659 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225646bb-8662-4012-b030-d0fdccff9a0c None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:19.339659 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225646bb-8662-4012-b030-d0fdccff9a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:19.367279 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-225646bb-8662-4012-b030-d0fdccff9a0c None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:19.370150 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-225646bb-8662-4012-b030-d0fdccff9a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:19.418595 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e30804-5a89-4a01-844e-6832f40281ef None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:19.431774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:19.472707 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab253f22-d955-4b23-b93c-dee59e046099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:19.473757 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab253f22-d955-4b23-b93c-dee59e046099 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:19.474233 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab253f22-d955-4b23-b93c-dee59e046099 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:19.474705 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab253f22-d955-4b23-b93c-dee59e046099 None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:19.475636 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 283/538] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:49:19.475939 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab253f22-d955-4b23-b93c-dee59e046099 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:19.477025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225646bb-8662-4012-b030-d0fdccff9a0c None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:19.480788 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab253f22-d955-4b23-b93c-dee59e046099 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:19.483518 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab253f22-d955-4b23-b93c-dee59e046099 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:19.535461 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:19.540198 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 256/539] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:19.543085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab253f22-d955-4b23-b93c-dee59e046099 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:19.632624 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225646bb-8662-4012-b030-d0fdccff9a0c None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:19.693173 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a8e4c-6ed4-4508-ad60-fb2778dbfa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:19.693924 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a8e4c-6ed4-4508-ad60-fb2778dbfa5a None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:19.694210 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a8e4c-6ed4-4508-ad60-fb2778dbfa5a None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:19.694488 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a8e4c-6ed4-4508-ad60-fb2778dbfa5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:19.695324 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a8e4c-6ed4-4508-ad60-fb2778dbfa5a None admin] RBAC: Adding query filter params (role.id=bc21bdc3d9dd4091a04f1e2fef77a8c3, scope.project.id=6910e69702854607889bab124edd60c9, user.id=ada53ed554844560843ab84198ac373c) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:19.695790 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a8e4c-6ed4-4508-ad60-fb2778dbfa5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:19.697688 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a8e4c-6ed4-4508-ad60-fb2778dbfa5a None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:19.705106 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 284/540] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:49:19 2022] GET /identity/v3/role_assignments?user.id=ada53ed554844560843ab84198ac373c&scope.project.id=6910e69702854607889bab124edd60c9&role.id=bc21bdc3d9dd4091a04f1e2fef77a8c3 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:19.706191 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a8e4c-6ed4-4508-ad60-fb2778dbfa5a None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:19.770502 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab253f22-d955-4b23-b93c-dee59e046099 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:19.841266 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a8e4c-6ed4-4508-ad60-fb2778dbfa5a None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:19.857051 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:19.896313 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9f919-db29-48fa-8687-d73810b7fe06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:19.897595 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb08d9f-c420-449c-abd3-7737b4aad9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:19.898264 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb08d9f-c420-449c-abd3-7737b4aad9a4 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:19.898534 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb08d9f-c420-449c-abd3-7737b4aad9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:19.899019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb08d9f-c420-449c-abd3-7737b4aad9a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:19.899813 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9f919-db29-48fa-8687-d73810b7fe06 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:19.900264 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9f919-db29-48fa-8687-d73810b7fe06 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:19.900541 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9f919-db29-48fa-8687-d73810b7fe06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:19.918324 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb08d9f-c420-449c-abd3-7737b4aad9a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:49:19.924610 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-dfb08d9f-c420-449c-abd3-7737b4aad9a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:19.924610 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:19.924610 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:19.924610 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:19.924610 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:19.924610 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:19.924610 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:19.924610 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:19.924610 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:19.924610 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:19.924610 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:19.924610 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:19.924610 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:49:19.924610 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:49:19.924610 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:49:19.924610 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:49:19.926398 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:49:19.926398 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:49:19.926398 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:49:19.926398 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:49:19.926398 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:19.926398 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:19.926398 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:19.926398 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:19.926398 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:19.926398 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:19.926398 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:19.926398 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:19.926398 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:19.926398 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:19.926398 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:19.926398 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:19.927895 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:19.927895 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:19.927895 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:19.927895 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:19.927895 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:49:19.927895 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:49:19.927895 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:49:19.927895 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:49:19.927895 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:49:19.927895 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:49:19.927895 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:19.927895 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:19.929175 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9f919-db29-48fa-8687-d73810b7fe06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:19.929340 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 257/541] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Aug 2 08:49:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:19.929464 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9f919-db29-48fa-8687-d73810b7fe06 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:19.933882 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb08d9f-c420-449c-abd3-7737b4aad9a4 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:19.956731 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-ecf9f919-db29-48fa-8687-d73810b7fe06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:19.956731 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:19.956731 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:19.956731 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:19.956731 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:19.956731 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:19.956731 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:19.956731 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:19.956731 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:19.956731 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:19.956731 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:19.956731 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:19.956731 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:49:19.956731 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:49:19.956731 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:49:19.958478 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:49:19.958478 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:19.958478 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:19.958478 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:19.958478 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:19.958478 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:19.958478 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:19.958478 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:19.958478 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:19.958478 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:19.958478 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:19.958478 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:19.958478 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:19.958478 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:19.958478 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:19.958478 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:19.958478 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:19.961515 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:49:19.961515 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:49:19.961515 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:49:19.961515 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:49:19.961515 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:49:19.961515 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:49:19.961515 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:19.961515 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:19.961515 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 285/542] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:49:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:19.977731 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9f919-db29-48fa-8687-d73810b7fe06 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:20.009932 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:20.159887 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9f919-db29-48fa-8687-d73810b7fe06 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:20.182470 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb08d9f-c420-449c-abd3-7737b4aad9a4 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:20.200997 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24becbbf-b6c0-4db0-ae33-59427e864bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:20.201814 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24becbbf-b6c0-4db0-ae33-59427e864bea None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:20.202107 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24becbbf-b6c0-4db0-ae33-59427e864bea None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:20.202390 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24becbbf-b6c0-4db0-ae33-59427e864bea None admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:20.203162 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24becbbf-b6c0-4db0-ae33-59427e864bea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:20.203471 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24becbbf-b6c0-4db0-ae33-59427e864bea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:20.205463 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24becbbf-b6c0-4db0-ae33-59427e864bea None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:20.222001 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 286/543] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:49:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:49:20.229298 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24becbbf-b6c0-4db0-ae33-59427e864bea None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:20.263959 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:20.267930 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a113d-261c-4c99-b154-59530f136835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:20.270233 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a113d-261c-4c99-b154-59530f136835 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:20.271538 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a113d-261c-4c99-b154-59530f136835 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:20.272761 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a113d-261c-4c99-b154-59530f136835 None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:20.280432 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a113d-261c-4c99-b154-59530f136835 None admin] RBAC: Adding query filter params (name=service) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:20.280432 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a113d-261c-4c99-b154-59530f136835 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:20.282048 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a113d-261c-4c99-b154-59530f136835 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:20.309155 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 258/544] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Aug 2 08:49:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:20.311464 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a113d-261c-4c99-b154-59530f136835 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:20.423176 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24becbbf-b6c0-4db0-ae33-59427e864bea None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:20.534642 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312188d-46c7-4d04-976a-c6e46dd5343d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:20.537193 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312188d-46c7-4d04-976a-c6e46dd5343d None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:20.537566 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312188d-46c7-4d04-976a-c6e46dd5343d None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:20.537844 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312188d-46c7-4d04-976a-c6e46dd5343d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:20.538569 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:20.538732 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312188d-46c7-4d04-976a-c6e46dd5343d None admin] RBAC: Adding query filter params (role.id=bc21bdc3d9dd4091a04f1e2fef77a8c3, scope.project.id=6910e69702854607889bab124edd60c9, user.id=6128f07ffd5f4357968b0e2e300f2e09) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:20.538997 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312188d-46c7-4d04-976a-c6e46dd5343d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:20.541586 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312188d-46c7-4d04-976a-c6e46dd5343d None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:20.552953 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a113d-261c-4c99-b154-59530f136835 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:20.566356 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 287/545] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:49:20 2022] GET /identity/v3/role_assignments?user.id=6128f07ffd5f4357968b0e2e300f2e09&scope.project.id=6910e69702854607889bab124edd60c9&role.id=bc21bdc3d9dd4091a04f1e2fef77a8c3 => generated 259 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:49:20.625298 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92048d-ebad-4314-b9c9-85e33c630961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:20.625997 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92048d-ebad-4314-b9c9-85e33c630961 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:20.626277 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92048d-ebad-4314-b9c9-85e33c630961 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:20.626544 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92048d-ebad-4314-b9c9-85e33c630961 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:20.646994 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92048d-ebad-4314-b9c9-85e33c630961 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:20.649275 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92048d-ebad-4314-b9c9-85e33c630961 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:20.676840 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-1a92048d-ebad-4314-b9c9-85e33c630961 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:20.676840 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:20.676840 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:20.676840 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:20.676840 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:20.676840 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:20.676840 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:20.676840 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:20.676840 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:20.676840 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:20.676840 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:20.676840 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:20.676840 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:20.676840 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:20.676840 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:20.678414 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:20.678414 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:20.678414 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:20.678414 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:20.678414 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:20.678414 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:20.678414 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:20.678414 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:20.678414 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:20.678414 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:20.678414 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:20.678414 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:20.678414 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:20.678414 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:20.678414 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:20.678414 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:20.678414 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:20.680961 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:20.680961 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:20.680961 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:20.680961 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:20.680961 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 259/546] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:20.684046 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312188d-46c7-4d04-976a-c6e46dd5343d None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:20.831225 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:20.843810 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312188d-46c7-4d04-976a-c6e46dd5343d None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:20.909190 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdef22-32d4-4d21-aa2a-89115ef1d57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:20.910732 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdef22-32d4-4d21-aa2a-89115ef1d57d None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:20.911517 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdef22-32d4-4d21-aa2a-89115ef1d57d None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:20.912314 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdef22-32d4-4d21-aa2a-89115ef1d57d None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:20.913919 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bdef22-32d4-4d21-aa2a-89115ef1d57d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:20.915466 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bdef22-32d4-4d21-aa2a-89115ef1d57d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:20.916768 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845fea3-009d-4cba-8754-1cae958a2d2e None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:20.917057 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845fea3-009d-4cba-8754-1cae958a2d2e None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:20.917329 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845fea3-009d-4cba-8754-1cae958a2d2e None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:20.919019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 260/547] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:20.919783 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bdef22-32d4-4d21-aa2a-89115ef1d57d None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:20.924636 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432a692-72cc-44a9-ab4d-75e889971f08 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:20.924978 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432a692-72cc-44a9-ab4d-75e889971f08 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:20.925171 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432a692-72cc-44a9-ab4d-75e889971f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:20.945356 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 288/548] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:20.952229 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdef22-32d4-4d21-aa2a-89115ef1d57d None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:20.953598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-4432a692-72cc-44a9-ab4d-75e889971f08 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:20.954832 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-4432a692-72cc-44a9-ab4d-75e889971f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:21.108513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 261/549] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:49:21.144034 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdef22-32d4-4d21-aa2a-89115ef1d57d None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:21.158571 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432a692-72cc-44a9-ab4d-75e889971f08 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:21.212328 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d35558-bf08-4882-96e4-7be11af3a4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:21.214502 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d35558-bf08-4882-96e4-7be11af3a4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:21.216144 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d35558-bf08-4882-96e4-7be11af3a4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:21.216797 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d35558-bf08-4882-96e4-7be11af3a4c6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:21.234141 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d35558-bf08-4882-96e4-7be11af3a4c6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:21.239177 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d35558-bf08-4882-96e4-7be11af3a4c6 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:21.263553 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-b3d35558-bf08-4882-96e4-7be11af3a4c6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:49:21.263553 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:21.263553 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:21.263553 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:21.263553 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:21.263553 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:21.263553 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:21.263553 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:21.263553 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:21.263553 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:21.263553 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:21.263553 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:21.263553 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:49:21.263553 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:49:21.263553 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:49:21.263553 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:49:21.264716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:21.264716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:21.264716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:49:21.264716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:21.264716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:49:21.264716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:21.264716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:21.264716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:21.264716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:21.264716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:21.264716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:21.264716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:21.264716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:21.264716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:21.264716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:21.264716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:21.264716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:21.264716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:21.265885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:21.265885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:21.265885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:49:21.265885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:49:21.265885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:49:21.265885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:49:21.265885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:49:21.265885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:49:21.265885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:49:21.265885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:21.287881 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 289/550] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:49:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:21.290967 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d35558-bf08-4882-96e4-7be11af3a4c6 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:21.317932 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:21.335039 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:21.401780 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432a692-72cc-44a9-ab4d-75e889971f08 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:21.467508 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49599b31-6607-45bf-b0f2-4e43b1bfc8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:21.468694 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49599b31-6607-45bf-b0f2-4e43b1bfc8c9 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:21.469195 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49599b31-6607-45bf-b0f2-4e43b1bfc8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:21.469796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49599b31-6607-45bf-b0f2-4e43b1bfc8c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:21.492564 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49599b31-6607-45bf-b0f2-4e43b1bfc8c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:49:21.499942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-49599b31-6607-45bf-b0f2-4e43b1bfc8c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:21.499942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:21.499942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:21.499942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:21.499942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:21.499942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:21.499942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:21.499942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:21.499942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:21.499942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:21.499942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:21.499942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:21.499942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:49:21.499942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:49:21.499942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:49:21.499942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:49:21.500916 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:49:21.500916 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:49:21.500916 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:49:21.500916 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:49:21.500916 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:21.500916 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:21.500916 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:21.500916 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:21.500916 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:21.500916 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:21.500916 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:21.500916 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:21.500916 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:21.500916 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:21.500916 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:21.500916 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:21.501869 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:21.501869 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:21.501869 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:21.501869 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:21.501869 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:49:21.501869 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:49:21.501869 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:49:21.501869 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:49:21.501869 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:49:21.501869 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:49:21.501869 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:21.501869 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:21.517782 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 262/551] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Aug 2 08:49:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:49:21.521535 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49599b31-6607-45bf-b0f2-4e43b1bfc8c9 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:21.545025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d35558-bf08-4882-96e4-7be11af3a4c6 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:21.635718 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ced1a4-2b19-4f03-9d45-a3fa39408537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:21.636547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ced1a4-2b19-4f03-9d45-a3fa39408537 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:21.636836 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ced1a4-2b19-4f03-9d45-a3fa39408537 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:21.637157 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ced1a4-2b19-4f03-9d45-a3fa39408537 None admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:21.638180 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ced1a4-2b19-4f03-9d45-a3fa39408537 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:21.638496 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ced1a4-2b19-4f03-9d45-a3fa39408537 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:21.640074 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ced1a4-2b19-4f03-9d45-a3fa39408537 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:21.681401 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 290/552] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Aug 2 08:49:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:21.686827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ced1a4-2b19-4f03-9d45-a3fa39408537 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:21.723489 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49599b31-6607-45bf-b0f2-4e43b1bfc8c9 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:21.764348 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:21.789086 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3766337-a685-4ed4-83b8-924744af0d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:21.789835 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3766337-a685-4ed4-83b8-924744af0d18 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:21.790094 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3766337-a685-4ed4-83b8-924744af0d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:21.790732 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3766337-a685-4ed4-83b8-924744af0d18 None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:21.791303 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3766337-a685-4ed4-83b8-924744af0d18 None admin] RBAC: Adding query filter params (name=service) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:21.791621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3766337-a685-4ed4-83b8-924744af0d18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:21.793226 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3766337-a685-4ed4-83b8-924744af0d18 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:21.808284 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 263/553] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Aug 2 08:49:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:21.810584 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc878a54-e883-42e1-9361-78f4a0da7c2b None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:21.811092 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc878a54-e883-42e1-9361-78f4a0da7c2b None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:21.811388 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc878a54-e883-42e1-9361-78f4a0da7c2b None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:21.813182 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 264/554] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:21.818153 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc878a54-e883-42e1-9361-78f4a0da7c2b None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:21.828670 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:21.869413 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ced1a4-2b19-4f03-9d45-a3fa39408537 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:21.919394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fd66a-7def-4daf-bf1d-d31eb6e8c8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:21.920549 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fd66a-7def-4daf-bf1d-d31eb6e8c8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:21.921064 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fd66a-7def-4daf-bf1d-d31eb6e8c8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:21.922391 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fd66a-7def-4daf-bf1d-d31eb6e8c8e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:21.985569 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc878a54-e883-42e1-9361-78f4a0da7c2b None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:22.015957 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603fd66a-7def-4daf-bf1d-d31eb6e8c8e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:22.018547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603fd66a-7def-4daf-bf1d-d31eb6e8c8e0 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:22.049505 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf15b8-5a12-4f8c-8ca4-4b06527550dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:22.050542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf15b8-5a12-4f8c-8ca4-4b06527550dd None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:22.051077 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf15b8-5a12-4f8c-8ca4-4b06527550dd None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:22.051503 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf15b8-5a12-4f8c-8ca4-4b06527550dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:22.064563 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf15b8-5a12-4f8c-8ca4-4b06527550dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:22.066391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf15b8-5a12-4f8c-8ca4-4b06527550dd None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:22.085875 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-64bf15b8-5a12-4f8c-8ca4-4b06527550dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:22.085875 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:22.085875 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:22.085875 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:22.085875 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:22.085875 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:22.085875 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:22.085875 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:22.085875 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:22.085875 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:22.085875 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:22.085875 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:22.085875 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:22.085875 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:22.085875 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:22.088241 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:22.088241 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:22.088241 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:22.088241 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:22.088241 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:22.088241 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:22.088241 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:22.088241 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:22.088241 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:22.088241 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:22.088241 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:22.088241 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:22.088241 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:22.088241 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:22.088241 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:22.088241 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:22.088241 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:22.090009 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:22.090009 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:22.090009 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:22.090009 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:22.093083 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 265/555] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:22.094853 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0c3a1-c9d3-44a2-b4a3-f218edb7cce3 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:22.095178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0c3a1-c9d3-44a2-b4a3-f218edb7cce3 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:22.095449 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0c3a1-c9d3-44a2-b4a3-f218edb7cce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:22.121487 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-a7d0c3a1-c9d3-44a2-b4a3-f218edb7cce3 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:22.124451 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-a7d0c3a1-c9d3-44a2-b4a3-f218edb7cce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:22.148406 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:22.195271 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 291/556] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:49:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:49:22.196383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fd66a-7def-4daf-bf1d-d31eb6e8c8e0 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:22.234352 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:22.302636 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 266/557] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:49:22.307019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0c3a1-c9d3-44a2-b4a3-f218edb7cce3 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:22.359634 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fd66a-7def-4daf-bf1d-d31eb6e8c8e0 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:22.411866 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2778ff9-8417-47c1-a8dd-432a3b4f2f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:22.413372 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2778ff9-8417-47c1-a8dd-432a3b4f2f7a None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:22.415368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2778ff9-8417-47c1-a8dd-432a3b4f2f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:22.416105 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2778ff9-8417-47c1-a8dd-432a3b4f2f7a None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:22.418805 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2778ff9-8417-47c1-a8dd-432a3b4f2f7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:22.419631 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2778ff9-8417-47c1-a8dd-432a3b4f2f7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:22.423735 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2778ff9-8417-47c1-a8dd-432a3b4f2f7a None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:22.451519 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 292/558] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:22.452711 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2778ff9-8417-47c1-a8dd-432a3b4f2f7a None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:22.512426 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0c3a1-c9d3-44a2-b4a3-f218edb7cce3 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:22.515060 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:22.564248 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071f13b-e32e-475a-bff0-47bb1f3e9ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:22.564890 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071f13b-e32e-475a-bff0-47bb1f3e9ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:22.565191 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071f13b-e32e-475a-bff0-47bb1f3e9ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:22.565502 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071f13b-e32e-475a-bff0-47bb1f3e9ec1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:22.585605 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071f13b-e32e-475a-bff0-47bb1f3e9ec1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:22.591233 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071f13b-e32e-475a-bff0-47bb1f3e9ec1 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:22.616116 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-7071f13b-e32e-475a-bff0-47bb1f3e9ec1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:22.616116 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:22.616116 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:22.616116 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:22.616116 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:22.616116 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:22.616116 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:22.616116 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:22.616116 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:22.616116 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:22.616116 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:22.616116 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:22.616116 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:22.616116 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:22.616116 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:22.619178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:22.619178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:22.619178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:22.619178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:22.619178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:22.619178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:22.619178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:22.619178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:22.619178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:22.619178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:22.619178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:22.619178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:22.619178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:22.619178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:22.619178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:22.619178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:22.619178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:22.621190 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:22.621190 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:22.621190 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:22.621190 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:22.621190 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 267/559] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:22.621190 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071f13b-e32e-475a-bff0-47bb1f3e9ec1 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:22.663471 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2778ff9-8417-47c1-a8dd-432a3b4f2f7a None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:22.691913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:22.715031 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5942d1-1811-4231-872d-e8e330b3506a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:22.715851 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5942d1-1811-4231-872d-e8e330b3506a None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:22.716318 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5942d1-1811-4231-872d-e8e330b3506a None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:22.716615 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5942d1-1811-4231-872d-e8e330b3506a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:22.741003 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5942d1-1811-4231-872d-e8e330b3506a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:49:22.752930 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-fe5942d1-1811-4231-872d-e8e330b3506a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:22.752930 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:22.752930 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:22.752930 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:22.752930 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:22.752930 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:22.752930 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:22.752930 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:22.752930 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:22.752930 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:22.752930 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:22.752930 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:22.752930 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:49:22.752930 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:49:22.752930 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:49:22.752930 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:49:22.755025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:49:22.755025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:49:22.755025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:49:22.755025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:49:22.755025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:22.755025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:22.755025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:22.755025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:22.755025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:22.755025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:22.755025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:22.755025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:22.755025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:22.755025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:22.755025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:22.755025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:22.756865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:22.756865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:22.756865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:22.756865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:22.756865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:49:22.756865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:49:22.756865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:49:22.756865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:49:22.756865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:49:22.756865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:49:22.756865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:22.756865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:22.761794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 293/560] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Aug 2 08:49:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:22.763581 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5942d1-1811-4231-872d-e8e330b3506a None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:22.811050 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071f13b-e32e-475a-bff0-47bb1f3e9ec1 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:22.851975 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f553c2-71ab-47da-af82-b7df22f41f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:22.852348 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f553c2-71ab-47da-af82-b7df22f41f81 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:22.852348 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f553c2-71ab-47da-af82-b7df22f41f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:22.852676 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f553c2-71ab-47da-af82-b7df22f41f81 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:22.862024 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f553c2-71ab-47da-af82-b7df22f41f81 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:22.863458 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f553c2-71ab-47da-af82-b7df22f41f81 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:22.879774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-82f553c2-71ab-47da-af82-b7df22f41f81 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 02 08:49:22.879774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:22.879774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:22.879774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:22.879774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:22.879774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:22.879774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:22.879774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:22.879774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:22.879774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:22.879774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:22.879774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:22.879774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:49:22.879774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:49:22.879774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:49:22.879774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:49:22.881749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:22.881749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:22.881749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:49:22.881749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:22.881749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:49:22.881749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:22.881749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:22.881749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:22.881749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:22.881749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:22.881749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:22.881749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:22.881749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:22.881749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:22.881749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:22.881749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:22.881749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:22.881749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:22.887670 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:22.887670 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:22.887670 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:49:22.887670 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:49:22.887670 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:49:22.887670 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:49:22.887670 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:49:22.887670 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:49:22.887670 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 02 08:49:22.887670 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:22.887670 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 268/561] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:49:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:22.887670 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f553c2-71ab-47da-af82-b7df22f41f81 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:22.940111 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:22.954874 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5942d1-1811-4231-872d-e8e330b3506a None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:23.020480 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f977e3d-da1d-47a0-9c18-44991663d2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:23.022016 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f977e3d-da1d-47a0-9c18-44991663d2a4 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:23.022893 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f977e3d-da1d-47a0-9c18-44991663d2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:23.024194 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f977e3d-da1d-47a0-9c18-44991663d2a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:23.025624 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f977e3d-da1d-47a0-9c18-44991663d2a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:23.026217 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f977e3d-da1d-47a0-9c18-44991663d2a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:23.029088 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f977e3d-da1d-47a0-9c18-44991663d2a4 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:23.038133 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:23.052879 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 294/562] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:23.055828 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cd4cd-c3a1-4af6-bff4-e6728ed3c25e None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:23.056463 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cd4cd-c3a1-4af6-bff4-e6728ed3c25e None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:23.056962 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cd4cd-c3a1-4af6-bff4-e6728ed3c25e None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:23.063543 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 295/563] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:23.063543 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cd4cd-c3a1-4af6-bff4-e6728ed3c25e None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:23.069885 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f553c2-71ab-47da-af82-b7df22f41f81 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:23.115250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e64094-4a8a-4868-ab6c-b7b3c8fe92bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:23.115788 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e64094-4a8a-4868-ab6c-b7b3c8fe92bc None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:23.116075 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e64094-4a8a-4868-ab6c-b7b3c8fe92bc None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:23.116388 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e64094-4a8a-4868-ab6c-b7b3c8fe92bc None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:23.117129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e64094-4a8a-4868-ab6c-b7b3c8fe92bc None admin] RBAC: Adding query filter params (name=service) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:23.118394 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e64094-4a8a-4868-ab6c-b7b3c8fe92bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:23.119469 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e64094-4a8a-4868-ab6c-b7b3c8fe92bc None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:23.136367 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 269/564] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Aug 2 08:49:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:23.136367 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e64094-4a8a-4868-ab6c-b7b3c8fe92bc None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:23.239139 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cd4cd-c3a1-4af6-bff4-e6728ed3c25e None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:23.264501 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e64094-4a8a-4868-ab6c-b7b3c8fe92bc None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:23.289552 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304dfd1-a3c2-4f2a-87d3-04e3855dcbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:23.293575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304dfd1-a3c2-4f2a-87d3-04e3855dcbb8 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:23.293864 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304dfd1-a3c2-4f2a-87d3-04e3855dcbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:23.294148 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304dfd1-a3c2-4f2a-87d3-04e3855dcbb8 None admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:23.294982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304dfd1-a3c2-4f2a-87d3-04e3855dcbb8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:23.295296 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304dfd1-a3c2-4f2a-87d3-04e3855dcbb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:23.296769 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304dfd1-a3c2-4f2a-87d3-04e3855dcbb8 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:23.311693 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22b41c-9456-49fa-9175-85c422fa92a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:23.312406 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22b41c-9456-49fa-9175-85c422fa92a0 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:23.312882 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22b41c-9456-49fa-9175-85c422fa92a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:23.313146 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22b41c-9456-49fa-9175-85c422fa92a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:23.328900 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 296/565] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Aug 2 08:49:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:23.328900 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cd605-e650-4212-822d-3094b2b71645 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:23.328900 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cd605-e650-4212-822d-3094b2b71645 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:23.328900 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cd605-e650-4212-822d-3094b2b71645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:23.329344 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22b41c-9456-49fa-9175-85c422fa92a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:23.329344 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22b41c-9456-49fa-9175-85c422fa92a0 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:23.338537 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:23.339913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-6f22b41c-9456-49fa-9175-85c422fa92a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:23.339913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:23.339913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:23.339913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:23.339913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:23.339913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:23.339913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:23.339913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:23.339913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:23.339913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:23.339913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:23.339913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:23.339913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:49:23.339913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:49:23.339913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:49:23.341198 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:49:23.341198 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:23.341198 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:23.341198 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:23.341198 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:23.341198 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:23.341198 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:23.341198 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:23.341198 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:23.341198 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:23.341198 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:23.341198 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:23.341198 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:23.341198 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:23.341198 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:23.341198 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:23.341198 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:23.342122 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:49:23.342122 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:49:23.342122 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:49:23.342122 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:49:23.342122 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:49:23.342122 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:49:23.342122 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:23.342122 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:23.342122 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 270/566] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:49:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:23.342122 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22b41c-9456-49fa-9175-85c422fa92a0 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:23.352478 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-b46cd605-e650-4212-822d-3094b2b71645 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:23.354354 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-b46cd605-e650-4212-822d-3094b2b71645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:23.355649 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:23.458502 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 297/567] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:49:23.461316 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceca1a6-332d-43c6-99eb-0ad0bd93ec01 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:23.461626 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceca1a6-332d-43c6-99eb-0ad0bd93ec01 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:23.461954 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceca1a6-332d-43c6-99eb-0ad0bd93ec01 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:23.464402 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 298/568] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:23.470413 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceca1a6-332d-43c6-99eb-0ad0bd93ec01 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:23.488043 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22b41c-9456-49fa-9175-85c422fa92a0 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:23.535491 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8eee6-05c3-4825-a411-d988e94e504d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:23.536207 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8eee6-05c3-4825-a411-d988e94e504d None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:23.536469 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8eee6-05c3-4825-a411-d988e94e504d None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:23.536744 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8eee6-05c3-4825-a411-d988e94e504d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:23.550912 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8eee6-05c3-4825-a411-d988e94e504d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:23.552408 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8eee6-05c3-4825-a411-d988e94e504d None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:23.577250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-56e8eee6-05c3-4825-a411-d988e94e504d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:23.577250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:23.577250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:23.577250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:23.577250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:23.577250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:23.577250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:23.577250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:23.577250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:23.577250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:23.577250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:23.577250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:23.577250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:23.577250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:23.577250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:23.578376 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:23.578376 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:23.578376 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:23.578376 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:23.578376 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:23.578376 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:23.578376 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:23.578376 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:23.578376 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:23.578376 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:23.578376 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:23.578376 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:23.578376 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:23.578376 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:23.578376 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:23.578376 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:23.578376 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:23.579295 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:23.579295 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:23.579295 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:23.579295 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:23.579700 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 271/569] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:23.580792 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8eee6-05c3-4825-a411-d988e94e504d None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:23.629183 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceca1a6-332d-43c6-99eb-0ad0bd93ec01 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:23.655416 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:23.671582 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971060bd-38f4-4dd8-972c-bd03624ea670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:23.672502 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971060bd-38f4-4dd8-972c-bd03624ea670 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:23.672640 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971060bd-38f4-4dd8-972c-bd03624ea670 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:23.672901 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971060bd-38f4-4dd8-972c-bd03624ea670 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:23.676219 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:23.686344 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971060bd-38f4-4dd8-972c-bd03624ea670 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:23.687845 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971060bd-38f4-4dd8-972c-bd03624ea670 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:23.699336 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8eee6-05c3-4825-a411-d988e94e504d None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:23.712482 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-971060bd-38f4-4dd8-972c-bd03624ea670 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:23.712482 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:23.712482 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:23.712482 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:23.712482 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:23.712482 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:23.712482 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:23.712482 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:23.712482 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:23.712482 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:23.712482 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:23.712482 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:23.712482 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:23.712482 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:23.712482 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:23.714459 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:23.714459 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:23.714459 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:23.714459 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:23.714459 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:23.714459 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:23.714459 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:23.714459 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:23.714459 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:23.714459 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:23.714459 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:23.714459 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:23.714459 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:23.714459 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:23.714459 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:23.714459 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:23.714459 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:23.716291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:23.716291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:23.716291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:23.716291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:23.716291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 299/570] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:23.716291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845e496-6cca-4e75-8284-a0e13a064fd3 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:23.716291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845e496-6cca-4e75-8284-a0e13a064fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:23.716291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845e496-6cca-4e75-8284-a0e13a064fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:23.736563 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-f845e496-6cca-4e75-8284-a0e13a064fd3 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:23.737771 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-f845e496-6cca-4e75-8284-a0e13a064fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:23.749820 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63cad7-0ef0-4996-bfb0-fd311af08f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:23.750788 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63cad7-0ef0-4996-bfb0-fd311af08f53 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:23.751077 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63cad7-0ef0-4996-bfb0-fd311af08f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:23.751472 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63cad7-0ef0-4996-bfb0-fd311af08f53 None admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:23.752851 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab63cad7-0ef0-4996-bfb0-fd311af08f53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:23.753165 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab63cad7-0ef0-4996-bfb0-fd311af08f53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:23.755274 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab63cad7-0ef0-4996-bfb0-fd311af08f53 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:23.777953 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 272/571] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:49:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:23.778845 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63cad7-0ef0-4996-bfb0-fd311af08f53 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:23.825627 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 300/572] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:49:23.826816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845e496-6cca-4e75-8284-a0e13a064fd3 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:23.917929 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63cad7-0ef0-4996-bfb0-fd311af08f53 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:23.952215 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:23.953425 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845e496-6cca-4e75-8284-a0e13a064fd3 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:23.960632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c988d-54ac-4792-86fc-da67e0eff79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:23.961354 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c988d-54ac-4792-86fc-da67e0eff79d None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:23.961636 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c988d-54ac-4792-86fc-da67e0eff79d None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:23.961961 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c988d-54ac-4792-86fc-da67e0eff79d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:23.973824 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c988d-54ac-4792-86fc-da67e0eff79d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:49:23.974233 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:23.979229 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-aa1c988d-54ac-4792-86fc-da67e0eff79d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:23.979229 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:23.979229 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:23.979229 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:23.979229 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:23.979229 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:23.979229 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:23.979229 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:23.979229 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:23.979229 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:23.979229 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:23.979229 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:23.979229 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:49:23.979229 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:49:23.979229 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:49:23.979229 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:49:23.980369 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:49:23.980369 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:49:23.980369 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:49:23.980369 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:49:23.980369 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:23.980369 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:23.980369 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:23.980369 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:23.980369 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:23.980369 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:23.980369 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:23.980369 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:23.980369 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:23.980369 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:23.980369 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:23.980369 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:23.985564 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:23.985564 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:23.985564 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:23.985564 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:23.985564 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:49:23.985564 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:49:23.985564 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:49:23.985564 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:49:23.985564 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:49:23.985564 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:49:23.985564 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:23.985564 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:23.985564 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 273/573] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Aug 2 08:49:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:23.985564 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c988d-54ac-4792-86fc-da67e0eff79d None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:24.001433 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5762015-e821-431d-8ee2-69478960c063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:24.002180 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5762015-e821-431d-8ee2-69478960c063 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:24.002797 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5762015-e821-431d-8ee2-69478960c063 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:24.003081 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5762015-e821-431d-8ee2-69478960c063 None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:24.003787 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5762015-e821-431d-8ee2-69478960c063 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:24.004093 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5762015-e821-431d-8ee2-69478960c063 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:24.005575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5762015-e821-431d-8ee2-69478960c063 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:24.026254 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 301/574] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:24.026254 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5762015-e821-431d-8ee2-69478960c063 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:24.104287 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c988d-54ac-4792-86fc-da67e0eff79d None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:24.143822 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bfdeb-147a-4f62-87c9-8d2f7a9e6b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:24.144491 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bfdeb-147a-4f62-87c9-8d2f7a9e6b83 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:24.144772 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bfdeb-147a-4f62-87c9-8d2f7a9e6b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:24.145050 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bfdeb-147a-4f62-87c9-8d2f7a9e6b83 None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:24.145758 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bfdeb-147a-4f62-87c9-8d2f7a9e6b83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:24.146065 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bfdeb-147a-4f62-87c9-8d2f7a9e6b83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:24.147465 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bfdeb-147a-4f62-87c9-8d2f7a9e6b83 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:24.160404 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5762015-e821-431d-8ee2-69478960c063 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:24.161396 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 274/575] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:24.162242 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bfdeb-147a-4f62-87c9-8d2f7a9e6b83 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:24.200058 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c24d1-4d02-4afc-86d4-b374e4bdeffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:24.200702 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c24d1-4d02-4afc-86d4-b374e4bdeffa None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:24.200985 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c24d1-4d02-4afc-86d4-b374e4bdeffa None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:24.201259 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c24d1-4d02-4afc-86d4-b374e4bdeffa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:24.202052 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c24d1-4d02-4afc-86d4-b374e4bdeffa None admin] RBAC: Adding query filter params (role.id=bc21bdc3d9dd4091a04f1e2fef77a8c3, scope.project.id=6910e69702854607889bab124edd60c9, user.id=58f8e572550b4ab5955d7a94f1563441) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:24.202356 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c24d1-4d02-4afc-86d4-b374e4bdeffa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:24.203796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c24d1-4d02-4afc-86d4-b374e4bdeffa None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:24.206464 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:24.209710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 302/576] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:49:24 2022] GET /identity/v3/role_assignments?user.id=58f8e572550b4ab5955d7a94f1563441&scope.project.id=6910e69702854607889bab124edd60c9&role.id=bc21bdc3d9dd4091a04f1e2fef77a8c3 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:24.210541 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c24d1-4d02-4afc-86d4-b374e4bdeffa None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:24.263882 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:24.301464 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bfdeb-147a-4f62-87c9-8d2f7a9e6b83 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:24.351890 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9545ab-27ec-4272-b6a6-34365cf9bb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:24.352762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9545ab-27ec-4272-b6a6-34365cf9bb96 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:24.353051 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9545ab-27ec-4272-b6a6-34365cf9bb96 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:24.353331 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9545ab-27ec-4272-b6a6-34365cf9bb96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:24.368596 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9545ab-27ec-4272-b6a6-34365cf9bb96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:49:24.374270 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-1b9545ab-27ec-4272-b6a6-34365cf9bb96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:24.374270 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:24.374270 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:24.374270 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:24.374270 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:24.374270 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:24.374270 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:24.374270 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:24.374270 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:24.374270 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:24.374270 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:24.374270 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:24.374270 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:49:24.374270 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:49:24.374270 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:49:24.374270 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:49:24.375984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:49:24.375984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:49:24.375984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:49:24.375984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:49:24.375984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:24.375984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:24.375984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:24.375984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:24.375984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:24.375984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:24.375984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:24.375984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:24.375984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:24.375984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:24.375984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:24.375984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:24.377770 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:24.377770 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:24.377770 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:24.377770 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:24.377770 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:49:24.377770 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:49:24.377770 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:49:24.377770 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:49:24.377770 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:49:24.377770 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:49:24.377770 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:24.377770 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:24.377770 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 275/577] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Aug 2 08:49:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:24.377770 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9545ab-27ec-4272-b6a6-34365cf9bb96 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:24.397436 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c24d1-4d02-4afc-86d4-b374e4bdeffa None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:24.464517 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9662bc5-cada-40b6-ab93-40568fc1ee82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:24.465660 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9662bc5-cada-40b6-ab93-40568fc1ee82 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:24.466224 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9662bc5-cada-40b6-ab93-40568fc1ee82 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:24.466645 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9662bc5-cada-40b6-ab93-40568fc1ee82 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:24.467947 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9662bc5-cada-40b6-ab93-40568fc1ee82 None admin] RBAC: Adding query filter params (name=service) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:24.468486 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9662bc5-cada-40b6-ab93-40568fc1ee82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:24.470674 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9662bc5-cada-40b6-ab93-40568fc1ee82 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:24.488053 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 303/578] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Aug 2 08:49:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:24.494009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9662bc5-cada-40b6-ab93-40568fc1ee82 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:24.560587 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9545ab-27ec-4272-b6a6-34365cf9bb96 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:24.563052 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:24.619369 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e0334-31c7-4f9d-b32b-0df182e52079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:24.620319 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e0334-31c7-4f9d-b32b-0df182e52079 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:24.620916 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e0334-31c7-4f9d-b32b-0df182e52079 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:24.621369 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e0334-31c7-4f9d-b32b-0df182e52079 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:24.631614 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e0334-31c7-4f9d-b32b-0df182e52079 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:24.634405 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e0334-31c7-4f9d-b32b-0df182e52079 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:24.647357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-ad0e0334-31c7-4f9d-b32b-0df182e52079 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:49:24.647357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:24.647357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:24.647357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:24.647357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:24.647357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:24.647357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:24.647357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:24.647357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:24.647357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:24.647357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:24.647357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:24.647357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:49:24.647357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:49:24.647357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:49:24.647357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:49:24.649228 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:24.649228 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:24.649228 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:49:24.649228 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:24.649228 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:49:24.649228 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:24.649228 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:24.649228 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:24.649228 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:24.649228 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:24.649228 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:24.649228 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:24.649228 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:24.649228 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:24.649228 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:24.649228 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:24.649228 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:24.649228 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:24.650208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:24.650208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:24.650208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:49:24.650208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:49:24.650208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:49:24.650208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:49:24.650208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:49:24.650208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:49:24.650208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:49:24.650208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:24.655525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 276/579] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Aug 2 08:49:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:24.657124 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e0334-31c7-4f9d-b32b-0df182e52079 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:24.691865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9662bc5-cada-40b6-ab93-40568fc1ee82 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:24.697161 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:24.754928 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8526c1-7805-4596-b748-3a5ace76f5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:24.756044 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8526c1-7805-4596-b748-3a5ace76f5c1 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:24.756581 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8526c1-7805-4596-b748-3a5ace76f5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:24.757067 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8526c1-7805-4596-b748-3a5ace76f5c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:24.770467 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8526c1-7805-4596-b748-3a5ace76f5c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:24.773228 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8526c1-7805-4596-b748-3a5ace76f5c1 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:24.793368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-dc8526c1-7805-4596-b748-3a5ace76f5c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:24.793368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:24.793368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:24.793368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:24.793368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:24.793368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:24.793368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:24.793368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:24.793368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:24.793368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:24.793368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:24.793368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:24.793368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:49:24.793368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:49:24.793368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:49:24.795371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:49:24.795371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:24.795371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:24.795371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:24.795371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:24.795371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:24.795371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:24.795371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:24.795371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:24.795371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:24.795371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:24.795371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:24.795371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:24.795371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:24.795371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:24.795371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:24.795371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:24.805187 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:49:24.805187 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:49:24.805187 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:49:24.805187 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:49:24.805187 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:49:24.805187 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:49:24.805187 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:24.805187 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:24.805187 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 304/580] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:49:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:24.805187 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8526c1-7805-4596-b748-3a5ace76f5c1 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:24.843283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e0334-31c7-4f9d-b32b-0df182e52079 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:24.900429 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dab6bc-4d53-4353-81be-c6664d3e5e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:24.901437 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dab6bc-4d53-4353-81be-c6664d3e5e6f None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:24.901888 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dab6bc-4d53-4353-81be-c6664d3e5e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:24.902343 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dab6bc-4d53-4353-81be-c6664d3e5e6f None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:24.903529 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dab6bc-4d53-4353-81be-c6664d3e5e6f None admin] RBAC: Adding query filter params (name=service) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:24.903932 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dab6bc-4d53-4353-81be-c6664d3e5e6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:24.906408 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dab6bc-4d53-4353-81be-c6664d3e5e6f None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:24.925633 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 277/581] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Aug 2 08:49:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:24.925633 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dab6bc-4d53-4353-81be-c6664d3e5e6f None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:24.965340 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:24.972083 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8526c1-7805-4596-b748-3a5ace76f5c1 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:25.034396 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468728b-1e40-4745-90d3-60ffb80651b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:25.035816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468728b-1e40-4745-90d3-60ffb80651b4 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:25.036289 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468728b-1e40-4745-90d3-60ffb80651b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:25.036700 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468728b-1e40-4745-90d3-60ffb80651b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:25.051529 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0468728b-1e40-4745-90d3-60ffb80651b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:25.053497 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0468728b-1e40-4745-90d3-60ffb80651b4 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:25.072710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-0468728b-1e40-4745-90d3-60ffb80651b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:25.072710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:25.072710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:25.072710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:25.072710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:25.072710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:25.072710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:25.072710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:25.072710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:25.072710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:25.072710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:25.072710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:25.072710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:25.072710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:25.072710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:25.074637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:25.074637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:25.074637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:25.074637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:25.074637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:25.074637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:25.074637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:25.074637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:25.074637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:25.074637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:25.074637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:25.074637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:25.074637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:25.074637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:25.074637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:25.074637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:25.074637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:25.076693 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:25.076693 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:25.076693 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:25.076693 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:25.079109 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 305/582] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:25.080058 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468728b-1e40-4745-90d3-60ffb80651b4 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:25.104783 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:25.126312 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dab6bc-4d53-4353-81be-c6664d3e5e6f None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:25.192299 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ec025-ac4d-4607-a666-897164a38d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:25.193691 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ec025-ac4d-4607-a666-897164a38d99 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:25.194353 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ec025-ac4d-4607-a666-897164a38d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:25.195028 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ec025-ac4d-4607-a666-897164a38d99 None admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:25.196743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ec025-ac4d-4607-a666-897164a38d99 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:25.197494 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ec025-ac4d-4607-a666-897164a38d99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:25.201119 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ec025-ac4d-4607-a666-897164a38d99 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:25.237921 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 278/583] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Aug 2 08:49:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:25.239611 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ec025-ac4d-4607-a666-897164a38d99 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:25.245968 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468728b-1e40-4745-90d3-60ffb80651b4 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:25.303852 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8626c-f803-4924-9303-52e8282db0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:25.305519 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8626c-f803-4924-9303-52e8282db0e2 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:25.306025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8626c-f803-4924-9303-52e8282db0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:25.306527 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8626c-f803-4924-9303-52e8282db0e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:25.307954 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8626c-f803-4924-9303-52e8282db0e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:25.308549 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8626c-f803-4924-9303-52e8282db0e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:25.311276 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8626c-f803-4924-9303-52e8282db0e2 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:25.334935 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 306/584] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:49:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:25.336545 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8626c-f803-4924-9303-52e8282db0e2 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:25.384379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:25.417099 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ec025-ac4d-4607-a666-897164a38d99 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:25.465006 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20a1d6-0277-43fb-a5f9-a30d4565ca9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:25.465687 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20a1d6-0277-43fb-a5f9-a30d4565ca9f None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:25.465964 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20a1d6-0277-43fb-a5f9-a30d4565ca9f None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:25.466234 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20a1d6-0277-43fb-a5f9-a30d4565ca9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:25.472577 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:25.480201 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20a1d6-0277-43fb-a5f9-a30d4565ca9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:25.481701 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20a1d6-0277-43fb-a5f9-a30d4565ca9f None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:25.500598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-2c20a1d6-0277-43fb-a5f9-a30d4565ca9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:25.500598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:25.500598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:25.500598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:25.500598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:25.500598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:25.500598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:25.500598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:25.500598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:25.500598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:25.500598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:25.500598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:25.500598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:25.500598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:25.500598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:25.501674 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:25.501674 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:25.501674 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:25.501674 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:25.501674 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:25.501674 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:25.501674 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:25.501674 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:25.501674 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:25.501674 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:25.501674 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:25.501674 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:25.501674 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:25.501674 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:25.501674 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:25.501674 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:25.501674 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:25.502863 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:25.502863 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:25.502863 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:25.502863 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:25.506943 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8626c-f803-4924-9303-52e8282db0e2 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:25.507170 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 279/585] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:25.508943 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20a1d6-0277-43fb-a5f9-a30d4565ca9f None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:25.557070 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e0a43-8c41-4187-9238-b643094663c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:25.557793 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e0a43-8c41-4187-9238-b643094663c3 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:25.559070 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e0a43-8c41-4187-9238-b643094663c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:25.559361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e0a43-8c41-4187-9238-b643094663c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:25.560098 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e0a43-8c41-4187-9238-b643094663c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:25.560425 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e0a43-8c41-4187-9238-b643094663c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:25.561827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e0a43-8c41-4187-9238-b643094663c3 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:25.583122 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 307/586] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:25.583122 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e0a43-8c41-4187-9238-b643094663c3 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:25.678452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20a1d6-0277-43fb-a5f9-a30d4565ca9f None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:25.724786 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e65c58-1410-4065-af90-6debdd3aa9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:25.725471 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e65c58-1410-4065-af90-6debdd3aa9ec None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:25.725757 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e65c58-1410-4065-af90-6debdd3aa9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:25.726031 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e65c58-1410-4065-af90-6debdd3aa9ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:25.729705 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:25.741032 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e65c58-1410-4065-af90-6debdd3aa9ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:25.743679 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e65c58-1410-4065-af90-6debdd3aa9ec None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:25.750239 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e0a43-8c41-4187-9238-b643094663c3 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:25.765783 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-12e65c58-1410-4065-af90-6debdd3aa9ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:25.765783 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:25.765783 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:25.765783 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:25.765783 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:25.765783 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:25.765783 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:25.765783 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:25.765783 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:25.765783 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:25.765783 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:25.765783 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:25.765783 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:25.765783 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:25.765783 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:25.766775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:25.766775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:25.766775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:25.766775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:25.766775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:25.766775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:25.766775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:25.766775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:25.766775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:25.766775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:25.766775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:25.766775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:25.766775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:25.766775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:25.766775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:25.766775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:25.766775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:25.767667 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:25.767667 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:25.767667 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:25.767667 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:25.777427 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 280/587] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:25.779014 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e65c58-1410-4065-af90-6debdd3aa9ec None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:25.819582 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb410074-53b7-410a-a633-db5cf93b441f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:25.821107 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb410074-53b7-410a-a633-db5cf93b441f None admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:25.821595 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb410074-53b7-410a-a633-db5cf93b441f None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:25.822039 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb410074-53b7-410a-a633-db5cf93b441f None admin] PATH_INFO: `/v3/projects/6910e69702854607889bab124edd60c9/users/bca8afe2c10f4db58716aacfd373504b/roles/bc21bdc3d9dd4091a04f1e2fef77a8c3` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:25.830032 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:25.855768 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb410074-53b7-410a-a633-db5cf93b441f None admin] RBAC: Authorizing `identity:create_grant(project_id=6910e69702854607889bab124edd60c9, user_id=bca8afe2c10f4db58716aacfd373504b, role_id=bc21bdc3d9dd4091a04f1e2fef77a8c3)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:25.858691 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb410074-53b7-410a-a633-db5cf93b441f None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:25.933323 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 308/588] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Aug 2 08:49:25 2022] PUT /identity/v3/projects/6910e69702854607889bab124edd60c9/users/bca8afe2c10f4db58716aacfd373504b/roles/bc21bdc3d9dd4091a04f1e2fef77a8c3 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:49:25.933323 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb410074-53b7-410a-a633-db5cf93b441f None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:25.954043 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e65c58-1410-4065-af90-6debdd3aa9ec None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:26.003493 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00269f8c-404a-497a-8505-2acb10302389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:26.004411 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00269f8c-404a-497a-8505-2acb10302389 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:26.004768 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00269f8c-404a-497a-8505-2acb10302389 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:26.005120 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00269f8c-404a-497a-8505-2acb10302389 None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:26.006026 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00269f8c-404a-497a-8505-2acb10302389 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:26.006411 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00269f8c-404a-497a-8505-2acb10302389 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:26.008121 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00269f8c-404a-497a-8505-2acb10302389 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:26.030142 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 281/589] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:26.031798 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00269f8c-404a-497a-8505-2acb10302389 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:26.116544 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:26.126442 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb410074-53b7-410a-a633-db5cf93b441f None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:26.179487 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577e756-ac0c-4f14-b34e-e1388d338fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:26.181466 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577e756-ac0c-4f14-b34e-e1388d338fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:26.181753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577e756-ac0c-4f14-b34e-e1388d338fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:26.182534 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577e756-ac0c-4f14-b34e-e1388d338fb0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:26.190582 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577e756-ac0c-4f14-b34e-e1388d338fb0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:26.192017 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577e756-ac0c-4f14-b34e-e1388d338fb0 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:26.206533 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-c577e756-ac0c-4f14-b34e-e1388d338fb0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 08:49:26.206533 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:26.206533 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:26.206533 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:26.206533 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:26.206533 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:26.206533 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:26.206533 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:26.206533 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:26.206533 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:26.206533 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:26.206533 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:26.206533 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:49:26.206533 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:49:26.206533 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:49:26.206533 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:49:26.207710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:26.207710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:26.207710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:49:26.207710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:26.207710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:49:26.207710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:26.207710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:26.207710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:26.207710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:26.207710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:26.207710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:26.207710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:26.207710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:26.207710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:26.207710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:26.207710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:26.207710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:26.207710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:26.208894 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:26.208894 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:26.208894 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:49:26.208894 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:49:26.208894 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:49:26.208894 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:49:26.208894 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:49:26.208894 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:49:26.208894 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 08:49:26.208894 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:26.208894 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 309/590] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:49:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:26.213251 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577e756-ac0c-4f14-b34e-e1388d338fb0 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:26.218430 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00269f8c-404a-497a-8505-2acb10302389 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:26.274837 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:26.365560 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577e756-ac0c-4f14-b34e-e1388d338fb0 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:26.449527 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9a5a8-f484-464d-9ea8-036a9990b3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:26.450238 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9a5a8-f484-464d-9ea8-036a9990b3ce None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:26.450702 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9a5a8-f484-464d-9ea8-036a9990b3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:26.450984 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9a5a8-f484-464d-9ea8-036a9990b3ce None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:26.458976 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d691cbb-cf45-4686-ba48-df782ddabdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:26.460047 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d691cbb-cf45-4686-ba48-df782ddabdc7 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:26.461095 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d691cbb-cf45-4686-ba48-df782ddabdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:26.461676 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d691cbb-cf45-4686-ba48-df782ddabdc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:26.462226 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9a5a8-f484-464d-9ea8-036a9990b3ce None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:26.462959 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d691cbb-cf45-4686-ba48-df782ddabdc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:26.463505 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d691cbb-cf45-4686-ba48-df782ddabdc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:26.463905 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9a5a8-f484-464d-9ea8-036a9990b3ce None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:26.466726 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d691cbb-cf45-4686-ba48-df782ddabdc7 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:26.479671 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-d1a9a5a8-f484-464d-9ea8-036a9990b3ce None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 08:49:26.479671 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:26.479671 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:26.479671 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:26.479671 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:26.479671 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:26.479671 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:26.479671 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:26.479671 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:26.479671 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:26.479671 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:26.479671 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:26.479671 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:49:26.479671 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:49:26.479671 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:49:26.479671 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:49:26.480699 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:26.480699 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:26.480699 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:49:26.480699 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:26.480699 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:49:26.480699 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:26.480699 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:26.480699 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:26.480699 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:26.480699 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:26.480699 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:26.480699 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:26.480699 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:26.480699 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:26.480699 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:26.480699 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:26.480699 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:26.480699 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:26.481648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:26.481648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:26.481648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:49:26.481648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:49:26.481648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:49:26.481648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:49:26.481648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:49:26.481648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:49:26.481648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 08:49:26.481648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:26.481648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 310/591] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Aug 2 08:49:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:26.482248 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9a5a8-f484-464d-9ea8-036a9990b3ce None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:26.498541 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 282/592] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:26.501420 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d691cbb-cf45-4686-ba48-df782ddabdc7 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:26.614613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9a5a8-f484-464d-9ea8-036a9990b3ce None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:26.623353 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:26.657594 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ec30c-e54c-4b22-86ed-929bf54fce0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:26.658734 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ec30c-e54c-4b22-86ed-929bf54fce0e None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:26.659399 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ec30c-e54c-4b22-86ed-929bf54fce0e None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:26.660795 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ec30c-e54c-4b22-86ed-929bf54fce0e None admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:26.664525 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ec30c-e54c-4b22-86ed-929bf54fce0e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:26.665438 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ec30c-e54c-4b22-86ed-929bf54fce0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:26.669214 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ec30c-e54c-4b22-86ed-929bf54fce0e None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:26.719098 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d691cbb-cf45-4686-ba48-df782ddabdc7 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:26.725575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 311/593] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Aug 2 08:49:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:26.725575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ec30c-e54c-4b22-86ed-929bf54fce0e None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:26.740372 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:26.799791 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44ad46-7d53-4c60-9989-0aab5632574b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:26.800987 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44ad46-7d53-4c60-9989-0aab5632574b None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:26.801451 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44ad46-7d53-4c60-9989-0aab5632574b None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:26.801934 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44ad46-7d53-4c60-9989-0aab5632574b None admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:26.803462 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44ad46-7d53-4c60-9989-0aab5632574b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:26.804000 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44ad46-7d53-4c60-9989-0aab5632574b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:26.808358 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44ad46-7d53-4c60-9989-0aab5632574b None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:26.857511 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 283/594] 10.222.0.20 () {56 vars in 1139 bytes} [Tue Aug 2 08:49:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:26.857511 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44ad46-7d53-4c60-9989-0aab5632574b None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:26.918083 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ec30c-e54c-4b22-86ed-929bf54fce0e None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:26.984949 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e918d448-dede-4275-8613-7bad8f16d26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:26.986066 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918d448-dede-4275-8613-7bad8f16d26b None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:26.986354 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918d448-dede-4275-8613-7bad8f16d26b None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:26.986627 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918d448-dede-4275-8613-7bad8f16d26b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:26.993308 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44ad46-7d53-4c60-9989-0aab5632574b None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:26.998507 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e918d448-dede-4275-8613-7bad8f16d26b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:27.000599 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e918d448-dede-4275-8613-7bad8f16d26b None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:27.022588 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-e918d448-dede-4275-8613-7bad8f16d26b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:27.022588 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:27.022588 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:27.022588 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:27.022588 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:27.022588 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:27.022588 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:27.022588 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:27.022588 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:27.022588 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:27.022588 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:27.022588 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:27.022588 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:49:27.022588 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:49:27.022588 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:49:27.025465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:49:27.025465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:27.025465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:27.025465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:27.025465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:27.025465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:27.025465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:27.025465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:27.025465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:27.025465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:27.025465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:27.025465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:27.025465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:27.025465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:27.025465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:27.025465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:27.025465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:27.027701 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:49:27.027701 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:49:27.027701 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:49:27.027701 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:49:27.027701 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:49:27.027701 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:49:27.027701 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:27.027701 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:27.027701 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 312/595] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:49:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:27.027701 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717807d-d69f-4715-b910-4a48ae9b9fbf None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:27.027701 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717807d-d69f-4715-b910-4a48ae9b9fbf None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:27.028851 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717807d-d69f-4715-b910-4a48ae9b9fbf None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:27.036908 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 313/596] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:27.036908 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717807d-d69f-4715-b910-4a48ae9b9fbf None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:27.064900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394e85f-e3e7-4d8f-b225-8abc4fabe214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:27.065776 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394e85f-e3e7-4d8f-b225-8abc4fabe214 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:27.066210 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394e85f-e3e7-4d8f-b225-8abc4fabe214 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:27.066522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394e85f-e3e7-4d8f-b225-8abc4fabe214 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:27.084905 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394e85f-e3e7-4d8f-b225-8abc4fabe214 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:27.085657 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:27.087237 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394e85f-e3e7-4d8f-b225-8abc4fabe214 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:27.120404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-7394e85f-e3e7-4d8f-b225-8abc4fabe214 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:27.120404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:27.120404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:27.120404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:27.120404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:27.120404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:27.120404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:27.120404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:27.120404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:27.120404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:27.120404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:27.120404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:27.120404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:27.120404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:27.120404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:27.122435 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:27.122435 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:27.122435 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:27.122435 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:27.122435 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:27.122435 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:27.122435 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:27.122435 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:27.122435 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:27.122435 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:27.122435 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:27.122435 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:27.122435 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:27.122435 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:27.122435 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:27.122435 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:27.122435 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:27.124754 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:27.124754 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:27.124754 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:27.124754 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:27.128631 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 284/597] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:27.129392 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394e85f-e3e7-4d8f-b225-8abc4fabe214 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:27.169957 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:27.236671 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717807d-d69f-4715-b910-4a48ae9b9fbf None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:27.299461 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9e4f3-b74b-4031-9451-6d688a0b4a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:27.300134 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9e4f3-b74b-4031-9451-6d688a0b4a78 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:27.300445 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9e4f3-b74b-4031-9451-6d688a0b4a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:27.300903 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9e4f3-b74b-4031-9451-6d688a0b4a78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:27.322208 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9e4f3-b74b-4031-9451-6d688a0b4a78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:27.325343 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9e4f3-b74b-4031-9451-6d688a0b4a78 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:27.342954 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394e85f-e3e7-4d8f-b225-8abc4fabe214 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:27.356333 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-1ea9e4f3-b74b-4031-9451-6d688a0b4a78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:27.356333 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:27.356333 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:27.356333 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:27.356333 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:27.356333 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:27.356333 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:27.356333 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:27.356333 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:27.356333 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:27.356333 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:27.356333 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:27.356333 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:27.356333 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:27.356333 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:27.357522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:27.357522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:27.357522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:27.357522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:27.357522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:27.357522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:27.357522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:27.357522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:27.357522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:27.357522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:27.357522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:27.357522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:27.357522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:27.357522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:27.357522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:27.357522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:27.357522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:27.358547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:27.358547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:27.358547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:27.358547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:27.359989 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 314/598] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:27.361250 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30567b-8951-48ac-8aeb-f2a11f16b543 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:27.361753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30567b-8951-48ac-8aeb-f2a11f16b543 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:27.362238 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30567b-8951-48ac-8aeb-f2a11f16b543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:27.393985 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-8e30567b-8951-48ac-8aeb-f2a11f16b543 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:27.395859 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-8e30567b-8951-48ac-8aeb-f2a11f16b543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:27.404405 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba93b30-0f64-4f03-9321-67b7117350b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:27.405361 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba93b30-0f64-4f03-9321-67b7117350b8 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:27.405913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba93b30-0f64-4f03-9321-67b7117350b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:27.408256 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba93b30-0f64-4f03-9321-67b7117350b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:27.408256 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba93b30-0f64-4f03-9321-67b7117350b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:27.408256 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba93b30-0f64-4f03-9321-67b7117350b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:27.412153 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba93b30-0f64-4f03-9321-67b7117350b8 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:27.441976 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 285/599] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:49:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:27.441976 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba93b30-0f64-4f03-9321-67b7117350b8 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:27.535642 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 315/600] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:49:27.536951 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30567b-8951-48ac-8aeb-f2a11f16b543 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:27.560003 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:27.595812 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:27.625360 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba93b30-0f64-4f03-9321-67b7117350b8 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:27.671986 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e70ad9-c847-4a80-98e4-12ddace273c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:27.672864 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e70ad9-c847-4a80-98e4-12ddace273c6 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:27.673236 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e70ad9-c847-4a80-98e4-12ddace273c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:27.673588 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e70ad9-c847-4a80-98e4-12ddace273c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:27.674581 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e70ad9-c847-4a80-98e4-12ddace273c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:27.674988 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e70ad9-c847-4a80-98e4-12ddace273c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:27.676712 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e70ad9-c847-4a80-98e4-12ddace273c6 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:27.684196 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30567b-8951-48ac-8aeb-f2a11f16b543 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:27.691836 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 286/601] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:27.692718 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e70ad9-c847-4a80-98e4-12ddace273c6 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:27.738349 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2ec44-4e50-4bc3-9c1e-7115aea30217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:27.739738 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2ec44-4e50-4bc3-9c1e-7115aea30217 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:27.740257 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2ec44-4e50-4bc3-9c1e-7115aea30217 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:27.740729 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2ec44-4e50-4bc3-9c1e-7115aea30217 None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:27.742969 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2ec44-4e50-4bc3-9c1e-7115aea30217 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:27.743451 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2ec44-4e50-4bc3-9c1e-7115aea30217 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:27.746132 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2ec44-4e50-4bc3-9c1e-7115aea30217 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:27.772138 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 316/602] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:27.772138 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2ec44-4e50-4bc3-9c1e-7115aea30217 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:27.839741 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e70ad9-c847-4a80-98e4-12ddace273c6 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:27.894544 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b767dbb-501c-463a-aa98-e0012deb2a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:27.895698 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b767dbb-501c-463a-aa98-e0012deb2a74 None admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:27.896070 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b767dbb-501c-463a-aa98-e0012deb2a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:27.896880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b767dbb-501c-463a-aa98-e0012deb2a74 None admin] PATH_INFO: `/v3/projects/6910e69702854607889bab124edd60c9/users/7bfcddefa71546d28078a38325c723a9/roles/bc21bdc3d9dd4091a04f1e2fef77a8c3` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:27.904142 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:27.910340 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:27.921805 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b767dbb-501c-463a-aa98-e0012deb2a74 None admin] RBAC: Authorizing `identity:create_grant(project_id=6910e69702854607889bab124edd60c9, user_id=7bfcddefa71546d28078a38325c723a9, role_id=bc21bdc3d9dd4091a04f1e2fef77a8c3)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:27.922489 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b767dbb-501c-463a-aa98-e0012deb2a74 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:27.977908 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2ec44-4e50-4bc3-9c1e-7115aea30217 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:28.012336 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 287/603] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Aug 2 08:49:27 2022] PUT /identity/v3/projects/6910e69702854607889bab124edd60c9/users/7bfcddefa71546d28078a38325c723a9/roles/bc21bdc3d9dd4091a04f1e2fef77a8c3 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:49:28.012336 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b767dbb-501c-463a-aa98-e0012deb2a74 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:28.056559 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a43a6-53fc-408d-a338-81eb13c877d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:28.058887 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a43a6-53fc-408d-a338-81eb13c877d0 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:28.059813 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a43a6-53fc-408d-a338-81eb13c877d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:28.060394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a43a6-53fc-408d-a338-81eb13c877d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:28.088303 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a43a6-53fc-408d-a338-81eb13c877d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:49:28.095342 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-c94a43a6-53fc-408d-a338-81eb13c877d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:28.095342 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:28.095342 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:28.095342 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:28.095342 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:28.095342 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:28.095342 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:28.095342 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:28.095342 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:28.095342 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:28.095342 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:28.095342 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:28.095342 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:49:28.095342 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:49:28.095342 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:49:28.095342 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:49:28.096540 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:49:28.096540 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:49:28.096540 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:49:28.096540 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:49:28.096540 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:28.096540 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:28.096540 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:28.096540 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:28.096540 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:28.096540 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:28.096540 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:28.096540 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:28.096540 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:28.096540 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:28.096540 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:28.096540 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:28.097386 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:28.097386 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:28.097386 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:28.097386 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:28.097386 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:49:28.097386 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:49:28.097386 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:49:28.097386 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:49:28.097386 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:49:28.097386 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:49:28.097386 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:28.097386 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:28.100511 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 317/604] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Aug 2 08:49:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:28.102957 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a43a6-53fc-408d-a338-81eb13c877d0 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:28.196630 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b767dbb-501c-463a-aa98-e0012deb2a74 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:28.263155 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a43a6-53fc-408d-a338-81eb13c877d0 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:28.274410 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69f541-86bb-4747-a4b4-0c249712a0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:28.275616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69f541-86bb-4747-a4b4-0c249712a0bb None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:28.275616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69f541-86bb-4747-a4b4-0c249712a0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:28.275812 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69f541-86bb-4747-a4b4-0c249712a0bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:28.284715 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a69f541-86bb-4747-a4b4-0c249712a0bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:28.286302 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a69f541-86bb-4747-a4b4-0c249712a0bb None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:28.302021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-1a69f541-86bb-4747-a4b4-0c249712a0bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:28.302021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:28.302021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:28.302021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:28.302021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:28.302021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:28.302021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:28.302021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:28.302021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:28.302021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:28.302021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:28.302021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:28.302021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:49:28.302021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:49:28.302021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:49:28.302980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:49:28.302980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:28.302980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:28.302980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:28.302980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:28.302980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:28.302980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:28.302980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:28.302980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:28.302980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:28.302980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:28.302980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:28.302980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:28.302980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:28.302980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:28.302980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:28.302980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:28.303868 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:49:28.303868 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:49:28.303868 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:49:28.303868 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:49:28.303868 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:49:28.303868 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:49:28.303868 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:28.303868 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:28.303868 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 288/605] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:49:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:28.308829 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69f541-86bb-4747-a4b4-0c249712a0bb None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:28.311796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:28.323667 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752eeb4-ec19-4b27-8ead-81dca7244742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:28.324737 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752eeb4-ec19-4b27-8ead-81dca7244742 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:28.325056 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752eeb4-ec19-4b27-8ead-81dca7244742 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:28.325393 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752eeb4-ec19-4b27-8ead-81dca7244742 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:28.334841 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752eeb4-ec19-4b27-8ead-81dca7244742 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:28.337203 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752eeb4-ec19-4b27-8ead-81dca7244742 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:28.352816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-1752eeb4-ec19-4b27-8ead-81dca7244742 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:28.352816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:28.352816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:28.352816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:28.352816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:28.352816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:28.352816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:28.352816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:28.352816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:28.352816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:28.352816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:28.352816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:28.352816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:49:28.352816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:49:28.352816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:49:28.353904 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:49:28.353904 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:28.353904 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:28.353904 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:28.353904 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:28.353904 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:28.353904 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:28.353904 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:28.353904 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:28.353904 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:28.353904 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:28.353904 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:28.353904 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:28.353904 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:28.353904 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:28.353904 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:28.353904 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:28.354914 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:49:28.354914 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:49:28.354914 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:49:28.354914 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:49:28.354914 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:49:28.354914 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:49:28.354914 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:28.354914 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:28.355414 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 318/606] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:49:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:28.355927 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752eeb4-ec19-4b27-8ead-81dca7244742 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:28.379966 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:28.456620 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69f541-86bb-4747-a4b4-0c249712a0bb None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:28.504604 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752eeb4-ec19-4b27-8ead-81dca7244742 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:28.512373 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb228a7-1de4-405e-8d45-0e33790c5b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:28.513715 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb228a7-1de4-405e-8d45-0e33790c5b24 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:28.514365 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb228a7-1de4-405e-8d45-0e33790c5b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:28.514977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb228a7-1de4-405e-8d45-0e33790c5b24 None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:28.516384 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb228a7-1de4-405e-8d45-0e33790c5b24 None admin] RBAC: Adding query filter params (name=service) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:28.517045 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb228a7-1de4-405e-8d45-0e33790c5b24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:28.519936 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb228a7-1de4-405e-8d45-0e33790c5b24 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:28.539089 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 289/607] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Aug 2 08:49:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:28.539089 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6c2fb-90c3-48e7-a8b5-fc073288951a None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:28.539089 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6c2fb-90c3-48e7-a8b5-fc073288951a None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:28.539089 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6c2fb-90c3-48e7-a8b5-fc073288951a None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:28.539089 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 290/608] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:28.539089 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6c2fb-90c3-48e7-a8b5-fc073288951a None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:28.566559 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27df897-35e0-468e-a3b0-0f570a4f6893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:28.567204 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27df897-35e0-468e-a3b0-0f570a4f6893 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:28.567491 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27df897-35e0-468e-a3b0-0f570a4f6893 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:28.567770 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27df897-35e0-468e-a3b0-0f570a4f6893 None admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:28.568582 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27df897-35e0-468e-a3b0-0f570a4f6893 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:28.568987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27df897-35e0-468e-a3b0-0f570a4f6893 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:28.571459 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27df897-35e0-468e-a3b0-0f570a4f6893 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:28.587386 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 319/609] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:49:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:28.588823 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27df897-35e0-468e-a3b0-0f570a4f6893 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:28.651701 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:28.693436 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6c2fb-90c3-48e7-a8b5-fc073288951a None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:28.706347 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:28.731872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27df897-35e0-468e-a3b0-0f570a4f6893 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:28.735444 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13ff83-8d00-4d24-866e-503c389ca98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:28.736112 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13ff83-8d00-4d24-866e-503c389ca98f None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:28.736401 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13ff83-8d00-4d24-866e-503c389ca98f None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:28.736687 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13ff83-8d00-4d24-866e-503c389ca98f None admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:28.738075 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13ff83-8d00-4d24-866e-503c389ca98f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:28.739025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13ff83-8d00-4d24-866e-503c389ca98f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:28.741090 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13ff83-8d00-4d24-866e-503c389ca98f None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:28.758355 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 291/610] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:49:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:28.759523 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792c7df-ec38-4909-a27c-be7d0ed7d3f6 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:28.759813 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792c7df-ec38-4909-a27c-be7d0ed7d3f6 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:28.760104 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792c7df-ec38-4909-a27c-be7d0ed7d3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:28.782401 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-b792c7df-ec38-4909-a27c-be7d0ed7d3f6 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:28.784377 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-b792c7df-ec38-4909-a27c-be7d0ed7d3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:28.790376 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87a6ea-2511-434a-bbc5-f8b99c5e6f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:28.791497 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87a6ea-2511-434a-bbc5-f8b99c5e6f2c None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:28.791985 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87a6ea-2511-434a-bbc5-f8b99c5e6f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:28.792517 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87a6ea-2511-434a-bbc5-f8b99c5e6f2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:28.810822 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87a6ea-2511-434a-bbc5-f8b99c5e6f2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:28.812974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87a6ea-2511-434a-bbc5-f8b99c5e6f2c None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:28.837974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-7e87a6ea-2511-434a-bbc5-f8b99c5e6f2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:28.837974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:28.837974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:28.837974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:28.837974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:28.837974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:28.837974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:28.837974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:28.837974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:28.837974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:28.837974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:28.837974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:28.837974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:28.837974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:28.837974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:28.839110 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:28.839110 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:28.839110 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:28.839110 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:28.839110 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:28.839110 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:28.839110 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:28.839110 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:28.839110 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:28.839110 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:28.839110 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:28.839110 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:28.839110 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:28.839110 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:28.839110 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:28.839110 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:28.839110 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:28.840232 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:28.840232 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:28.840232 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:28.840232 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:28.840232 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 320/611] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:28.840232 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87a6ea-2511-434a-bbc5-f8b99c5e6f2c None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:28.893923 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 292/612] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:49:28.895629 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792c7df-ec38-4909-a27c-be7d0ed7d3f6 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:29.006081 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:29.013033 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87a6ea-2511-434a-bbc5-f8b99c5e6f2c None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:29.065752 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78b2ff-318d-44e3-9c17-41801399cef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:29.066555 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78b2ff-318d-44e3-9c17-41801399cef3 None admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:29.066894 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78b2ff-318d-44e3-9c17-41801399cef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:29.067249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78b2ff-318d-44e3-9c17-41801399cef3 None admin] PATH_INFO: `/v3/projects/6910e69702854607889bab124edd60c9/users/ada53ed554844560843ab84198ac373c/roles/bc21bdc3d9dd4091a04f1e2fef77a8c3` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:29.086645 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:29.087629 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78b2ff-318d-44e3-9c17-41801399cef3 None admin] RBAC: Authorizing `identity:create_grant(project_id=6910e69702854607889bab124edd60c9, user_id=ada53ed554844560843ab84198ac373c, role_id=bc21bdc3d9dd4091a04f1e2fef77a8c3)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:29.089238 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78b2ff-318d-44e3-9c17-41801399cef3 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:29.093119 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792c7df-ec38-4909-a27c-be7d0ed7d3f6 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:29.159406 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba1a6f-e40a-4cd9-9513-aa296d58f24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:29.160142 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba1a6f-e40a-4cd9-9513-aa296d58f24e None admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:29.160440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba1a6f-e40a-4cd9-9513-aa296d58f24e None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:29.160730 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba1a6f-e40a-4cd9-9513-aa296d58f24e None admin] PATH_INFO: `/v3/projects/6910e69702854607889bab124edd60c9/users/6128f07ffd5f4357968b0e2e300f2e09/roles/bc21bdc3d9dd4091a04f1e2fef77a8c3` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:29.181288 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba1a6f-e40a-4cd9-9513-aa296d58f24e None admin] RBAC: Authorizing `identity:create_grant(project_id=6910e69702854607889bab124edd60c9, user_id=6128f07ffd5f4357968b0e2e300f2e09, role_id=bc21bdc3d9dd4091a04f1e2fef77a8c3)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:29.182818 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba1a6f-e40a-4cd9-9513-aa296d58f24e None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:29.186901 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 321/613] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Aug 2 08:49:28 2022] PUT /identity/v3/projects/6910e69702854607889bab124edd60c9/users/ada53ed554844560843ab84198ac373c/roles/bc21bdc3d9dd4091a04f1e2fef77a8c3 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:49:29.187973 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78b2ff-318d-44e3-9c17-41801399cef3 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:29.284084 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 293/614] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Aug 2 08:49:28 2022] PUT /identity/v3/projects/6910e69702854607889bab124edd60c9/users/6128f07ffd5f4357968b0e2e300f2e09/roles/bc21bdc3d9dd4091a04f1e2fef77a8c3 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:49:29.286180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba1a6f-e40a-4cd9-9513-aa296d58f24e None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:29.426710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78b2ff-318d-44e3-9c17-41801399cef3 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:29.508286 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611551e-fca5-47b1-90c0-4222a566e27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:29.509261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611551e-fca5-47b1-90c0-4222a566e27c None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:29.509731 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611551e-fca5-47b1-90c0-4222a566e27c None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:29.510194 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611551e-fca5-47b1-90c0-4222a566e27c None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:29.511438 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5611551e-fca5-47b1-90c0-4222a566e27c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:29.512155 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5611551e-fca5-47b1-90c0-4222a566e27c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:29.514540 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5611551e-fca5-47b1-90c0-4222a566e27c None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:29.532134 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba1a6f-e40a-4cd9-9513-aa296d58f24e None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:29.537821 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 322/615] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:29.548704 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611551e-fca5-47b1-90c0-4222a566e27c None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:29.580399 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:29.609345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9c181-15cf-4b54-ac8f-a1dc1f447b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:29.610808 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9c181-15cf-4b54-ac8f-a1dc1f447b77 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:29.611573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9c181-15cf-4b54-ac8f-a1dc1f447b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:29.612277 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9c181-15cf-4b54-ac8f-a1dc1f447b77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:29.639897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9c181-15cf-4b54-ac8f-a1dc1f447b77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:49:29.650616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-d9b9c181-15cf-4b54-ac8f-a1dc1f447b77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:29.650616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:29.650616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:29.650616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:29.650616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:29.650616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:29.650616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:29.650616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:29.650616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:29.650616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:29.650616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:29.650616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:29.650616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:49:29.650616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:49:29.650616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:49:29.650616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:49:29.652693 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:49:29.652693 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:49:29.652693 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:49:29.652693 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:49:29.652693 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:29.652693 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:29.652693 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:29.652693 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:29.652693 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:29.652693 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:29.652693 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:29.652693 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:29.652693 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:29.652693 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:29.652693 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:29.652693 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:29.654485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:29.654485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:29.654485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:29.654485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:29.654485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:49:29.654485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:49:29.654485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:49:29.654485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:49:29.654485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:49:29.654485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:49:29.654485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:29.654485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:29.658731 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 294/616] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Aug 2 08:49:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:29.670859 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9c181-15cf-4b54-ac8f-a1dc1f447b77 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:29.693801 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:29.714032 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611551e-fca5-47b1-90c0-4222a566e27c None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:29.781042 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea19c04-0e47-450e-bcdf-e1587cdee109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:29.781828 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea19c04-0e47-450e-bcdf-e1587cdee109 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:29.782281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea19c04-0e47-450e-bcdf-e1587cdee109 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:29.782514 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea19c04-0e47-450e-bcdf-e1587cdee109 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:29.801417 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea19c04-0e47-450e-bcdf-e1587cdee109 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:29.804144 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea19c04-0e47-450e-bcdf-e1587cdee109 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:29.828385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-eea19c04-0e47-450e-bcdf-e1587cdee109 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:49:29.828385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:29.828385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:29.828385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:29.828385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:29.828385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:29.828385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:29.828385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:29.828385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:29.828385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:29.828385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:29.828385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:29.828385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:49:29.828385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:49:29.828385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:49:29.828385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:49:29.830455 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:29.830455 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:29.830455 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:49:29.830455 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:29.830455 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:49:29.830455 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:29.830455 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:29.830455 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:29.830455 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:29.830455 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:29.830455 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:29.830455 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:29.830455 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:29.830455 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:29.830455 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:29.830455 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:29.830455 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:29.830455 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:29.832712 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:29.832712 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:29.832712 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:49:29.832712 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:49:29.832712 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:49:29.832712 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:49:29.832712 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:49:29.832712 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:49:29.832712 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:49:29.832712 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:29.832712 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 323/617] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:49:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:29.836635 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea19c04-0e47-450e-bcdf-e1587cdee109 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:29.975702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9c181-15cf-4b54-ac8f-a1dc1f447b77 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:30.065949 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5c526-baf2-4fdb-999c-3af329835b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:30.066926 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5c526-baf2-4fdb-999c-3af329835b52 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:30.067415 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5c526-baf2-4fdb-999c-3af329835b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:30.067910 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5c526-baf2-4fdb-999c-3af329835b52 None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:30.069222 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5c526-baf2-4fdb-999c-3af329835b52 None admin] RBAC: Adding query filter params (name=service) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:30.069793 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5c526-baf2-4fdb-999c-3af329835b52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:30.072966 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5c526-baf2-4fdb-999c-3af329835b52 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:30.084856 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:30.089192 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 295/618] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Aug 2 08:49:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:30.094708 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5c526-baf2-4fdb-999c-3af329835b52 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:30.176600 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea19c04-0e47-450e-bcdf-e1587cdee109 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:30.224377 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5afa57-24a1-44a3-88fe-d34299ab06df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:30.225024 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5afa57-24a1-44a3-88fe-d34299ab06df None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:30.225301 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5afa57-24a1-44a3-88fe-d34299ab06df None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:30.225574 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5afa57-24a1-44a3-88fe-d34299ab06df None admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:30.227024 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5afa57-24a1-44a3-88fe-d34299ab06df None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:30.227573 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5afa57-24a1-44a3-88fe-d34299ab06df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:30.229194 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5afa57-24a1-44a3-88fe-d34299ab06df None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:30.238516 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:30.275226 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 324/619] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Aug 2 08:49:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:30.281259 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5afa57-24a1-44a3-88fe-d34299ab06df None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:30.324036 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5c526-baf2-4fdb-999c-3af329835b52 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:30.444372 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47b4a4-9442-448f-83ff-3d89d62ed06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:30.446080 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47b4a4-9442-448f-83ff-3d89d62ed06c None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:30.446607 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47b4a4-9442-448f-83ff-3d89d62ed06c None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:30.447098 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47b4a4-9442-448f-83ff-3d89d62ed06c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:30.501014 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c47b4a4-9442-448f-83ff-3d89d62ed06c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:30.504269 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c47b4a4-9442-448f-83ff-3d89d62ed06c None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:30.546499 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-1c47b4a4-9442-448f-83ff-3d89d62ed06c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:30.546499 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:30.546499 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:30.546499 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:30.546499 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:30.546499 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:30.546499 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:30.546499 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:30.546499 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:30.546499 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:30.546499 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:30.546499 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:30.546499 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:30.546499 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:30.546499 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:30.548113 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:30.548113 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:30.548113 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:30.548113 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:30.548113 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:30.548113 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:30.548113 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:30.548113 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:30.548113 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:30.548113 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:30.548113 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:30.548113 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:30.548113 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:30.548113 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:30.548113 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:30.548113 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:30.548113 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:30.549824 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:30.549824 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:30.549824 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:30.549824 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:30.556781 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 296/620] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 462 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:30.562471 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47b4a4-9442-448f-83ff-3d89d62ed06c None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:30.603879 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5afa57-24a1-44a3-88fe-d34299ab06df None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:30.663023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:30.679920 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2ddd7-019e-4921-bb73-14bafe570206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:30.680758 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2ddd7-019e-4921-bb73-14bafe570206 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:30.681250 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2ddd7-019e-4921-bb73-14bafe570206 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:30.682607 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2ddd7-019e-4921-bb73-14bafe570206 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:30.704658 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed2ddd7-019e-4921-bb73-14bafe570206 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:30.707487 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed2ddd7-019e-4921-bb73-14bafe570206 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:30.739580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-aed2ddd7-019e-4921-bb73-14bafe570206 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:30.739580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:30.739580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:30.739580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:30.739580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:30.739580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:30.739580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:30.739580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:30.739580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:30.739580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:30.739580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:30.739580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:30.739580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:30.739580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:30.739580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:30.741372 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:30.741372 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:30.741372 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:30.741372 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:30.741372 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:30.741372 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:30.741372 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:30.741372 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:30.741372 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:30.741372 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:30.741372 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:30.741372 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:30.741372 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:30.741372 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:30.741372 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:30.741372 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:30.741372 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:30.743143 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:30.743143 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:30.743143 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:30.743143 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:30.743143 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 325/621] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 461 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:49:30.748543 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2ddd7-019e-4921-bb73-14bafe570206 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:30.983333 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2ddd7-019e-4921-bb73-14bafe570206 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:31.044073 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47b4a4-9442-448f-83ff-3d89d62ed06c None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:31.065002 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87803ec5-76c0-4b50-9afc-4b526613f1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:31.066967 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87803ec5-76c0-4b50-9afc-4b526613f1dd None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:31.067467 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87803ec5-76c0-4b50-9afc-4b526613f1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:31.068000 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87803ec5-76c0-4b50-9afc-4b526613f1dd None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:31.071319 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87803ec5-76c0-4b50-9afc-4b526613f1dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:31.072098 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87803ec5-76c0-4b50-9afc-4b526613f1dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:31.074804 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87803ec5-76c0-4b50-9afc-4b526613f1dd None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:31.104787 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 326/622] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:49:31.111095 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87803ec5-76c0-4b50-9afc-4b526613f1dd None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:31.143816 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:31.194605 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b173afd-6093-47e5-ba7c-3d6ced037e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:31.195827 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b173afd-6093-47e5-ba7c-3d6ced037e3f None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:31.196108 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b173afd-6093-47e5-ba7c-3d6ced037e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:31.196442 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b173afd-6093-47e5-ba7c-3d6ced037e3f None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:31.197906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b173afd-6093-47e5-ba7c-3d6ced037e3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:31.198248 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b173afd-6093-47e5-ba7c-3d6ced037e3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:31.199828 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b173afd-6093-47e5-ba7c-3d6ced037e3f None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:31.208409 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:31.238686 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 297/623] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 676 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:31.245316 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b173afd-6093-47e5-ba7c-3d6ced037e3f None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:31.332495 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87803ec5-76c0-4b50-9afc-4b526613f1dd None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:31.390021 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb30fa-56b4-45af-805d-bd3bb58b8280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:31.391017 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb30fa-56b4-45af-805d-bd3bb58b8280 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:31.391294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb30fa-56b4-45af-805d-bd3bb58b8280 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:31.391794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb30fa-56b4-45af-805d-bd3bb58b8280 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:31.402793 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb30fa-56b4-45af-805d-bd3bb58b8280 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:31.404603 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb30fa-56b4-45af-805d-bd3bb58b8280 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:31.425258 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b173afd-6093-47e5-ba7c-3d6ced037e3f None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:31.426647 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-7bdb30fa-56b4-45af-805d-bd3bb58b8280 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:31.426647 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:31.426647 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:31.426647 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:31.426647 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:31.426647 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:31.426647 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:31.426647 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:31.426647 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:31.426647 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:31.426647 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:31.426647 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:31.426647 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:49:31.426647 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:49:31.426647 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:49:31.427715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:49:31.427715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:31.427715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:31.427715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:31.427715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:31.427715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:31.427715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:31.427715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:31.427715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:31.427715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:31.427715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:31.427715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:31.427715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:31.427715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:31.427715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:31.427715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:31.427715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:31.428646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:49:31.428646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:49:31.428646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:49:31.428646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:49:31.428646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:49:31.428646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:49:31.428646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:31.428646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:31.434156 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 327/624] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:49:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:49:31.435881 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59070a2-1c6a-403a-89e9-240950047045 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:31.436326 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59070a2-1c6a-403a-89e9-240950047045 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:31.436609 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59070a2-1c6a-403a-89e9-240950047045 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:31.441919 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 328/625] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:31.443027 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59070a2-1c6a-403a-89e9-240950047045 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:31.482203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260fcd4-a179-431c-8226-5837ec466be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:31.483593 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260fcd4-a179-431c-8226-5837ec466be2 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:31.484421 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260fcd4-a179-431c-8226-5837ec466be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:31.485462 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260fcd4-a179-431c-8226-5837ec466be2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:31.498084 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260fcd4-a179-431c-8226-5837ec466be2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:31.499934 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260fcd4-a179-431c-8226-5837ec466be2 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:31.517974 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-7260fcd4-a179-431c-8226-5837ec466be2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 02 08:49:31.517974 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:31.517974 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:31.517974 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:31.517974 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:31.517974 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:31.517974 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:31.517974 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:31.517974 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:31.517974 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:31.517974 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:31.517974 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:31.517974 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:49:31.517974 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:49:31.517974 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:49:31.517974 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:49:31.518992 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:31.518992 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:31.518992 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:49:31.518992 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:31.518992 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:49:31.518992 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:31.518992 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:31.518992 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:31.518992 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:31.518992 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:31.518992 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:31.518992 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:31.518992 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:31.518992 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:31.518992 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:31.518992 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:31.518992 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:31.518992 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:31.519940 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:31.519940 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:31.519940 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:49:31.519940 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:49:31.519940 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:49:31.519940 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:49:31.519940 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:49:31.519940 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:49:31.519940 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 02 08:49:31.519940 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:31.527383 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 298/626] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:49:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:49:31.527383 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc61833-1867-40d5-897d-d476e95c81ee None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:31.527383 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc61833-1867-40d5-897d-d476e95c81ee None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:31.527383 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc61833-1867-40d5-897d-d476e95c81ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:31.554648 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-4cc61833-1867-40d5-897d-d476e95c81ee None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:31.556801 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-4cc61833-1867-40d5-897d-d476e95c81ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:31.579409 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:31.584424 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59070a2-1c6a-403a-89e9-240950047045 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:31.616035 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:31.631401 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257f79f-ee8c-4797-81c3-7caaaddcc030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:31.633581 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257f79f-ee8c-4797-81c3-7caaaddcc030 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:31.634058 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257f79f-ee8c-4797-81c3-7caaaddcc030 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:31.635067 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257f79f-ee8c-4797-81c3-7caaaddcc030 None admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:31.636278 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257f79f-ee8c-4797-81c3-7caaaddcc030 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:31.637089 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257f79f-ee8c-4797-81c3-7caaaddcc030 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:31.640203 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257f79f-ee8c-4797-81c3-7caaaddcc030 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:31.652491 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 299/627] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:49:31.653476 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc61833-1867-40d5-897d-d476e95c81ee None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:31.658849 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 329/628] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:49:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:31.667058 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257f79f-ee8c-4797-81c3-7caaaddcc030 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:31.809505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257f79f-ee8c-4797-81c3-7caaaddcc030 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:31.818551 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc61833-1867-40d5-897d-d476e95c81ee None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:31.852911 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128662b-7f95-4603-a118-bf952850136f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:31.854110 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128662b-7f95-4603-a118-bf952850136f None admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:31.854644 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128662b-7f95-4603-a118-bf952850136f None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:31.855120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128662b-7f95-4603-a118-bf952850136f None admin] PATH_INFO: `/v3/projects/6910e69702854607889bab124edd60c9/users/58f8e572550b4ab5955d7a94f1563441/roles/bc21bdc3d9dd4091a04f1e2fef77a8c3` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:31.869015 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97484be9-5e7d-4a08-9fa7-b3d3d9b4197e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:31.869764 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97484be9-5e7d-4a08-9fa7-b3d3d9b4197e None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:31.870113 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97484be9-5e7d-4a08-9fa7-b3d3d9b4197e None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:31.870526 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97484be9-5e7d-4a08-9fa7-b3d3d9b4197e None admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:31.871642 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97484be9-5e7d-4a08-9fa7-b3d3d9b4197e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:31.871911 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97484be9-5e7d-4a08-9fa7-b3d3d9b4197e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:31.873632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97484be9-5e7d-4a08-9fa7-b3d3d9b4197e None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:31.876737 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128662b-7f95-4603-a118-bf952850136f None admin] RBAC: Authorizing `identity:create_grant(project_id=6910e69702854607889bab124edd60c9, user_id=58f8e572550b4ab5955d7a94f1563441, role_id=bc21bdc3d9dd4091a04f1e2fef77a8c3)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:31.878881 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128662b-7f95-4603-a118-bf952850136f None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:31.905618 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 300/629] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Aug 2 08:49:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:31.905618 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97484be9-5e7d-4a08-9fa7-b3d3d9b4197e None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:31.972201 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:31.973497 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 330/630] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Aug 2 08:49:31 2022] PUT /identity/v3/projects/6910e69702854607889bab124edd60c9/users/58f8e572550b4ab5955d7a94f1563441/roles/bc21bdc3d9dd4091a04f1e2fef77a8c3 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:49:31.975550 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128662b-7f95-4603-a118-bf952850136f None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:32.016880 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:32.108084 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97484be9-5e7d-4a08-9fa7-b3d3d9b4197e None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:32.165111 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145a65b-c0a2-41d5-a7f4-a149144af0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:32.166270 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145a65b-c0a2-41d5-a7f4-a149144af0a1 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:32.166778 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145a65b-c0a2-41d5-a7f4-a149144af0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:32.167291 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145a65b-c0a2-41d5-a7f4-a149144af0a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:32.190587 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a145a65b-c0a2-41d5-a7f4-a149144af0a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:49:32.198551 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128662b-7f95-4603-a118-bf952850136f None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:32.203329 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-a145a65b-c0a2-41d5-a7f4-a149144af0a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:32.203329 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:32.203329 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:32.203329 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:32.203329 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:32.203329 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:32.203329 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:32.203329 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:32.203329 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:32.203329 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:32.203329 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:32.203329 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:32.203329 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:49:32.203329 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:49:32.203329 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:49:32.203329 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:49:32.204405 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:49:32.204405 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:49:32.204405 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:49:32.204405 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:49:32.204405 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:32.204405 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:32.204405 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:32.204405 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:32.204405 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:32.204405 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:32.204405 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:32.204405 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:32.204405 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:32.204405 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:32.204405 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:32.204405 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:32.205264 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:32.205264 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:32.205264 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:32.205264 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:32.205264 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:49:32.205264 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:49:32.205264 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:49:32.205264 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:49:32.205264 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:49:32.205264 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:49:32.205264 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:32.205264 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:32.207852 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 301/631] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Aug 2 08:49:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:32.217532 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145a65b-c0a2-41d5-a7f4-a149144af0a1 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:32.283089 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09078ab9-1d0d-4e06-9e58-031f5b233d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:32.286690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09078ab9-1d0d-4e06-9e58-031f5b233d53 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:32.286690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09078ab9-1d0d-4e06-9e58-031f5b233d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:32.286690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09078ab9-1d0d-4e06-9e58-031f5b233d53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:32.408683 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145a65b-c0a2-41d5-a7f4-a149144af0a1 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:32.413286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:32.433281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09078ab9-1d0d-4e06-9e58-031f5b233d53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:32.439314 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09078ab9-1d0d-4e06-9e58-031f5b233d53 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:32.455899 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:32.460616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6255c-aa75-41a7-a58e-6e22785aab76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:32.460616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6255c-aa75-41a7-a58e-6e22785aab76 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:32.460964 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6255c-aa75-41a7-a58e-6e22785aab76 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:32.461908 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6255c-aa75-41a7-a58e-6e22785aab76 None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:32.462971 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6255c-aa75-41a7-a58e-6e22785aab76 None admin] RBAC: Adding query filter params (name=service) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:32.463283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6255c-aa75-41a7-a58e-6e22785aab76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:32.464909 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6255c-aa75-41a7-a58e-6e22785aab76 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:32.477892 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 302/632] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Aug 2 08:49:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:32.486485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6255c-aa75-41a7-a58e-6e22785aab76 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:32.689701 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 331/633] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:49:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 715 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:49:32.693274 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980feda6-1be8-4250-b65a-c02aa3a28cc7 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:32.693745 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980feda6-1be8-4250-b65a-c02aa3a28cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:32.694199 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980feda6-1be8-4250-b65a-c02aa3a28cc7 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:32.702929 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 332/634] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:32 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:32.704659 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980feda6-1be8-4250-b65a-c02aa3a28cc7 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:32.709934 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6255c-aa75-41a7-a58e-6e22785aab76 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:32.782574 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63b8f0-2e6d-4a28-857b-5296f71507bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:32.783257 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63b8f0-2e6d-4a28-857b-5296f71507bc None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:32.783562 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63b8f0-2e6d-4a28-857b-5296f71507bc None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:32.783819 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63b8f0-2e6d-4a28-857b-5296f71507bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:32.802578 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab63b8f0-2e6d-4a28-857b-5296f71507bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:32.805114 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab63b8f0-2e6d-4a28-857b-5296f71507bc None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:32.828877 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-ab63b8f0-2e6d-4a28-857b-5296f71507bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:32.828877 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:32.828877 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:32.828877 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:32.828877 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:32.828877 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:32.828877 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:32.828877 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:32.828877 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:32.828877 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:32.828877 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:32.828877 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:32.828877 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:32.828877 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:32.828877 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:32.829900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:32.829900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:32.829900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:32.829900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:32.829900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:32.829900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:32.829900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:32.829900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:32.829900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:32.829900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:32.829900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:32.829900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:32.829900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:32.829900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:32.829900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:32.829900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:32.829900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:32.830774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:32.830774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:32.830774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:32.830774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:32.830774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 303/635] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:49:32.834338 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5be2f-2dc6-45e2-8a41-616795fc64dc None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:32.834338 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5be2f-2dc6-45e2-8a41-616795fc64dc None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:32.834338 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5be2f-2dc6-45e2-8a41-616795fc64dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:32.846316 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:32.861554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-dfa5be2f-2dc6-45e2-8a41-616795fc64dc None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:32.863458 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-dfa5be2f-2dc6-45e2-8a41-616795fc64dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:32.975659 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980feda6-1be8-4250-b65a-c02aa3a28cc7 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:32.994079 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:32.994855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 304/636] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:49:32.996222 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5be2f-2dc6-45e2-8a41-616795fc64dc None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:33.048935 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab57561-6382-4785-a776-2f45cdccf8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:33.049990 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab57561-6382-4785-a776-2f45cdccf8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:33.050451 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab57561-6382-4785-a776-2f45cdccf8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:33.050918 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab57561-6382-4785-a776-2f45cdccf8c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:33.074759 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab57561-6382-4785-a776-2f45cdccf8c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:33.077982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab57561-6382-4785-a776-2f45cdccf8c8 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:33.109678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-aab57561-6382-4785-a776-2f45cdccf8c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:33.109678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:33.109678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:33.109678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:33.109678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:33.109678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:33.109678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:33.109678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:33.109678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:33.109678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:33.109678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:33.109678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:33.109678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:33.109678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:33.109678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:33.110979 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:33.110979 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:33.110979 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:33.110979 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:33.110979 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:33.110979 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:33.110979 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:33.110979 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:33.110979 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:33.110979 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:33.110979 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:33.110979 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:33.110979 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:33.110979 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:33.110979 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:33.110979 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:33.110979 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:33.113457 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:33.113457 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:33.113457 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:33.113457 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:33.113457 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 333/637] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:33.114164 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090857fb-91ea-4293-9261-16b069d8b591 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:33.114657 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090857fb-91ea-4293-9261-16b069d8b591 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:33.115158 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090857fb-91ea-4293-9261-16b069d8b591 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:33.122315 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 334/638] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:33.122315 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090857fb-91ea-4293-9261-16b069d8b591 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:33.185468 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5be2f-2dc6-45e2-8a41-616795fc64dc None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:33.235855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9826ad0-f02b-41d7-b638-e51fe047c108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:33.236700 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9826ad0-f02b-41d7-b638-e51fe047c108 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:33.236965 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9826ad0-f02b-41d7-b638-e51fe047c108 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:33.237243 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9826ad0-f02b-41d7-b638-e51fe047c108 None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:33.238030 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9826ad0-f02b-41d7-b638-e51fe047c108 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:33.238434 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9826ad0-f02b-41d7-b638-e51fe047c108 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:33.240060 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9826ad0-f02b-41d7-b638-e51fe047c108 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:33.243136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:33.266836 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 305/639] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:33.268040 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9826ad0-f02b-41d7-b638-e51fe047c108 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:33.322008 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090857fb-91ea-4293-9261-16b069d8b591 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:33.385899 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe540d71-999f-4d04-8fd3-c129f4ee632c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:33.387069 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe540d71-999f-4d04-8fd3-c129f4ee632c None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:33.387579 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe540d71-999f-4d04-8fd3-c129f4ee632c None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:33.388054 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe540d71-999f-4d04-8fd3-c129f4ee632c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:33.409160 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe540d71-999f-4d04-8fd3-c129f4ee632c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:49:33.420774 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-fe540d71-999f-4d04-8fd3-c129f4ee632c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:33.420774 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:33.420774 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:33.420774 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:33.420774 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:33.420774 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:33.420774 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:33.420774 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:33.420774 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:33.420774 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:33.420774 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:33.420774 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:33.420774 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:49:33.420774 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:49:33.420774 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:49:33.420774 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:49:33.421925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:49:33.421925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:49:33.421925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:49:33.421925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:49:33.421925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:33.421925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:33.421925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:33.421925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:33.421925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:33.421925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:33.421925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:33.421925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:33.421925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:33.421925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:33.421925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:33.421925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:33.422790 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:33.422790 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:33.422790 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:33.422790 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:33.422790 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:49:33.422790 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:49:33.422790 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:49:33.422790 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:49:33.422790 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:49:33.422790 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:49:33.422790 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:33.422790 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:33.424819 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 335/640] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Aug 2 08:49:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:33.425582 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0531478-5967-4bed-ae0a-dd48562de3ac None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:33.426064 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0531478-5967-4bed-ae0a-dd48562de3ac None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:33.426540 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0531478-5967-4bed-ae0a-dd48562de3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:33.454587 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9826ad0-f02b-41d7-b638-e51fe047c108 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:33.460181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-b0531478-5967-4bed-ae0a-dd48562de3ac None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:33.462860 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-b0531478-5967-4bed-ae0a-dd48562de3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:33.489458 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:33.521616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c8f13-cc28-459e-a0fe-0bac01c5a6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:33.522681 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c8f13-cc28-459e-a0fe-0bac01c5a6ae None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:33.524099 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c8f13-cc28-459e-a0fe-0bac01c5a6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:33.524718 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c8f13-cc28-459e-a0fe-0bac01c5a6ae None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:33.526018 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c8f13-cc28-459e-a0fe-0bac01c5a6ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:33.526568 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c8f13-cc28-459e-a0fe-0bac01c5a6ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:33.529334 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c8f13-cc28-459e-a0fe-0bac01c5a6ae None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:33.560216 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 306/641] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:33.560216 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c8f13-cc28-459e-a0fe-0bac01c5a6ae None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:33.604196 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 336/642] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:49:33.604196 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0531478-5967-4bed-ae0a-dd48562de3ac None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:33.673670 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:33.752455 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c8f13-cc28-459e-a0fe-0bac01c5a6ae None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:33.769563 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0531478-5967-4bed-ae0a-dd48562de3ac None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:33.798299 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7478b-c6e9-4da7-9d16-bdbd64b9d7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:33.799130 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7478b-c6e9-4da7-9d16-bdbd64b9d7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:33.799416 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7478b-c6e9-4da7-9d16-bdbd64b9d7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:33.799697 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7478b-c6e9-4da7-9d16-bdbd64b9d7a8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:33.811982 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7478b-c6e9-4da7-9d16-bdbd64b9d7a8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:33.814928 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7478b-c6e9-4da7-9d16-bdbd64b9d7a8 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:33.817385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfd3e3-ae3f-4d7c-87ab-a9a5ac74afa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:33.818048 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfd3e3-ae3f-4d7c-87ab-a9a5ac74afa2 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:33.818337 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfd3e3-ae3f-4d7c-87ab-a9a5ac74afa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:33.818614 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfd3e3-ae3f-4d7c-87ab-a9a5ac74afa2 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:33.819364 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfd3e3-ae3f-4d7c-87ab-a9a5ac74afa2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:33.819684 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfd3e3-ae3f-4d7c-87ab-a9a5ac74afa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:33.822248 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfd3e3-ae3f-4d7c-87ab-a9a5ac74afa2 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:33.831637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 337/643] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Aug 2 08:49:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:33.832544 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfd3e3-ae3f-4d7c-87ab-a9a5ac74afa2 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:33.841397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-95c7478b-c6e9-4da7-9d16-bdbd64b9d7a8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:49:33.841397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:33.841397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:33.841397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:33.841397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:33.841397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:33.841397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:33.841397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:33.841397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:33.841397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:33.841397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:33.841397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:33.841397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:49:33.841397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:49:33.841397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:49:33.841397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:49:33.843621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:33.843621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:33.843621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:49:33.843621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:33.843621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:49:33.843621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:33.843621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:33.843621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:33.843621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:33.843621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:33.843621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:33.843621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:33.843621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:33.843621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:33.843621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:33.843621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:33.843621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:33.843621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:33.845641 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:33.845641 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:33.845641 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:49:33.845641 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:49:33.845641 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:49:33.845641 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:49:33.845641 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:49:33.845641 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:49:33.845641 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:49:33.845641 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:33.847388 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 307/644] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Aug 2 08:49:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:33.847388 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7478b-c6e9-4da7-9d16-bdbd64b9d7a8 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:33.866095 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:33.978058 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7478b-c6e9-4da7-9d16-bdbd64b9d7a8 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:33.994654 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:34.016491 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfd3e3-ae3f-4d7c-87ab-a9a5ac74afa2 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:34.024906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd54657-c173-487e-9141-f6c56ce428a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:34.026130 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd54657-c173-487e-9141-f6c56ce428a9 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:34.026612 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd54657-c173-487e-9141-f6c56ce428a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:34.027612 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd54657-c173-487e-9141-f6c56ce428a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:34.041555 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd54657-c173-487e-9141-f6c56ce428a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:49:34.050889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-ccd54657-c173-487e-9141-f6c56ce428a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:34.050889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:34.050889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:34.050889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:34.050889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:34.050889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:34.050889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:34.050889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:34.050889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:34.050889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:34.050889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:34.050889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:34.050889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:49:34.050889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:49:34.050889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:49:34.050889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:49:34.052575 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:49:34.052575 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:49:34.052575 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:49:34.052575 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:49:34.052575 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:34.052575 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:34.052575 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:34.052575 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:34.052575 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:34.052575 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:34.052575 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:34.052575 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:34.052575 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:34.052575 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:34.052575 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:34.052575 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:34.055542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:34.055542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:34.055542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:34.055542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:34.055542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:49:34.055542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:49:34.055542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:49:34.055542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:49:34.055542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:49:34.055542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:49:34.055542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:34.055542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:34.055542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 308/645] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Aug 2 08:49:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:34.055542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd54657-c173-487e-9141-f6c56ce428a9 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:34.069748 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589d835-1e83-4f4b-a9fa-bec329b87ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:34.071101 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589d835-1e83-4f4b-a9fa-bec329b87ade None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:34.071562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589d835-1e83-4f4b-a9fa-bec329b87ade None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:34.072020 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589d835-1e83-4f4b-a9fa-bec329b87ade None admin] PATH_INFO: `/v3/projects/service` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:34.081405 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4589d835-1e83-4f4b-a9fa-bec329b87ade None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:34.083146 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4589d835-1e83-4f4b-a9fa-bec329b87ade None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:34.098794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-4589d835-1e83-4f4b-a9fa-bec329b87ade None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:34.098794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:34.098794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:34.098794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:34.098794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:34.098794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:34.098794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:34.098794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:34.098794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:34.098794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:34.098794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:34.098794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:34.098794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:49:34.098794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:49:34.098794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:49:34.099865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:49:34.099865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:34.099865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:34.099865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:34.099865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:34.099865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:34.099865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:34.099865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:34.099865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:34.099865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:34.099865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:34.099865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:34.099865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:34.099865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:34.099865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:34.099865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:34.099865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:34.101023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:49:34.101023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:49:34.101023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:49:34.101023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:49:34.101023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:49:34.101023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:49:34.101023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:34.101023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:34.101023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 338/646] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:49:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:34.102457 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589d835-1e83-4f4b-a9fa-bec329b87ade None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:34.193822 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd54657-c173-487e-9141-f6c56ce428a9 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:34.200691 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:34.242441 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589d835-1e83-4f4b-a9fa-bec329b87ade None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:34.247516 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a6939-b35c-47c1-a68f-d292235a125a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:34.248333 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a6939-b35c-47c1-a68f-d292235a125a None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:34.248708 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a6939-b35c-47c1-a68f-d292235a125a None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:34.249066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a6939-b35c-47c1-a68f-d292235a125a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:34.263778 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a6939-b35c-47c1-a68f-d292235a125a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:34.265541 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a6939-b35c-47c1-a68f-d292235a125a None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:34.293888 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-6e9a6939-b35c-47c1-a68f-d292235a125a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:34.293888 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:34.293888 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:34.293888 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:34.293888 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:34.293888 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:34.293888 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:34.293888 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:34.293888 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:34.293888 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:34.293888 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:34.293888 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:34.293888 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:34.293888 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:34.293888 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:34.295624 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:34.295624 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:34.295624 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:34.295624 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:34.295624 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:34.295624 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:34.295624 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:34.295624 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:34.295624 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:34.295624 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:34.295624 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:34.295624 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:34.295624 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:34.295624 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:34.295624 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:34.295624 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:34.295624 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:34.297898 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:34.297898 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:34.297898 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:34.297898 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:34.297898 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 309/647] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:34.297898 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a6939-b35c-47c1-a68f-d292235a125a None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:34.312962 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fec57-6dd5-4f80-8faf-ea4df7a8d9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:34.313686 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fec57-6dd5-4f80-8faf-ea4df7a8d9df None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:34.313970 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fec57-6dd5-4f80-8faf-ea4df7a8d9df None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:34.314238 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fec57-6dd5-4f80-8faf-ea4df7a8d9df None admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:34.315038 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77fec57-6dd5-4f80-8faf-ea4df7a8d9df None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:34.315338 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77fec57-6dd5-4f80-8faf-ea4df7a8d9df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:34.317094 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77fec57-6dd5-4f80-8faf-ea4df7a8d9df None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:34.326200 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:34.340696 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 339/648] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Aug 2 08:49:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:34.341656 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fec57-6dd5-4f80-8faf-ea4df7a8d9df None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:34.427234 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a6939-b35c-47c1-a68f-d292235a125a None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:34.472404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f09d9-0e5b-4b8c-ac1e-08f84b7784cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:34.473295 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f09d9-0e5b-4b8c-ac1e-08f84b7784cc None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:34.473653 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f09d9-0e5b-4b8c-ac1e-08f84b7784cc None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:34.474010 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f09d9-0e5b-4b8c-ac1e-08f84b7784cc None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:34.474755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f09d9-0e5b-4b8c-ac1e-08f84b7784cc None admin] RBAC: Adding query filter params (name=service) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:34.475068 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f09d9-0e5b-4b8c-ac1e-08f84b7784cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:34.476846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f09d9-0e5b-4b8c-ac1e-08f84b7784cc None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:34.477341 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fec57-6dd5-4f80-8faf-ea4df7a8d9df None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:34.486676 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 310/649] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Aug 2 08:49:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:34.487558 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f09d9-0e5b-4b8c-ac1e-08f84b7784cc None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:34.528352 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:34.538306 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605dbe9b-7e62-44c4-9e9f-63612542bcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:34.539253 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605dbe9b-7e62-44c4-9e9f-63612542bcec None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:34.539713 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605dbe9b-7e62-44c4-9e9f-63612542bcec None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:34.540209 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605dbe9b-7e62-44c4-9e9f-63612542bcec None admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:34.541508 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605dbe9b-7e62-44c4-9e9f-63612542bcec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:34.542021 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605dbe9b-7e62-44c4-9e9f-63612542bcec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:34.544539 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605dbe9b-7e62-44c4-9e9f-63612542bcec None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:34.565354 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 340/650] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:49:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:34.566842 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605dbe9b-7e62-44c4-9e9f-63612542bcec None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:34.645970 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:34.666090 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f09d9-0e5b-4b8c-ac1e-08f84b7784cc None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:34.708849 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3112350-5227-4cde-8360-bdc032b14dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:34.709515 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3112350-5227-4cde-8360-bdc032b14dec None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:34.709800 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3112350-5227-4cde-8360-bdc032b14dec None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:34.710051 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3112350-5227-4cde-8360-bdc032b14dec None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:34.711638 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3112350-5227-4cde-8360-bdc032b14dec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:34.712004 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3112350-5227-4cde-8360-bdc032b14dec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:34.713615 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3112350-5227-4cde-8360-bdc032b14dec None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:34.722052 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605dbe9b-7e62-44c4-9e9f-63612542bcec None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:34.737247 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 311/651] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:34.737247 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3112350-5227-4cde-8360-bdc032b14dec None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:34.775959 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed30be-b86e-4048-96f8-d28d34f108fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:34.776733 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed30be-b86e-4048-96f8-d28d34f108fb None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:34.777006 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed30be-b86e-4048-96f8-d28d34f108fb None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:34.777279 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed30be-b86e-4048-96f8-d28d34f108fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:34.849466 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:34.865019 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed30be-b86e-4048-96f8-d28d34f108fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:34.866835 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed30be-b86e-4048-96f8-d28d34f108fb None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:34.871935 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3112350-5227-4cde-8360-bdc032b14dec None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:34.916733 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c7dc6-cb5f-48dd-be43-7b62c76c0c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:34.917399 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c7dc6-cb5f-48dd-be43-7b62c76c0c2a None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:34.917684 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c7dc6-cb5f-48dd-be43-7b62c76c0c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:34.917964 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c7dc6-cb5f-48dd-be43-7b62c76c0c2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:34.930845 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c7dc6-cb5f-48dd-be43-7b62c76c0c2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:34.932614 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c7dc6-cb5f-48dd-be43-7b62c76c0c2a None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:34.943201 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:34.950129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-735c7dc6-cb5f-48dd-be43-7b62c76c0c2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:34.950129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:34.950129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:34.950129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:34.950129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:34.950129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:34.950129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:34.950129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:34.950129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:34.950129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:34.950129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:34.950129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:34.950129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:34.950129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:34.950129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:34.951493 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:34.951493 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:34.951493 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:34.951493 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:34.951493 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:34.951493 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:34.951493 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:34.951493 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:34.951493 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:34.951493 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:34.951493 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:34.951493 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:34.951493 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:34.951493 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:34.951493 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:34.951493 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:34.951493 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:34.959114 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:34.959114 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:34.959114 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:34.959114 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:34.959114 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 312/652] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:34.959114 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c7dc6-cb5f-48dd-be43-7b62c76c0c2a None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:35.001237 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 341/653] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:49:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:49:35.002364 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed30be-b86e-4048-96f8-d28d34f108fb None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:35.083870 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c7dc6-cb5f-48dd-be43-7b62c76c0c2a None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:35.109143 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:35.130281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed30be-b86e-4048-96f8-d28d34f108fb None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:35.134057 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2760a11-48f6-4a1c-ad3f-fc3db168f7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:35.134687 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2760a11-48f6-4a1c-ad3f-fc3db168f7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:35.134961 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2760a11-48f6-4a1c-ad3f-fc3db168f7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:35.135230 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2760a11-48f6-4a1c-ad3f-fc3db168f7a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:35.136057 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2760a11-48f6-4a1c-ad3f-fc3db168f7a4 None admin] RBAC: Adding query filter params (role.id=bc21bdc3d9dd4091a04f1e2fef77a8c3, scope.project.id=6910e69702854607889bab124edd60c9, user.id=bca8afe2c10f4db58716aacfd373504b) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:35.136476 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2760a11-48f6-4a1c-ad3f-fc3db168f7a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:35.137997 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2760a11-48f6-4a1c-ad3f-fc3db168f7a4 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:35.144751 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 313/654] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:49:34 2022] GET /identity/v3/role_assignments?user.id=bca8afe2c10f4db58716aacfd373504b&scope.project.id=6910e69702854607889bab124edd60c9&role.id=bc21bdc3d9dd4091a04f1e2fef77a8c3 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:35.146036 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515960fb-2eab-4f88-880b-3254ef8fadc5 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:35.146526 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515960fb-2eab-4f88-880b-3254ef8fadc5 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:35.146720 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515960fb-2eab-4f88-880b-3254ef8fadc5 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:35.149032 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 314/655] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:35.149689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515960fb-2eab-4f88-880b-3254ef8fadc5 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:35.182510 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec49ce-3317-4d1f-9ac6-276ba829314b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:35.183165 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec49ce-3317-4d1f-9ac6-276ba829314b None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:35.183454 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec49ce-3317-4d1f-9ac6-276ba829314b None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:35.183735 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec49ce-3317-4d1f-9ac6-276ba829314b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:35.194316 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec49ce-3317-4d1f-9ac6-276ba829314b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:35.196291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec49ce-3317-4d1f-9ac6-276ba829314b None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:35.211866 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-cdec49ce-3317-4d1f-9ac6-276ba829314b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 08:49:35.211866 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:35.211866 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:35.211866 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:35.211866 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:35.211866 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:35.211866 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:35.211866 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:35.211866 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:35.211866 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:35.211866 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:35.211866 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:35.211866 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:49:35.211866 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:49:35.211866 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:49:35.211866 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:49:35.213742 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:35.213742 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:35.213742 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:49:35.213742 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:35.213742 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:49:35.213742 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:35.213742 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:35.213742 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:35.213742 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:35.213742 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:35.213742 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:35.213742 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:35.213742 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:35.213742 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:35.213742 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:35.213742 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:35.213742 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:35.213742 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:35.215603 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:35.215603 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:35.215603 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:49:35.215603 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:49:35.215603 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:49:35.215603 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:49:35.215603 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:49:35.215603 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:49:35.215603 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 08:49:35.215603 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:35.215603 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 342/656] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:49:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:35.215603 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec49ce-3317-4d1f-9ac6-276ba829314b None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:35.274810 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:35.341374 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515960fb-2eab-4f88-880b-3254ef8fadc5 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:35.397006 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec49ce-3317-4d1f-9ac6-276ba829314b None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:35.404066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea030a-7d03-45d1-a596-192be7ca963f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:35.404066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea030a-7d03-45d1-a596-192be7ca963f None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:35.404066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea030a-7d03-45d1-a596-192be7ca963f None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:35.404066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea030a-7d03-45d1-a596-192be7ca963f None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:35.404675 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea030a-7d03-45d1-a596-192be7ca963f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:35.404675 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea030a-7d03-45d1-a596-192be7ca963f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:35.404675 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea030a-7d03-45d1-a596-192be7ca963f None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:35.425821 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 315/657] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:35.428263 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41035e09-865b-43f8-9513-cd50a836831b None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:35.428728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41035e09-865b-43f8-9513-cd50a836831b None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:35.429923 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41035e09-865b-43f8-9513-cd50a836831b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:35.457240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-41035e09-865b-43f8-9513-cd50a836831b None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:35.458823 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a8eae-a98f-4554-8f4f-162bae814970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:35.459102 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-41035e09-865b-43f8-9513-cd50a836831b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:35.459813 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a8eae-a98f-4554-8f4f-162bae814970 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:35.460352 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a8eae-a98f-4554-8f4f-162bae814970 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:35.460786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a8eae-a98f-4554-8f4f-162bae814970 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:35.478460 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a8eae-a98f-4554-8f4f-162bae814970 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:35.481076 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a8eae-a98f-4554-8f4f-162bae814970 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:35.500691 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-884a8eae-a98f-4554-8f4f-162bae814970 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:35.500691 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:35.500691 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:35.500691 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:35.500691 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:35.500691 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:35.500691 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:35.500691 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:35.500691 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:35.500691 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:35.500691 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:35.500691 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:35.500691 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:35.500691 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:35.500691 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:35.501715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:35.501715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:35.501715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:35.501715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:35.501715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:35.501715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:35.501715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:35.501715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:35.501715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:35.501715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:35.501715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:35.501715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:35.501715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:35.501715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:35.501715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:35.501715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:35.501715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:35.502926 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:35.502926 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:35.502926 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:35.502926 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:35.502926 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 343/658] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:35.503333 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a8eae-a98f-4554-8f4f-162bae814970 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:35.506939 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:35.576268 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 316/659] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:49:35.576268 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41035e09-865b-43f8-9513-cd50a836831b None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:35.679044 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:35.688085 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a8eae-a98f-4554-8f4f-162bae814970 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:35.738891 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1edd10-6d1a-49b5-85c4-ed72ba250a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:35.739722 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1edd10-6d1a-49b5-85c4-ed72ba250a7f None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:35.740219 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1edd10-6d1a-49b5-85c4-ed72ba250a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:35.740641 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1edd10-6d1a-49b5-85c4-ed72ba250a7f None admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:35.741999 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1edd10-6d1a-49b5-85c4-ed72ba250a7f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:35.742648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1edd10-6d1a-49b5-85c4-ed72ba250a7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:35.745530 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1edd10-6d1a-49b5-85c4-ed72ba250a7f None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:35.746062 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41035e09-865b-43f8-9513-cd50a836831b None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:35.783483 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 344/660] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Aug 2 08:49:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:35.783483 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1edd10-6d1a-49b5-85c4-ed72ba250a7f None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:35.816951 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d344e69-9c8b-49ea-8715-5e8961842e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:35.817826 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d344e69-9c8b-49ea-8715-5e8961842e54 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:35.818291 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d344e69-9c8b-49ea-8715-5e8961842e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:35.818701 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d344e69-9c8b-49ea-8715-5e8961842e54 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:35.829427 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d344e69-9c8b-49ea-8715-5e8961842e54 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:35.831082 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d344e69-9c8b-49ea-8715-5e8961842e54 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:35.845621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-3d344e69-9c8b-49ea-8715-5e8961842e54 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 08:49:35.845621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:35.845621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:35.845621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:35.845621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:35.845621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:35.845621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:35.845621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:35.845621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:35.845621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:35.845621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:35.845621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:35.845621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:49:35.845621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:49:35.845621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:49:35.845621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:49:35.852798 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:35.852798 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:35.852798 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:49:35.852798 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:35.852798 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:49:35.852798 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:35.852798 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:35.852798 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:35.852798 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:35.852798 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:35.852798 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:35.852798 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:35.852798 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:35.852798 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:35.852798 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:35.852798 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:35.852798 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:35.852798 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:35.854276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:35.854276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:35.854276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:49:35.854276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:49:35.854276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:49:35.854276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:49:35.854276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:49:35.854276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:49:35.854276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 08:49:35.854276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:35.854276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 317/661] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Aug 2 08:49:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:35.854276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d344e69-9c8b-49ea-8715-5e8961842e54 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:35.870514 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:35.926031 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1edd10-6d1a-49b5-85c4-ed72ba250a7f None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:35.975703 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f86c9c-76dc-4ed5-9408-903a9fcf7554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:35.977275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f86c9c-76dc-4ed5-9408-903a9fcf7554 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:35.977920 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f86c9c-76dc-4ed5-9408-903a9fcf7554 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:35.978348 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f86c9c-76dc-4ed5-9408-903a9fcf7554 None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:35.979230 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f86c9c-76dc-4ed5-9408-903a9fcf7554 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:35.979837 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f86c9c-76dc-4ed5-9408-903a9fcf7554 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:35.981463 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f86c9c-76dc-4ed5-9408-903a9fcf7554 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:36.000262 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d344e69-9c8b-49ea-8715-5e8961842e54 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:36.003027 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 345/662] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:36.003695 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f86c9c-76dc-4ed5-9408-903a9fcf7554 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:36.025312 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:36.073670 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d475b1c-cf29-4839-8580-8f2c1b750073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:36.074347 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d475b1c-cf29-4839-8580-8f2c1b750073 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:36.074632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d475b1c-cf29-4839-8580-8f2c1b750073 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:36.075070 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d475b1c-cf29-4839-8580-8f2c1b750073 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:36.090211 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d475b1c-cf29-4839-8580-8f2c1b750073 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:49:36.097797 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-2d475b1c-cf29-4839-8580-8f2c1b750073 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:36.097797 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:36.097797 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:36.097797 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:36.097797 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:36.097797 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:36.097797 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:36.097797 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:36.097797 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:36.097797 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:36.097797 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:36.097797 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:36.097797 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:49:36.097797 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:49:36.097797 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:49:36.097797 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:49:36.099843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:49:36.099843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:49:36.099843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:49:36.099843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:49:36.099843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:36.099843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:36.099843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:36.099843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:36.099843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:36.099843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:36.099843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:36.099843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:36.099843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:36.099843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:36.099843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:36.099843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:36.101679 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:36.101679 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:36.101679 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:36.101679 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:36.101679 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:49:36.101679 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:49:36.101679 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:49:36.101679 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:49:36.101679 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:49:36.101679 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:49:36.101679 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:36.101679 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:36.101679 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 318/663] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Aug 2 08:49:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:36.101679 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d475b1c-cf29-4839-8580-8f2c1b750073 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:36.166910 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f86c9c-76dc-4ed5-9408-903a9fcf7554 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:36.197968 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:36.217073 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e930eb-0031-451f-964c-9799f833d41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:36.217824 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e930eb-0031-451f-964c-9799f833d41d None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:36.218115 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e930eb-0031-451f-964c-9799f833d41d None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:36.218494 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e930eb-0031-451f-964c-9799f833d41d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:36.257839 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d475b1c-cf29-4839-8580-8f2c1b750073 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:36.309368 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9921c74-586e-4b03-b41a-800c0080a4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:36.310076 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9921c74-586e-4b03-b41a-800c0080a4ac None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:36.310267 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9921c74-586e-4b03-b41a-800c0080a4ac None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:36.310605 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9921c74-586e-4b03-b41a-800c0080a4ac None admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:36.311414 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9921c74-586e-4b03-b41a-800c0080a4ac None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:36.311765 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9921c74-586e-4b03-b41a-800c0080a4ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:36.312460 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e930eb-0031-451f-964c-9799f833d41d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:36.313334 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9921c74-586e-4b03-b41a-800c0080a4ac None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:36.313921 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e930eb-0031-451f-964c-9799f833d41d None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:36.339815 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 319/664] 10.222.0.20 () {56 vars in 1139 bytes} [Tue Aug 2 08:49:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:36.340592 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9921c74-586e-4b03-b41a-800c0080a4ac None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:36.395668 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:36.464709 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 346/665] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:49:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:49:36.466304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e930eb-0031-451f-964c-9799f833d41d None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:36.498726 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:36.505589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9921c74-586e-4b03-b41a-800c0080a4ac None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:36.556528 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a04b49-66ec-488d-bbfa-0b58a071b657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:36.557120 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a04b49-66ec-488d-bbfa-0b58a071b657 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:36.557396 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a04b49-66ec-488d-bbfa-0b58a071b657 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:36.557727 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a04b49-66ec-488d-bbfa-0b58a071b657 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:36.567646 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a04b49-66ec-488d-bbfa-0b58a071b657 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:36.570209 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a04b49-66ec-488d-bbfa-0b58a071b657 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:36.587876 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-56a04b49-66ec-488d-bbfa-0b58a071b657 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:36.587876 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:36.587876 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:36.587876 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:36.587876 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:36.587876 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:36.587876 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:36.587876 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:36.587876 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:36.587876 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:36.587876 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:36.587876 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:36.587876 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:49:36.587876 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:49:36.587876 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:49:36.594981 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:49:36.594981 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:36.594981 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:36.594981 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:36.594981 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:36.594981 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:36.594981 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:36.594981 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:36.594981 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:36.594981 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:36.594981 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:36.594981 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:36.594981 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:36.594981 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:36.594981 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:36.594981 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:36.594981 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:36.596103 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:49:36.596103 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:49:36.596103 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:49:36.596103 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:49:36.596103 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:49:36.596103 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:49:36.596103 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:36.596103 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:36.596103 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 320/666] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:49:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:36.596103 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a04b49-66ec-488d-bbfa-0b58a071b657 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:36.599098 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e930eb-0031-451f-964c-9799f833d41d None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:36.643240 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e392c-b931-49ca-b598-40f5b03da2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:36.644476 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e392c-b931-49ca-b598-40f5b03da2e4 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:36.645008 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e392c-b931-49ca-b598-40f5b03da2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:36.646347 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e392c-b931-49ca-b598-40f5b03da2e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:36.649409 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e392c-b931-49ca-b598-40f5b03da2e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:36.649921 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e392c-b931-49ca-b598-40f5b03da2e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:36.651910 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e392c-b931-49ca-b598-40f5b03da2e4 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:36.662275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 347/667] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Aug 2 08:49:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:36.663229 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e392c-b931-49ca-b598-40f5b03da2e4 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:36.728385 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:36.742930 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a04b49-66ec-488d-bbfa-0b58a071b657 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:36.793118 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:36.796479 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6e95b-93bd-44df-a738-d67d250a295c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:36.797276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6e95b-93bd-44df-a738-d67d250a295c None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:36.797657 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6e95b-93bd-44df-a738-d67d250a295c None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:36.798000 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6e95b-93bd-44df-a738-d67d250a295c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:36.820910 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e392c-b931-49ca-b598-40f5b03da2e4 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:36.884391 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c13c0-7837-4439-873b-4f02e50d1748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:36.885070 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c13c0-7837-4439-873b-4f02e50d1748 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:36.885406 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c13c0-7837-4439-873b-4f02e50d1748 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:36.885745 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c13c0-7837-4439-873b-4f02e50d1748 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:36.898716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c13c0-7837-4439-873b-4f02e50d1748 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:36.900784 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c13c0-7837-4439-873b-4f02e50d1748 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:36.917234 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6e95b-93bd-44df-a738-d67d250a295c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:36.919898 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6e95b-93bd-44df-a738-d67d250a295c None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:36.920174 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-871c13c0-7837-4439-873b-4f02e50d1748 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:36.920174 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:36.920174 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:36.920174 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:36.920174 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:36.920174 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:36.920174 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:36.920174 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:36.920174 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:36.920174 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:36.920174 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:36.920174 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:36.920174 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:36.920174 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:36.920174 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:36.921249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:36.921249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:36.921249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:36.921249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:36.921249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:36.921249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:36.921249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:36.921249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:36.921249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:36.921249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:36.921249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:36.921249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:36.921249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:36.921249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:36.921249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:36.921249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:36.921249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:36.922365 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:36.922365 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:36.922365 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:36.922365 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:36.926169 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 348/668] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:36.926941 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c13c0-7837-4439-873b-4f02e50d1748 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:37.072813 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:37.077038 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c13c0-7837-4439-873b-4f02e50d1748 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:37.088488 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 321/669] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:49:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:49:37.089516 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6e95b-93bd-44df-a738-d67d250a295c None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:37.133426 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed01bb2-3762-47c7-9324-3673face2164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:37.134335 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed01bb2-3762-47c7-9324-3673face2164 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:37.134799 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed01bb2-3762-47c7-9324-3673face2164 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:37.135257 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed01bb2-3762-47c7-9324-3673face2164 None admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:37.136596 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed01bb2-3762-47c7-9324-3673face2164 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:37.137096 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed01bb2-3762-47c7-9324-3673face2164 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:37.139275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed01bb2-3762-47c7-9324-3673face2164 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:37.143113 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:37.162205 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 349/670] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:49:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:37.164437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed01bb2-3762-47c7-9324-3673face2164 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:37.233025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6e95b-93bd-44df-a738-d67d250a295c None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:37.285856 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af36167-8431-463c-8712-46f915d05eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:37.287055 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af36167-8431-463c-8712-46f915d05eff None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:37.287302 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af36167-8431-463c-8712-46f915d05eff None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:37.287581 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af36167-8431-463c-8712-46f915d05eff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:37.302397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af36167-8431-463c-8712-46f915d05eff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:37.305049 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af36167-8431-463c-8712-46f915d05eff None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:37.324846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-1af36167-8431-463c-8712-46f915d05eff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:37.324846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:37.324846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:37.324846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:37.324846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:37.324846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:37.324846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:37.324846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:37.324846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:37.324846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:37.324846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:37.324846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:37.324846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:37.324846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:37.324846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:37.327573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:37.327573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:37.327573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:37.327573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:37.327573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:37.327573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:37.327573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:37.327573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:37.327573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:37.327573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:37.327573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:37.327573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:37.327573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:37.327573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:37.327573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:37.327573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:37.327573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:37.331037 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:37.331037 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:37.331037 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:37.331037 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:37.331644 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed01bb2-3762-47c7-9324-3673face2164 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:37.331804 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 322/671] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:37.332248 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af36167-8431-463c-8712-46f915d05eff None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:37.378560 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ac61b-39c2-4a81-8ee5-f955068d4c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:37.379578 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ac61b-39c2-4a81-8ee5-f955068d4c8e None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:37.380049 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ac61b-39c2-4a81-8ee5-f955068d4c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:37.380368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ac61b-39c2-4a81-8ee5-f955068d4c8e None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:37.381375 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ac61b-39c2-4a81-8ee5-f955068d4c8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:37.381696 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ac61b-39c2-4a81-8ee5-f955068d4c8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:37.383751 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ac61b-39c2-4a81-8ee5-f955068d4c8e None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:37.400103 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 350/672] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:37.402706 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:37.405352 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ac61b-39c2-4a81-8ee5-f955068d4c8e None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:37.479790 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af36167-8431-463c-8712-46f915d05eff None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:37.485115 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:37.525064 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e0587-a073-4cb7-83dc-0253eb36cd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:37.525725 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e0587-a073-4cb7-83dc-0253eb36cd77 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:37.526016 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e0587-a073-4cb7-83dc-0253eb36cd77 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:37.526284 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e0587-a073-4cb7-83dc-0253eb36cd77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:37.538633 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e0587-a073-4cb7-83dc-0253eb36cd77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:37.540702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e0587-a073-4cb7-83dc-0253eb36cd77 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:37.555729 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ac61b-39c2-4a81-8ee5-f955068d4c8e None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:37.559513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-883e0587-a073-4cb7-83dc-0253eb36cd77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:37.559513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:37.559513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:37.559513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:37.559513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:37.559513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:37.559513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:37.559513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:37.559513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:37.559513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:37.559513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:37.559513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:37.559513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:37.559513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:37.559513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:37.560972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:37.560972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:37.560972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:37.560972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:37.560972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:37.560972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:37.560972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:37.560972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:37.560972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:37.560972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:37.560972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:37.560972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:37.560972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:37.560972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:37.560972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:37.560972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:37.560972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:37.566129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:37.566129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:37.566129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:37.566129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:37.566129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 323/673] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:37.566129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e0587-a073-4cb7-83dc-0253eb36cd77 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:37.608735 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46e835-b98c-4036-bb22-cf59d29d4d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:37.609621 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46e835-b98c-4036-bb22-cf59d29d4d8b None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:37.609939 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46e835-b98c-4036-bb22-cf59d29d4d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:37.610219 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46e835-b98c-4036-bb22-cf59d29d4d8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:37.611044 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d46e835-b98c-4036-bb22-cf59d29d4d8b None admin] RBAC: Adding query filter params (role.id=bc21bdc3d9dd4091a04f1e2fef77a8c3, scope.project.id=6910e69702854607889bab124edd60c9, user.id=7bfcddefa71546d28078a38325c723a9) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:37.611378 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d46e835-b98c-4036-bb22-cf59d29d4d8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:37.613286 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d46e835-b98c-4036-bb22-cf59d29d4d8b None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:37.620913 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 351/674] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:49:37 2022] GET /identity/v3/role_assignments?user.id=7bfcddefa71546d28078a38325c723a9&scope.project.id=6910e69702854607889bab124edd60c9&role.id=bc21bdc3d9dd4091a04f1e2fef77a8c3 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:37.622054 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46e835-b98c-4036-bb22-cf59d29d4d8b None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:37.723952 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:37.731562 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e0587-a073-4cb7-83dc-0253eb36cd77 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:37.785743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ba486-b23c-4810-aafe-5ea1e74b3fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:37.786421 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ba486-b23c-4810-aafe-5ea1e74b3fcc None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:37.786532 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46e835-b98c-4036-bb22-cf59d29d4d8b None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:37.786739 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ba486-b23c-4810-aafe-5ea1e74b3fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:37.786974 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ba486-b23c-4810-aafe-5ea1e74b3fcc None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:37.787885 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ba486-b23c-4810-aafe-5ea1e74b3fcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:37.788116 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ba486-b23c-4810-aafe-5ea1e74b3fcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:37.790495 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ba486-b23c-4810-aafe-5ea1e74b3fcc None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:37.807639 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 324/675] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:37.808611 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ba486-b23c-4810-aafe-5ea1e74b3fcc None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:37.820965 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:37.846733 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c4882-3f48-498f-bb5e-27259a165582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:37.847668 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c4882-3f48-498f-bb5e-27259a165582 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:37.847998 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c4882-3f48-498f-bb5e-27259a165582 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:37.848327 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c4882-3f48-498f-bb5e-27259a165582 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:37.861775 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c4882-3f48-498f-bb5e-27259a165582 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:37.864416 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c4882-3f48-498f-bb5e-27259a165582 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:37.881327 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-407c4882-3f48-498f-bb5e-27259a165582 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:37.881327 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:37.881327 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:37.881327 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:37.881327 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:37.881327 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:37.881327 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:37.881327 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:37.881327 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:37.881327 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:37.881327 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:37.881327 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:37.881327 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:49:37.881327 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:49:37.881327 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:49:37.883624 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:49:37.883624 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:37.883624 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:37.883624 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:37.883624 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:37.883624 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:37.883624 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:37.883624 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:37.883624 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:37.883624 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:37.883624 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:37.883624 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:37.883624 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:37.883624 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:37.883624 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:37.883624 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:37.883624 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:37.884736 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:49:37.884736 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:49:37.884736 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:49:37.884736 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:49:37.884736 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:49:37.884736 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:49:37.884736 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:37.884736 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:37.885723 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 352/676] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:49:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:37.887035 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a17d2-b600-4003-8626-a4fdfa2c86ff None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:37.887469 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a17d2-b600-4003-8626-a4fdfa2c86ff None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:37.887587 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a17d2-b600-4003-8626-a4fdfa2c86ff None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:37.889593 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 353/677] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:37.891010 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a17d2-b600-4003-8626-a4fdfa2c86ff None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:37.957753 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ba486-b23c-4810-aafe-5ea1e74b3fcc None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:38.004673 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76da5a8-54aa-4af4-b901-eb034d81448d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:38.005331 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76da5a8-54aa-4af4-b901-eb034d81448d None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:38.005615 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76da5a8-54aa-4af4-b901-eb034d81448d None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:38.005973 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76da5a8-54aa-4af4-b901-eb034d81448d None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:38.006612 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76da5a8-54aa-4af4-b901-eb034d81448d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:38.006915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76da5a8-54aa-4af4-b901-eb034d81448d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:38.008470 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76da5a8-54aa-4af4-b901-eb034d81448d None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:38.029514 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 325/678] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:38.029514 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76da5a8-54aa-4af4-b901-eb034d81448d None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:38.032038 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a17d2-b600-4003-8626-a4fdfa2c86ff None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:38.049152 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:38.088636 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32f982-b00d-4372-b268-0c7b6064c22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:38.089829 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32f982-b00d-4372-b268-0c7b6064c22e None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:38.090372 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32f982-b00d-4372-b268-0c7b6064c22e None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:38.090946 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32f982-b00d-4372-b268-0c7b6064c22e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:38.107297 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32f982-b00d-4372-b268-0c7b6064c22e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:38.109969 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32f982-b00d-4372-b268-0c7b6064c22e None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:38.134383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-2b32f982-b00d-4372-b268-0c7b6064c22e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:49:38.134383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:38.134383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:38.134383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:38.134383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:38.134383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:38.134383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:38.134383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:38.134383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:38.134383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:38.134383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:38.134383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:38.134383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:49:38.134383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:49:38.134383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:49:38.134383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:49:38.135572 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:38.135572 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:38.135572 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:49:38.135572 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:38.135572 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:49:38.135572 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:38.135572 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:38.135572 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:38.135572 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:38.135572 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:38.135572 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:38.135572 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:38.135572 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:38.135572 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:38.135572 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:38.135572 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:38.135572 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:38.135572 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:38.136740 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:38.136740 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:38.136740 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:49:38.136740 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:49:38.136740 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:49:38.136740 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:49:38.136740 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:49:38.136740 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:49:38.136740 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:49:38.136740 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:38.136740 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 354/679] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:49:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:38.138745 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2abbe-986c-4bbc-9da5-dee3b2ee1f77 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:38.139233 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2abbe-986c-4bbc-9da5-dee3b2ee1f77 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:38.139721 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2abbe-986c-4bbc-9da5-dee3b2ee1f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:38.168468 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76da5a8-54aa-4af4-b901-eb034d81448d None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:38.170372 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-f6e2abbe-986c-4bbc-9da5-dee3b2ee1f77 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:38.172458 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-f6e2abbe-986c-4bbc-9da5-dee3b2ee1f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:38.217366 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:38.218003 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75342f23-5970-42c1-b014-e206d7369d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:38.219051 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75342f23-5970-42c1-b014-e206d7369d12 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:38.219519 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75342f23-5970-42c1-b014-e206d7369d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:38.220000 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75342f23-5970-42c1-b014-e206d7369d12 None admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:38.221423 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75342f23-5970-42c1-b014-e206d7369d12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:38.221954 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75342f23-5970-42c1-b014-e206d7369d12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:38.224969 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75342f23-5970-42c1-b014-e206d7369d12 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:38.247213 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 326/680] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:49:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:38.248865 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75342f23-5970-42c1-b014-e206d7369d12 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:38.276063 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 355/681] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:49:38.277136 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2abbe-986c-4bbc-9da5-dee3b2ee1f77 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:38.377903 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:38.413057 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75342f23-5970-42c1-b014-e206d7369d12 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:38.432932 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2abbe-986c-4bbc-9da5-dee3b2ee1f77 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:38.457980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508efc49-f923-4fc5-a34b-747bd04580ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:38.459022 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508efc49-f923-4fc5-a34b-747bd04580ac None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:38.459508 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508efc49-f923-4fc5-a34b-747bd04580ac None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:38.459929 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508efc49-f923-4fc5-a34b-747bd04580ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:38.469645 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508efc49-f923-4fc5-a34b-747bd04580ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:38.471727 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508efc49-f923-4fc5-a34b-747bd04580ac None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:38.478277 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bf673-875c-4906-a864-6ff7ae78d585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:38.478910 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bf673-875c-4906-a864-6ff7ae78d585 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:38.479189 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bf673-875c-4906-a864-6ff7ae78d585 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:38.479464 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bf673-875c-4906-a864-6ff7ae78d585 None admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:38.480324 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9bf673-875c-4906-a864-6ff7ae78d585 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:38.480665 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9bf673-875c-4906-a864-6ff7ae78d585 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:38.482575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9bf673-875c-4906-a864-6ff7ae78d585 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:38.487675 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-508efc49-f923-4fc5-a34b-747bd04580ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:38.487675 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:38.487675 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:38.487675 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:38.487675 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:38.487675 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:38.487675 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:38.487675 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:38.487675 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:38.487675 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:38.487675 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:38.487675 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:38.487675 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:49:38.487675 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:49:38.487675 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:49:38.489805 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:49:38.489805 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:38.489805 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:38.489805 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:38.489805 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:38.489805 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:38.489805 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:38.489805 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:38.489805 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:38.489805 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:38.489805 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:38.489805 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:38.489805 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:38.489805 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:38.489805 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:38.489805 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:38.489805 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:38.498068 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:49:38.498068 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:49:38.498068 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:49:38.498068 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:49:38.498068 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:49:38.498068 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:49:38.498068 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:38.498068 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:38.498068 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 327/682] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:49:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:38.498068 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508efc49-f923-4fc5-a34b-747bd04580ac None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:38.524988 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 356/683] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Aug 2 08:49:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:38.524988 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bf673-875c-4906-a864-6ff7ae78d585 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:38.562369 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:38.645061 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508efc49-f923-4fc5-a34b-747bd04580ac None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:38.655928 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bf673-875c-4906-a864-6ff7ae78d585 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:38.691934 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329baad3-5949-4894-a92d-b169bca351bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:38.692863 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329baad3-5949-4894-a92d-b169bca351bb None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:38.693302 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329baad3-5949-4894-a92d-b169bca351bb None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:38.693712 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329baad3-5949-4894-a92d-b169bca351bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:38.695216 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329baad3-5949-4894-a92d-b169bca351bb None admin] RBAC: Adding query filter params (role.id=bc21bdc3d9dd4091a04f1e2fef77a8c3, scope.project.id=6910e69702854607889bab124edd60c9, user.id=ada53ed554844560843ab84198ac373c) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:38.695489 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329baad3-5949-4894-a92d-b169bca351bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:38.697695 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329baad3-5949-4894-a92d-b169bca351bb None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:38.700827 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:38.711102 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 328/684] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:49:38 2022] GET /identity/v3/role_assignments?user.id=ada53ed554844560843ab84198ac373c&scope.project.id=6910e69702854607889bab124edd60c9&role.id=bc21bdc3d9dd4091a04f1e2fef77a8c3 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:38.716945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e96dbd-05ef-4530-969b-a6565f8b9f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:38.716945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e96dbd-05ef-4530-969b-a6565f8b9f93 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:38.716945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e96dbd-05ef-4530-969b-a6565f8b9f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:38.716945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e96dbd-05ef-4530-969b-a6565f8b9f93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:38.717602 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329baad3-5949-4894-a92d-b169bca351bb None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:38.731469 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e96dbd-05ef-4530-969b-a6565f8b9f93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:38.733970 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e96dbd-05ef-4530-969b-a6565f8b9f93 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:38.757522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-42e96dbd-05ef-4530-969b-a6565f8b9f93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:38.757522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:38.757522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:38.757522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:38.757522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:38.757522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:38.757522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:38.757522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:38.757522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:38.757522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:38.757522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:38.757522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:38.757522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:38.757522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:38.757522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:38.759275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:38.759275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:38.759275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:38.759275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:38.759275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:38.759275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:38.759275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:38.759275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:38.759275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:38.759275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:38.759275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:38.759275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:38.759275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:38.759275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:38.759275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:38.759275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:38.759275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:38.760876 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:38.760876 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:38.760876 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:38.760876 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:38.760876 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 357/685] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:38.761888 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e96dbd-05ef-4530-969b-a6565f8b9f93 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:38.872677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329baad3-5949-4894-a92d-b169bca351bb None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:38.941533 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:38.944899 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede6049-9533-485b-b581-df50ca3a21b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:38.946495 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede6049-9533-485b-b581-df50ca3a21b2 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:38.947129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede6049-9533-485b-b581-df50ca3a21b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:38.947775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede6049-9533-485b-b581-df50ca3a21b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:38.949934 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede6049-9533-485b-b581-df50ca3a21b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:38.950822 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede6049-9533-485b-b581-df50ca3a21b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:38.953530 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede6049-9533-485b-b581-df50ca3a21b2 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:38.974884 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e96dbd-05ef-4530-969b-a6565f8b9f93 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:38.977388 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 329/686] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:49:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:38.979053 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede6049-9533-485b-b581-df50ca3a21b2 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:39.033785 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6198871-352c-427f-ae27-2a8402ada558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:39.034598 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6198871-352c-427f-ae27-2a8402ada558 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:39.034957 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6198871-352c-427f-ae27-2a8402ada558 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:39.035305 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6198871-352c-427f-ae27-2a8402ada558 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:39.074884 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:39.136328 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6198871-352c-427f-ae27-2a8402ada558 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:39.138219 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6198871-352c-427f-ae27-2a8402ada558 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:39.155839 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede6049-9533-485b-b581-df50ca3a21b2 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:39.222898 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070b0dc-e191-4471-bede-126bf9e66eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:39.223854 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070b0dc-e191-4471-bede-126bf9e66eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:39.224352 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070b0dc-e191-4471-bede-126bf9e66eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:39.224919 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070b0dc-e191-4471-bede-126bf9e66eb6 None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:39.227313 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070b0dc-e191-4471-bede-126bf9e66eb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:39.227479 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070b0dc-e191-4471-bede-126bf9e66eb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:39.229882 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070b0dc-e191-4471-bede-126bf9e66eb6 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:39.247511 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:39.261152 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 330/687] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:39.265862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070b0dc-e191-4471-bede-126bf9e66eb6 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:39.276812 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 358/688] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:49:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:49:39.278015 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6198871-352c-427f-ae27-2a8402ada558 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:39.395246 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6198871-352c-427f-ae27-2a8402ada558 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:39.442583 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb94de2f-afd8-4534-b4e3-5481e7fc0dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:39.443673 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94de2f-afd8-4534-b4e3-5481e7fc0dd9 None admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:39.444192 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94de2f-afd8-4534-b4e3-5481e7fc0dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:39.445305 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94de2f-afd8-4534-b4e3-5481e7fc0dd9 None admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:39.446875 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb94de2f-afd8-4534-b4e3-5481e7fc0dd9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:39.449673 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb94de2f-afd8-4534-b4e3-5481e7fc0dd9 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:39.453541 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070b0dc-e191-4471-bede-126bf9e66eb6 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:39.481080 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:39.497707 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0a2e8-4721-4f85-a4bd-05bc36d230b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:39.498472 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0a2e8-4721-4f85-a4bd-05bc36d230b5 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:39.498643 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0a2e8-4721-4f85-a4bd-05bc36d230b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:39.499005 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0a2e8-4721-4f85-a4bd-05bc36d230b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:39.499807 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b0a2e8-4721-4f85-a4bd-05bc36d230b5 None admin] RBAC: Adding query filter params (role.id=bc21bdc3d9dd4091a04f1e2fef77a8c3, scope.project.id=6910e69702854607889bab124edd60c9, user.id=6128f07ffd5f4357968b0e2e300f2e09) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:39.500119 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b0a2e8-4721-4f85-a4bd-05bc36d230b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:39.501623 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b0a2e8-4721-4f85-a4bd-05bc36d230b5 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:39.516345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 331/689] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:49:39 2022] GET /identity/v3/role_assignments?user.id=6128f07ffd5f4357968b0e2e300f2e09&scope.project.id=6910e69702854607889bab124edd60c9&role.id=bc21bdc3d9dd4091a04f1e2fef77a8c3 => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:39.516345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0a2e8-4721-4f85-a4bd-05bc36d230b5 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:39.571001 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 359/690] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Aug 2 08:49:39 2022] POST /identity/v3/users => generated 254 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:49:39.760418 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0a2e8-4721-4f85-a4bd-05bc36d230b5 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:39.810767 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6c7fa-0852-4d6c-ad7b-823a5c5c2478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:39.811739 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6c7fa-0852-4d6c-ad7b-823a5c5c2478 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:39.812185 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6c7fa-0852-4d6c-ad7b-823a5c5c2478 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:39.812614 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6c7fa-0852-4d6c-ad7b-823a5c5c2478 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:39.826080 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6c7fa-0852-4d6c-ad7b-823a5c5c2478 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:39.827808 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6c7fa-0852-4d6c-ad7b-823a5c5c2478 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:39.844708 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-fbd6c7fa-0852-4d6c-ad7b-823a5c5c2478 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:39.844708 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:39.844708 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:39.844708 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:39.844708 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:39.844708 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:39.844708 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:39.844708 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:39.844708 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:39.844708 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:39.844708 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:39.844708 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:39.844708 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:39.844708 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:39.844708 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:39.845763 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:39.845763 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:39.845763 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:39.845763 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:39.845763 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:39.845763 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:39.845763 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:39.845763 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:39.845763 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:39.845763 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:39.845763 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:39.845763 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:39.845763 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:39.845763 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:39.845763 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:39.845763 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:39.845763 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:39.846736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:39.846736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:39.846736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:39.846736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:39.848670 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 332/691] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:39.856873 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb94de2f-afd8-4534-b4e3-5481e7fc0dd9 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:39.904142 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:40.013380 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb94de2f-afd8-4534-b4e3-5481e7fc0dd9 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:40.076331 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef66e7-8d06-4807-9b4b-b379b3cb6e6e None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:40.076657 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef66e7-8d06-4807-9b4b-b379b3cb6e6e None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:40.076935 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef66e7-8d06-4807-9b4b-b379b3cb6e6e None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:40.079703 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 333/692] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:49:40.080089 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a233f0f-3df4-491c-8b60-8cf579c86a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:40.081468 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a233f0f-3df4-491c-8b60-8cf579c86a1b None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:40.082181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a233f0f-3df4-491c-8b60-8cf579c86a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:40.082670 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a233f0f-3df4-491c-8b60-8cf579c86a1b None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:40.083823 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a233f0f-3df4-491c-8b60-8cf579c86a1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:40.084331 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a233f0f-3df4-491c-8b60-8cf579c86a1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:40.084855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffc0ba-ed55-4c63-bc09-5a8378ad868d None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:40.085675 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffc0ba-ed55-4c63-bc09-5a8378ad868d None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:40.086067 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffc0ba-ed55-4c63-bc09-5a8378ad868d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:40.087553 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a233f0f-3df4-491c-8b60-8cf579c86a1b None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:40.112072 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-b5ffc0ba-ed55-4c63-bc09-5a8378ad868d None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:40.113366 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-b5ffc0ba-ed55-4c63-bc09-5a8378ad868d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:40.118094 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 360/693] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:40.124298 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a233f0f-3df4-491c-8b60-8cf579c86a1b None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:40.187078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:40.256224 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 334/694] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:49:40.283090 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:40.292011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a233f0f-3df4-491c-8b60-8cf579c86a1b None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:40.296496 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ffc0ba-ed55-4c63-bc09-5a8378ad868d None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:40.393961 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf91bb-2b9c-4de3-8fdc-22b831e90b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:40.394631 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf91bb-2b9c-4de3-8fdc-22b831e90b50 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:40.394910 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf91bb-2b9c-4de3-8fdc-22b831e90b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:40.395183 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf91bb-2b9c-4de3-8fdc-22b831e90b50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:40.413062 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf91bb-2b9c-4de3-8fdc-22b831e90b50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:40.415515 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf91bb-2b9c-4de3-8fdc-22b831e90b50 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:40.438756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-6dbf91bb-2b9c-4de3-8fdc-22b831e90b50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:40.438756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:40.438756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:40.438756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:40.438756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:40.438756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:40.438756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:40.438756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:40.438756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:40.438756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:40.438756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:40.438756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:40.438756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:49:40.438756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:49:40.438756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:49:40.441927 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:49:40.441927 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:40.441927 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:40.441927 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:40.441927 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:40.441927 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:40.441927 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:40.441927 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:40.441927 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:40.441927 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:40.441927 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:40.441927 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:40.441927 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:40.441927 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:40.441927 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:40.441927 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:40.441927 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:40.448296 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:49:40.448296 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:49:40.448296 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:49:40.448296 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:49:40.448296 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:49:40.448296 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:49:40.448296 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:40.448296 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:40.448296 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 361/695] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:49:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:40.448296 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf91bb-2b9c-4de3-8fdc-22b831e90b50 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:40.464643 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ffc0ba-ed55-4c63-bc09-5a8378ad868d None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:40.507548 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da5680-2d84-4c93-b111-10fdde9fc444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:40.509995 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da5680-2d84-4c93-b111-10fdde9fc444 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:40.510260 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da5680-2d84-4c93-b111-10fdde9fc444 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:40.510675 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da5680-2d84-4c93-b111-10fdde9fc444 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:40.525621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da5680-2d84-4c93-b111-10fdde9fc444 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:49:40.531044 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-a3da5680-2d84-4c93-b111-10fdde9fc444 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:49:40.531044 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:40.531044 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:40.531044 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:40.531044 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:40.531044 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:40.531044 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:40.531044 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:40.531044 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:40.531044 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:40.531044 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:40.531044 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:40.531044 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:49:40.531044 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:49:40.531044 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:49:40.531044 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:49:40.534590 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:49:40.534590 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:49:40.534590 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:49:40.534590 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:49:40.534590 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:40.534590 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:40.534590 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:40.534590 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:40.534590 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:40.534590 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:40.534590 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:40.534590 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:40.534590 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:40.534590 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:40.534590 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:40.534590 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:40.536906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:40.536906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:40.536906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:40.536906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:40.536906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:49:40.536906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:49:40.536906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:49:40.536906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:49:40.536906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:49:40.536906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:49:40.536906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:49:40.536906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:40.536906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 335/696] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:49:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:49:40.544222 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da5680-2d84-4c93-b111-10fdde9fc444 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:40.617994 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:40.646041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf91bb-2b9c-4de3-8fdc-22b831e90b50 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:40.724184 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da5680-2d84-4c93-b111-10fdde9fc444 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:40.735960 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f09e1-e174-40ab-8399-b28551069b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:40.737067 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f09e1-e174-40ab-8399-b28551069b30 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:40.737502 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f09e1-e174-40ab-8399-b28551069b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:40.737920 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f09e1-e174-40ab-8399-b28551069b30 None admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:40.738843 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f09e1-e174-40ab-8399-b28551069b30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:40.739336 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f09e1-e174-40ab-8399-b28551069b30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:40.740996 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f09e1-e174-40ab-8399-b28551069b30 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:40.769519 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 362/697] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:49:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:40.779393 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f09e1-e174-40ab-8399-b28551069b30 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:40.815583 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52621dd-753a-4766-b053-ba04659b7141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:40.817063 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52621dd-753a-4766-b053-ba04659b7141 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:40.817795 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52621dd-753a-4766-b053-ba04659b7141 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:40.818427 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52621dd-753a-4766-b053-ba04659b7141 None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:40.820968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52621dd-753a-4766-b053-ba04659b7141 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:40.823323 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52621dd-753a-4766-b053-ba04659b7141 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:40.829598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52621dd-753a-4766-b053-ba04659b7141 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:40.832747 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:40.862186 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 336/698] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:49:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:40.865879 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52621dd-753a-4766-b053-ba04659b7141 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:41.048678 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:41.051087 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f09e1-e174-40ab-8399-b28551069b30 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:41.072607 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52621dd-753a-4766-b053-ba04659b7141 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:41.158666 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dffb68-8df2-4cad-aa4d-0a1e29ab3786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:41.159885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dffb68-8df2-4cad-aa4d-0a1e29ab3786 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:41.161761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dffb68-8df2-4cad-aa4d-0a1e29ab3786 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:41.162638 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dffb68-8df2-4cad-aa4d-0a1e29ab3786 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:41.167202 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dffb68-8df2-4cad-aa4d-0a1e29ab3786 None admin] RBAC: Adding query filter params (role.id=bc21bdc3d9dd4091a04f1e2fef77a8c3, scope.project.id=6910e69702854607889bab124edd60c9, user.id=58f8e572550b4ab5955d7a94f1563441) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:41.167961 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dffb68-8df2-4cad-aa4d-0a1e29ab3786 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:41.172321 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dffb68-8df2-4cad-aa4d-0a1e29ab3786 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:41.189177 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8e026-00f8-4a68-853a-e78376b7948e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:41.190288 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8e026-00f8-4a68-853a-e78376b7948e None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:41.190783 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8e026-00f8-4a68-853a-e78376b7948e None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:41.191259 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8e026-00f8-4a68-853a-e78376b7948e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:41.196768 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 363/699] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:49:40 2022] GET /identity/v3/role_assignments?user.id=58f8e572550b4ab5955d7a94f1563441&scope.project.id=6910e69702854607889bab124edd60c9&role.id=bc21bdc3d9dd4091a04f1e2fef77a8c3 => generated 608 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:49:41.228795 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce8e026-00f8-4a68-853a-e78376b7948e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:41.231651 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce8e026-00f8-4a68-853a-e78376b7948e None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:41.268934 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-cce8e026-00f8-4a68-853a-e78376b7948e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:41.268934 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:41.268934 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:41.268934 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:41.268934 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:41.268934 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:41.268934 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:41.268934 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:41.268934 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:41.268934 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:41.268934 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:41.268934 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:41.268934 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:41.268934 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:41.268934 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:41.269896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:41.269896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:41.269896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:41.269896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:41.269896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:41.269896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:41.269896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:41.269896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:41.269896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:41.269896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:41.269896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:41.269896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:41.269896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:41.269896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:41.269896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:41.269896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:41.269896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:41.270800 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:41.270800 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:41.270800 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:41.270800 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:41.295345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 337/700] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 417 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:41.301450 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dffb68-8df2-4cad-aa4d-0a1e29ab3786 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:41.482145 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:41.486228 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a178f-eb29-42de-9bad-a2d2038765f7 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:41.487747 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a178f-eb29-42de-9bad-a2d2038765f7 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:41.489060 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a178f-eb29-42de-9bad-a2d2038765f7 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:41.493369 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 338/701] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:41 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:41.501228 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d2baf-1e69-4243-a495-16c8821ba3e3 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:41.501544 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d2baf-1e69-4243-a495-16c8821ba3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:41.502042 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d2baf-1e69-4243-a495-16c8821ba3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:41.523054 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-7e0d2baf-1e69-4243-a495-16c8821ba3e3 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:41.526617 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-7e0d2baf-1e69-4243-a495-16c8821ba3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:41.527396 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dffb68-8df2-4cad-aa4d-0a1e29ab3786 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:41.596914 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf88982-512a-4f99-b91f-f4183c4458d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:41.598358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf88982-512a-4f99-b91f-f4183c4458d3 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:41.599118 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf88982-512a-4f99-b91f-f4183c4458d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:41.599881 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf88982-512a-4f99-b91f-f4183c4458d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:41.602153 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf88982-512a-4f99-b91f-f4183c4458d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:41.603064 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf88982-512a-4f99-b91f-f4183c4458d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:41.606079 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf88982-512a-4f99-b91f-f4183c4458d3 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:41.621101 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 339/702] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:49:41.642318 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 364/703] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:41.652324 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d2baf-1e69-4243-a495-16c8821ba3e3 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:41.657631 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf88982-512a-4f99-b91f-f4183c4458d3 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:41.810366 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:41.859290 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d2baf-1e69-4243-a495-16c8821ba3e3 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:41.863973 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf88982-512a-4f99-b91f-f4183c4458d3 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:41.910459 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c77bb0-9188-4372-be87-177ba67ed3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:41.911265 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c77bb0-9188-4372-be87-177ba67ed3ae None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:41.911723 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c77bb0-9188-4372-be87-177ba67ed3ae None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:41.912115 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c77bb0-9188-4372-be87-177ba67ed3ae None admin] PATH_INFO: `/v3/users/nova` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:41.923928 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c77bb0-9188-4372-be87-177ba67ed3ae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:41.925598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c77bb0-9188-4372-be87-177ba67ed3ae None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:41.941283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-a3c77bb0-9188-4372-be87-177ba67ed3ae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:49:41.941283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:41.941283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:41.941283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:41.941283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:41.941283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:41.941283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:41.941283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:41.941283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:41.941283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:41.941283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:41.941283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:41.941283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:49:41.941283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:49:41.941283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:49:41.941283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:49:41.943174 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:41.943174 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:41.943174 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:49:41.943174 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:41.943174 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:49:41.943174 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:41.943174 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:41.943174 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:41.943174 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:41.943174 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:41.943174 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:41.943174 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:41.943174 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:41.943174 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:41.943174 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:41.943174 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:41.943174 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:41.943174 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:41.945728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:41.945728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:41.945728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:49:41.945728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:49:41.945728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:49:41.945728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:49:41.945728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:49:41.945728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:49:41.945728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:49:41.945728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:41.948127 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 340/704] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Aug 2 08:49:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:41.948824 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cb4cb-56ca-4bc3-bf3c-8543e0d4bbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:41.949483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c77bb0-9188-4372-be87-177ba67ed3ae None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:41.950518 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cb4cb-56ca-4bc3-bf3c-8543e0d4bbac None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:41.951296 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cb4cb-56ca-4bc3-bf3c-8543e0d4bbac None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:41.952051 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cb4cb-56ca-4bc3-bf3c-8543e0d4bbac None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:41.955130 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629cb4cb-56ca-4bc3-bf3c-8543e0d4bbac None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:41.958053 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629cb4cb-56ca-4bc3-bf3c-8543e0d4bbac None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:41.974957 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-629cb4cb-56ca-4bc3-bf3c-8543e0d4bbac None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 08:49:41.974957 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:41.974957 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:49:41.974957 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:49:41.974957 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:49:41.974957 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:49:41.974957 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:49:41.974957 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:49:41.974957 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 08:49:41.974957 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:41.974957 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:49:41.974957 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:41.974957 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:41.974957 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:41.974957 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:41.974957 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:41.976817 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:41.976817 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:41.976817 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:41.976817 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:41.976817 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:41.976817 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:41.976817 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:41.976817 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:49:41.976817 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:49:41.976817 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:49:41.976817 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:49:41.976817 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:41.976817 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:41.976817 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:41.976817 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:41.976817 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:41.977941 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:41.977941 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:41.977941 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:41.977941 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:41.977941 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:41.977941 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:41.977941 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:41.977941 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:41.977941 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:41.977941 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:41.977941 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:41.977941 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:49:41.977941 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:49:41.977941 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 08:49:41.977941 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:41.982136 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 365/705] 10.222.0.20 () {56 vars in 1129 bytes} [Tue Aug 2 08:49:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:49:41.983437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cb4cb-56ca-4bc3-bf3c-8543e0d4bbac None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:41.987199 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:42.104322 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c77bb0-9188-4372-be87-177ba67ed3ae None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:42.159540 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cb4cb-56ca-4bc3-bf3c-8543e0d4bbac None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:42.204546 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:42.214837 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078fdb5-15be-4fc5-bc48-359f067bb960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:42.215548 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078fdb5-15be-4fc5-bc48-359f067bb960 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:42.218995 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078fdb5-15be-4fc5-bc48-359f067bb960 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:42.218995 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078fdb5-15be-4fc5-bc48-359f067bb960 None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:42.218995 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078fdb5-15be-4fc5-bc48-359f067bb960 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:42.218995 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078fdb5-15be-4fc5-bc48-359f067bb960 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:42.218995 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078fdb5-15be-4fc5-bc48-359f067bb960 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:42.224386 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 366/706] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Aug 2 08:49:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:42.230847 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078fdb5-15be-4fc5-bc48-359f067bb960 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:42.231836 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9737cc-97e8-4aff-91f2-a75ee3a1cecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:42.232612 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9737cc-97e8-4aff-91f2-a75ee3a1cecd None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:42.232891 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9737cc-97e8-4aff-91f2-a75ee3a1cecd None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:42.233173 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9737cc-97e8-4aff-91f2-a75ee3a1cecd None admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:42.234080 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9737cc-97e8-4aff-91f2-a75ee3a1cecd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:42.234388 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9737cc-97e8-4aff-91f2-a75ee3a1cecd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:42.246331 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9737cc-97e8-4aff-91f2-a75ee3a1cecd None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:42.292187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 341/707] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Aug 2 08:49:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:42.292187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9737cc-97e8-4aff-91f2-a75ee3a1cecd None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:42.374411 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:42.424846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078fdb5-15be-4fc5-bc48-359f067bb960 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:42.475319 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b35a0-f072-4424-aea5-ae6c4d8d3d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:42.476764 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b35a0-f072-4424-aea5-ae6c4d8d3d7f None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:42.477054 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b35a0-f072-4424-aea5-ae6c4d8d3d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:42.477324 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b35a0-f072-4424-aea5-ae6c4d8d3d7f None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:42.478127 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b35a0-f072-4424-aea5-ae6c4d8d3d7f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:42.478438 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b35a0-f072-4424-aea5-ae6c4d8d3d7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:42.479992 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b35a0-f072-4424-aea5-ae6c4d8d3d7f None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:42.487417 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 367/708] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Aug 2 08:49:42 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:42.552957 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9737cc-97e8-4aff-91f2-a75ee3a1cecd None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:42.586160 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26e3fd-42fd-44b1-9182-40b19bf6aba0 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:42.586490 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26e3fd-42fd-44b1-9182-40b19bf6aba0 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:42.586738 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26e3fd-42fd-44b1-9182-40b19bf6aba0 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:42.599408 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85f9b8-80b1-492d-b81a-004b34421ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:42.600109 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85f9b8-80b1-492d-b81a-004b34421ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:42.600423 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85f9b8-80b1-492d-b81a-004b34421ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:42.600798 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 368/709] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:42 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:49:42.601601 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85f9b8-80b1-492d-b81a-004b34421ff9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:42.611985 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1140eb-676f-4e02-ab1d-36da80a65ae1 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:42.612741 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1140eb-676f-4e02-ab1d-36da80a65ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:42.613253 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1140eb-676f-4e02-ab1d-36da80a65ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:42.656996 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-aa1140eb-676f-4e02-ab1d-36da80a65ae1 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:42.658671 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-aa1140eb-676f-4e02-ab1d-36da80a65ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:42.683893 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:42.716201 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85f9b8-80b1-492d-b81a-004b34421ff9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:42.718083 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85f9b8-80b1-492d-b81a-004b34421ff9 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:42.848689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 342/710] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:49:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:49:42.855342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85f9b8-80b1-492d-b81a-004b34421ff9 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:42.975489 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 369/711] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:49:42.978051 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11403cf-6975-4b8f-9402-2269b9f10dd9 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:42.978222 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11403cf-6975-4b8f-9402-2269b9f10dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:42.978488 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11403cf-6975-4b8f-9402-2269b9f10dd9 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:42.980205 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 370/712] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:42.994425 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850db36-b01f-421f-a2f1-c6f189a98ee6 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:42.994761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850db36-b01f-421f-a2f1-c6f189a98ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:42.994975 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850db36-b01f-421f-a2f1-c6f189a98ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:43.033908 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-a850db36-b01f-421f-a2f1-c6f189a98ee6 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:43.036485 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-a850db36-b01f-421f-a2f1-c6f189a98ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:43.039933 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:43.058699 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85f9b8-80b1-492d-b81a-004b34421ff9 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:43.109228 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a8d77-beb2-4089-a594-4cff9427fb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:43.110059 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a8d77-beb2-4089-a594-4cff9427fb68 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:43.110433 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a8d77-beb2-4089-a594-4cff9427fb68 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:43.110717 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a8d77-beb2-4089-a594-4cff9427fb68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:43.126165 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a8d77-beb2-4089-a594-4cff9427fb68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:43.128460 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a8d77-beb2-4089-a594-4cff9427fb68 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:43.152982 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-489a8d77-beb2-4089-a594-4cff9427fb68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:43.152982 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:43.152982 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:43.152982 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:43.152982 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:43.152982 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:43.152982 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:43.152982 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:43.152982 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:43.152982 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:43.152982 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:43.152982 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:43.152982 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:43.152982 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:43.152982 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:43.153968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:43.153968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:43.153968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:43.153968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:43.153968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:43.153968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:43.153968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:43.153968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:43.153968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:43.153968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:43.153968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:43.153968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:43.153968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:43.153968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:43.153968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:43.153968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:43.153968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:43.154941 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:43.154941 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:43.154941 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:43.154941 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:43.155168 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 343/713] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:43.156660 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a8d77-beb2-4089-a594-4cff9427fb68 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:43.166930 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:43.200201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 371/714] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:49:43.200201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850db36-b01f-421f-a2f1-c6f189a98ee6 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:43.377348 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850db36-b01f-421f-a2f1-c6f189a98ee6 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:43.382247 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a8d77-beb2-4089-a594-4cff9427fb68 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:43.436318 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdd9f3-0fd9-473d-a15c-776d643634f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:43.437364 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdd9f3-0fd9-473d-a15c-776d643634f4 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:43.437908 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdd9f3-0fd9-473d-a15c-776d643634f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:43.438417 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdd9f3-0fd9-473d-a15c-776d643634f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:43.439759 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbdd9f3-0fd9-473d-a15c-776d643634f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:43.440652 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbdd9f3-0fd9-473d-a15c-776d643634f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:43.442237 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7bd6cf-e020-4e8f-8328-90adad9b3b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:43.442981 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bd6cf-e020-4e8f-8328-90adad9b3b1b None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:43.443327 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbdd9f3-0fd9-473d-a15c-776d643634f4 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:43.443538 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bd6cf-e020-4e8f-8328-90adad9b3b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:43.443905 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bd6cf-e020-4e8f-8328-90adad9b3b1b None admin] PATH_INFO: `/v3/services/network` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:43.444881 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7bd6cf-e020-4e8f-8328-90adad9b3b1b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:43.451256 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7bd6cf-e020-4e8f-8328-90adad9b3b1b None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:43.460281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 372/715] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:43.460525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-bb7bd6cf-e020-4e8f-8328-90adad9b3b1b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 08:49:43.460525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:43.460525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:49:43.460525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:49:43.460525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:49:43.460525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:49:43.460525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:49:43.460525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:49:43.460525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 08:49:43.460525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:43.460525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:49:43.460525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:43.460525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:43.460525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:43.460525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:43.460525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:43.460525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:43.462466 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:43.462466 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:43.462466 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:43.462466 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:43.462466 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:43.462466 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:43.462466 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:49:43.462466 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:49:43.462466 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:49:43.462466 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:49:43.462466 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:43.462466 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:43.462466 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:43.462466 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:43.462466 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:43.462466 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:43.463485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:43.463485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:43.463485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:43.463485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:43.463485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:43.463485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:43.463485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:43.463485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:43.463485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:43.463485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:43.463485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:49:43.463485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:49:43.463485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 08:49:43.463485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:43.466464 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdd9f3-0fd9-473d-a15c-776d643634f4 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:43.466788 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 344/716] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:49:43 2022] GET /identity/v3/services/network => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:43.467730 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7bd6cf-e020-4e8f-8328-90adad9b3b1b None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:43.474056 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:43.536325 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:43.601414 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7bd6cf-e020-4e8f-8328-90adad9b3b1b None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:43.608309 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdd9f3-0fd9-473d-a15c-776d643634f4 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:43.644841 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c59fd-facf-43c4-a192-8fa8e6b6615f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:43.645595 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c59fd-facf-43c4-a192-8fa8e6b6615f None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:43.645884 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c59fd-facf-43c4-a192-8fa8e6b6615f None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:43.646207 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c59fd-facf-43c4-a192-8fa8e6b6615f None admin] PATH_INFO: `/v3/services` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:43.646910 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c59fd-facf-43c4-a192-8fa8e6b6615f None admin] RBAC: Adding query filter params (name=network) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:43.647258 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c59fd-facf-43c4-a192-8fa8e6b6615f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:43.649402 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c59fd-facf-43c4-a192-8fa8e6b6615f None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:43.651760 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8867ae2-f9f6-4f32-be84-236ceb15b972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:43.652960 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8867ae2-f9f6-4f32-be84-236ceb15b972 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:43.653489 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8867ae2-f9f6-4f32-be84-236ceb15b972 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:43.653967 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8867ae2-f9f6-4f32-be84-236ceb15b972 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:43.659525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 345/717] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Aug 2 08:49:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:43.660738 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c59fd-facf-43c4-a192-8fa8e6b6615f None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:43.668559 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8867ae2-f9f6-4f32-be84-236ceb15b972 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:49:43.675358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-c8867ae2-f9f6-4f32-be84-236ceb15b972 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:43.675358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:43.675358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:43.675358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:43.675358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:43.675358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:43.675358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:43.675358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:43.675358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:43.675358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:43.675358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:43.675358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:43.675358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:49:43.675358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:49:43.675358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:49:43.675358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:49:43.676776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:49:43.676776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:49:43.676776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:49:43.676776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:49:43.676776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:43.676776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:43.676776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:43.676776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:43.676776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:43.676776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:43.676776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:43.676776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:43.676776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:43.676776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:43.676776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:43.676776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:43.677646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:43.677646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:43.677646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:43.677646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:43.677646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:49:43.677646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:49:43.677646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:49:43.677646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:49:43.677646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:49:43.677646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:49:43.677646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:43.677646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:43.684319 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 373/718] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Aug 2 08:49:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:43.685622 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8867ae2-f9f6-4f32-be84-236ceb15b972 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:43.748185 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:43.792390 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c59fd-facf-43c4-a192-8fa8e6b6615f None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:43.816310 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8867ae2-f9f6-4f32-be84-236ceb15b972 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:43.830644 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:43.835654 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca088d3-5e33-4a0c-bbc9-8bc7c2b650d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:43.836175 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca088d3-5e33-4a0c-bbc9-8bc7c2b650d0 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:43.836475 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca088d3-5e33-4a0c-bbc9-8bc7c2b650d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:43.836759 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca088d3-5e33-4a0c-bbc9-8bc7c2b650d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:43.844761 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca088d3-5e33-4a0c-bbc9-8bc7c2b650d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:43.846300 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca088d3-5e33-4a0c-bbc9-8bc7c2b650d0 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:43.859051 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-aca088d3-5e33-4a0c-bbc9-8bc7c2b650d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:43.859051 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:43.859051 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:43.859051 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:43.859051 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:43.859051 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:43.859051 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:43.859051 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:43.859051 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:43.859051 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:43.859051 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:43.859051 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:43.859051 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:49:43.859051 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:49:43.859051 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:49:43.860647 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:49:43.860647 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:43.860647 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:43.860647 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:43.860647 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:43.860647 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:43.860647 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:43.860647 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:43.860647 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:43.860647 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:43.860647 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:43.860647 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:43.860647 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:43.860647 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:43.860647 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:43.860647 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:43.860647 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:43.862090 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:49:43.862090 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:49:43.862090 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:49:43.862090 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:49:43.862090 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:49:43.862090 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:49:43.862090 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:43.862090 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:43.862090 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 346/719] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:49:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:43.862090 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca088d3-5e33-4a0c-bbc9-8bc7c2b650d0 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:43.863875 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1c657-04c4-4df9-83e2-734656c88a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:43.864917 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1c657-04c4-4df9-83e2-734656c88a0b None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:43.865501 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1c657-04c4-4df9-83e2-734656c88a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:43.865970 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1c657-04c4-4df9-83e2-734656c88a0b None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:43.867582 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1c657-04c4-4df9-83e2-734656c88a0b None admin] RBAC: Adding query filter params (type=network) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:43.868198 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1c657-04c4-4df9-83e2-734656c88a0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:43.870228 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1c657-04c4-4df9-83e2-734656c88a0b None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:43.876956 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 374/720] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Aug 2 08:49:43 2022] GET /identity/v3/services?type=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:43.878269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1c657-04c4-4df9-83e2-734656c88a0b None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:44.099505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1c657-04c4-4df9-83e2-734656c88a0b None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:44.105579 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca088d3-5e33-4a0c-bbc9-8bc7c2b650d0 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:44.145487 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:44.156311 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4ee2e-fba8-4d3f-87ee-127eaa7a4f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:44.156944 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f8de6-e64c-40fb-b612-a02796566cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:44.166265 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f8de6-e64c-40fb-b612-a02796566cfd None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:44.166409 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4ee2e-fba8-4d3f-87ee-127eaa7a4f88 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:44.166508 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f8de6-e64c-40fb-b612-a02796566cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:44.166616 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4ee2e-fba8-4d3f-87ee-127eaa7a4f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:44.166743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f8de6-e64c-40fb-b612-a02796566cfd None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:44.166886 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4ee2e-fba8-4d3f-87ee-127eaa7a4f88 None admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:44.167027 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f8de6-e64c-40fb-b612-a02796566cfd None admin] RBAC: Adding query filter params (name=service) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:44.167155 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4ee2e-fba8-4d3f-87ee-127eaa7a4f88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:44.167290 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f8de6-e64c-40fb-b612-a02796566cfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:44.167413 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4ee2e-fba8-4d3f-87ee-127eaa7a4f88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:44.167551 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f8de6-e64c-40fb-b612-a02796566cfd None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:44.167688 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4ee2e-fba8-4d3f-87ee-127eaa7a4f88 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:44.173275 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 347/721] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Aug 2 08:49:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:44.177174 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 375/722] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:49:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:44.180214 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f8de6-e64c-40fb-b612-a02796566cfd None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:44.188570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4ee2e-fba8-4d3f-87ee-127eaa7a4f88 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:44.251793 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:44.386819 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4ee2e-fba8-4d3f-87ee-127eaa7a4f88 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:44.389246 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f8de6-e64c-40fb-b612-a02796566cfd None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:44.437869 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f12455-fd38-412b-b22b-7a25e1be1571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:44.438799 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f12455-fd38-412b-b22b-7a25e1be1571 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:44.439152 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f12455-fd38-412b-b22b-7a25e1be1571 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:44.439580 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f12455-fd38-412b-b22b-7a25e1be1571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:44.446218 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb0219-b116-44d4-8553-21db55f55b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:44.447357 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb0219-b116-44d4-8553-21db55f55b2a None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:44.448009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb0219-b116-44d4-8553-21db55f55b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:44.448673 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb0219-b116-44d4-8553-21db55f55b2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:44.449772 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb0219-b116-44d4-8553-21db55f55b2a None admin] RBAC: Adding query filter params (role.id=b5477d3c4e5a4514b64211ec2452d1d8, scope.project.id=6910e69702854607889bab124edd60c9, user.id=7bfcddefa71546d28078a38325c723a9) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:44.451190 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb0219-b116-44d4-8553-21db55f55b2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:44.453916 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb0219-b116-44d4-8553-21db55f55b2a None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:44.456187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f12455-fd38-412b-b22b-7a25e1be1571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:44.458284 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f12455-fd38-412b-b22b-7a25e1be1571 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:44.464658 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 376/723] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:49:44 2022] GET /identity/v3/role_assignments?user.id=7bfcddefa71546d28078a38325c723a9&scope.project.id=6910e69702854607889bab124edd60c9&role.id=b5477d3c4e5a4514b64211ec2452d1d8 => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:49:44.467453 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c821ea5-9494-4fd0-b4be-a41f1ba11bc2 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:44.468400 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c821ea5-9494-4fd0-b4be-a41f1ba11bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:44.469164 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c821ea5-9494-4fd0-b4be-a41f1ba11bc2 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:44.472568 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 377/724] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:44.479436 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5326a0-2154-4635-ba13-b10dfce5a5b1 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:44.480431 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5326a0-2154-4635-ba13-b10dfce5a5b1 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:44.481142 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5326a0-2154-4635-ba13-b10dfce5a5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:44.493046 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-c5f12455-fd38-412b-b22b-7a25e1be1571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:44.493046 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:44.493046 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:44.493046 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:44.493046 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:44.493046 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:44.493046 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:44.493046 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:44.493046 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:44.493046 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:44.493046 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:44.493046 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:44.493046 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:44.493046 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:44.493046 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:44.494855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:44.494855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:44.494855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:44.494855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:44.494855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:44.494855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:44.494855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:44.494855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:44.494855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:44.494855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:44.494855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:44.494855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:44.494855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:44.494855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:44.494855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:44.494855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:44.494855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:44.496802 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:44.496802 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:44.496802 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:44.496802 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:44.501054 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 348/725] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:44.510387 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f12455-fd38-412b-b22b-7a25e1be1571 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:44.552742 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-4e5326a0-2154-4635-ba13-b10dfce5a5b1 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:44.556261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-4e5326a0-2154-4635-ba13-b10dfce5a5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:44.656129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:44.733907 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 378/726] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:49:44.770826 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f12455-fd38-412b-b22b-7a25e1be1571 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:44.776921 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5326a0-2154-4635-ba13-b10dfce5a5b1 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:44.813912 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fed13a-c2d5-46e9-9fb7-e8de61b81327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:44.815050 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fed13a-c2d5-46e9-9fb7-e8de61b81327 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:44.815594 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fed13a-c2d5-46e9-9fb7-e8de61b81327 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:44.816076 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fed13a-c2d5-46e9-9fb7-e8de61b81327 None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:44.817276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fed13a-c2d5-46e9-9fb7-e8de61b81327 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:44.817827 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fed13a-c2d5-46e9-9fb7-e8de61b81327 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:44.818706 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:44.821247 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fed13a-c2d5-46e9-9fb7-e8de61b81327 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:44.837207 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 349/727] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:49:44.843199 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fed13a-c2d5-46e9-9fb7-e8de61b81327 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:44.967812 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fed13a-c2d5-46e9-9fb7-e8de61b81327 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:44.970037 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:45.010458 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f9b2c-ec74-454e-b589-05e56c7f6258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:45.011624 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f9b2c-ec74-454e-b589-05e56c7f6258 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:45.012144 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f9b2c-ec74-454e-b589-05e56c7f6258 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:45.012890 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f9b2c-ec74-454e-b589-05e56c7f6258 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:45.021450 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f9b2c-ec74-454e-b589-05e56c7f6258 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:45.024009 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f9b2c-ec74-454e-b589-05e56c7f6258 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:45.038137 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-c26f9b2c-ec74-454e-b589-05e56c7f6258 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:49:45.038137 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:45.038137 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:45.038137 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:45.038137 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:45.038137 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:45.038137 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:45.038137 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:45.038137 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:45.038137 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:45.038137 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:45.038137 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:45.038137 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:49:45.038137 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:49:45.038137 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:49:45.038137 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:49:45.039276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:45.039276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:45.039276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:49:45.039276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:45.039276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:49:45.039276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:45.039276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:45.039276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:45.039276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:45.039276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:45.039276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:45.039276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:45.039276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:45.039276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:45.039276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:45.039276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:45.039276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:45.039276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:45.040250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:45.040250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:45.040250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:49:45.040250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:49:45.040250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:49:45.040250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:49:45.040250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:49:45.040250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:49:45.040250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:49:45.040250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:45.043055 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 350/728] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Aug 2 08:49:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:49:45.049012 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f9b2c-ec74-454e-b589-05e56c7f6258 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:45.058530 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5326a0-2154-4635-ba13-b10dfce5a5b1 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:45.171681 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f9b2c-ec74-454e-b589-05e56c7f6258 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:45.188946 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7dd148-dcde-402e-9786-c4b5669ebd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:45.189630 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dd148-dcde-402e-9786-c4b5669ebd7f None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:45.189901 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dd148-dcde-402e-9786-c4b5669ebd7f None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:45.190254 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dd148-dcde-402e-9786-c4b5669ebd7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:45.213100 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4f7e5-9ee2-4dbd-a4e4-b1fc518ab0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:45.214262 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4f7e5-9ee2-4dbd-a4e4-b1fc518ab0cd None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:45.214833 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4f7e5-9ee2-4dbd-a4e4-b1fc518ab0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:45.215384 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4f7e5-9ee2-4dbd-a4e4-b1fc518ab0cd None admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:45.216440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4f7e5-9ee2-4dbd-a4e4-b1fc518ab0cd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:45.217100 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4f7e5-9ee2-4dbd-a4e4-b1fc518ab0cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:45.219009 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4f7e5-9ee2-4dbd-a4e4-b1fc518ab0cd None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:45.225204 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7dd148-dcde-402e-9786-c4b5669ebd7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:49:45.230796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-dd7dd148-dcde-402e-9786-c4b5669ebd7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:49:45.230796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:45.230796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:45.230796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:45.230796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:45.230796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:45.230796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:45.230796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:45.230796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:45.230796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:45.230796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:45.230796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:45.230796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:49:45.230796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:49:45.230796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:49:45.230796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:49:45.231743 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:49:45.231743 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:49:45.231743 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:49:45.231743 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:49:45.231743 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:45.231743 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:45.231743 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:45.231743 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:45.231743 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:45.231743 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:45.231743 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:45.231743 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:45.231743 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:45.231743 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:45.231743 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:45.231743 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:45.232631 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:45.232631 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:45.232631 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:45.232631 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:45.232631 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:49:45.232631 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:49:45.232631 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:49:45.232631 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:49:45.232631 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:49:45.232631 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:49:45.232631 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:49:45.232631 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:45.240647 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 379/729] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:49:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 464 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:49:45.249224 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7dd148-dcde-402e-9786-c4b5669ebd7f None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:45.250226 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 351/730] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Aug 2 08:49:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:49:45.256460 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4f7e5-9ee2-4dbd-a4e4-b1fc518ab0cd None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:45.297136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:45.482640 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:45.512426 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7dd148-dcde-402e-9786-c4b5669ebd7f None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:45.541668 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4f7e5-9ee2-4dbd-a4e4-b1fc518ab0cd None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:45.595917 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc228058-7909-4667-b99f-8ab7fe51648b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:45.597256 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc228058-7909-4667-b99f-8ab7fe51648b None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:45.597789 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc228058-7909-4667-b99f-8ab7fe51648b None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:45.598260 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc228058-7909-4667-b99f-8ab7fe51648b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:45.611948 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af0695-f2d4-4943-9831-ef6909960d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:45.612867 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af0695-f2d4-4943-9831-ef6909960d23 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:45.613181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af0695-f2d4-4943-9831-ef6909960d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:45.613459 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af0695-f2d4-4943-9831-ef6909960d23 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:45.614513 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af0695-f2d4-4943-9831-ef6909960d23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:45.614957 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af0695-f2d4-4943-9831-ef6909960d23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:45.617150 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af0695-f2d4-4943-9831-ef6909960d23 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:45.635864 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 380/731] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:49:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:45.638258 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bf685-dcaf-480d-8eb7-bf337591ac00 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:45.638744 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bf685-dcaf-480d-8eb7-bf337591ac00 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:45.639188 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bf685-dcaf-480d-8eb7-bf337591ac00 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:45.643220 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 381/732] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:45.644134 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bf685-dcaf-480d-8eb7-bf337591ac00 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:45.702231 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc228058-7909-4667-b99f-8ab7fe51648b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:45.704866 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc228058-7909-4667-b99f-8ab7fe51648b None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:45.743622 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:45.778570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bf685-dcaf-480d-8eb7-bf337591ac00 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:45.820699 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f4891-f6a2-4fd7-9020-24dbb6cb5a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:45.821767 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f4891-f6a2-4fd7-9020-24dbb6cb5a85 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:45.822275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f4891-f6a2-4fd7-9020-24dbb6cb5a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:45.822761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f4891-f6a2-4fd7-9020-24dbb6cb5a85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:45.836590 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f4891-f6a2-4fd7-9020-24dbb6cb5a85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:45.838814 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f4891-f6a2-4fd7-9020-24dbb6cb5a85 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:45.855848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-e98f4891-f6a2-4fd7-9020-24dbb6cb5a85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:45.855848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:45.855848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:45.855848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:45.855848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:45.855848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:45.855848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:45.855848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:45.855848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:45.855848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:45.855848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:45.855848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:45.855848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:45.855848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:45.855848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:45.856875 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:45.856875 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:45.856875 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:45.856875 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:45.856875 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:45.856875 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:45.856875 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:45.856875 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:45.856875 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:45.856875 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:45.856875 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:45.856875 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:45.856875 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:45.856875 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:45.856875 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:45.856875 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:45.856875 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:45.857809 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:45.857809 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:45.857809 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:45.857809 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:45.860508 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 382/733] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:45.862084 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95717a1-d8a4-4c7b-9794-1d82ae64cfb8 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:45.862589 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95717a1-d8a4-4c7b-9794-1d82ae64cfb8 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:45.863163 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95717a1-d8a4-4c7b-9794-1d82ae64cfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:45.872142 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:45.886536 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-c95717a1-d8a4-4c7b-9794-1d82ae64cfb8 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:45.888233 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-c95717a1-d8a4-4c7b-9794-1d82ae64cfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:45.909419 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 352/734] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:49:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 08:49:45.909419 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc228058-7909-4667-b99f-8ab7fe51648b None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:45.982766 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 383/735] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:49:45.988262 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95717a1-d8a4-4c7b-9794-1d82ae64cfb8 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:46.109695 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc228058-7909-4667-b99f-8ab7fe51648b None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:46.147789 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:46.168250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d13a0-ab51-4810-835f-e5227bbd1c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:46.168250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d13a0-ab51-4810-835f-e5227bbd1c89 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:46.172491 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d13a0-ab51-4810-835f-e5227bbd1c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:46.172491 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d13a0-ab51-4810-835f-e5227bbd1c89 None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:46.172491 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d13a0-ab51-4810-835f-e5227bbd1c89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:46.172491 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d13a0-ab51-4810-835f-e5227bbd1c89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:46.173410 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d13a0-ab51-4810-835f-e5227bbd1c89 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:46.189657 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 353/736] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:46.190830 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d13a0-ab51-4810-835f-e5227bbd1c89 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:46.196294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95717a1-d8a4-4c7b-9794-1d82ae64cfb8 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:46.248368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:46.256317 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2e2a7-9ec2-4db4-887f-d8180bf57f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:46.260135 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2e2a7-9ec2-4db4-887f-d8180bf57f50 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:46.260135 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2e2a7-9ec2-4db4-887f-d8180bf57f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:46.260135 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2e2a7-9ec2-4db4-887f-d8180bf57f50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:46.274310 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b2e2a7-9ec2-4db4-887f-d8180bf57f50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:46.276446 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b2e2a7-9ec2-4db4-887f-d8180bf57f50 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:46.301989 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-04b2e2a7-9ec2-4db4-887f-d8180bf57f50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:46.301989 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:46.301989 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:46.301989 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:46.301989 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:46.301989 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:46.301989 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:46.301989 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:46.301989 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:46.301989 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:46.301989 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:46.301989 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:46.301989 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:46.301989 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:46.301989 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:46.304407 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:46.304407 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:46.304407 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:46.304407 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:46.304407 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:46.304407 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:46.304407 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:46.304407 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:46.304407 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:46.304407 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:46.304407 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:46.304407 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:46.304407 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:46.304407 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:46.304407 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:46.304407 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:46.304407 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:46.305730 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:46.305730 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:46.305730 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:46.305730 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:46.308015 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 384/737] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:46.309238 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2e2a7-9ec2-4db4-887f-d8180bf57f50 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:46.419195 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d13a0-ab51-4810-835f-e5227bbd1c89 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:46.465308 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2e2a7-9ec2-4db4-887f-d8180bf57f50 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:46.495656 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a113d3c-e5aa-45db-b618-196f4fb43c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:46.497332 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a113d3c-e5aa-45db-b618-196f4fb43c8b None admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:46.497921 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a113d3c-e5aa-45db-b618-196f4fb43c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:46.498501 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a113d3c-e5aa-45db-b618-196f4fb43c8b None admin] PATH_INFO: `/v3/services` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:46.500342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a113d3c-e5aa-45db-b618-196f4fb43c8b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:46.503139 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a113d3c-e5aa-45db-b618-196f4fb43c8b None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:46.523528 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72411274-8e85-49fd-ba71-490446532cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:46.540620 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72411274-8e85-49fd-ba71-490446532cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:46.540620 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72411274-8e85-49fd-ba71-490446532cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:46.540620 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72411274-8e85-49fd-ba71-490446532cb0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:46.541179 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72411274-8e85-49fd-ba71-490446532cb0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:46.543991 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72411274-8e85-49fd-ba71-490446532cb0 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:46.566259 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-72411274-8e85-49fd-ba71-490446532cb0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:49:46.566259 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:46.566259 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:46.566259 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:46.566259 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:46.566259 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:46.566259 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:46.566259 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:46.566259 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:46.566259 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:46.566259 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:46.566259 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:46.566259 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:49:46.566259 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:49:46.566259 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:49:46.566259 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:49:46.567503 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:46.567503 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:46.567503 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:49:46.567503 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:46.567503 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:49:46.567503 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:46.567503 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:46.567503 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:46.567503 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:46.567503 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:46.567503 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:46.567503 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:46.567503 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:46.567503 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:46.567503 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:46.567503 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:46.567503 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:46.567503 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:46.568598 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:46.568598 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:46.568598 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:49:46.568598 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:49:46.568598 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:49:46.568598 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:49:46.568598 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:49:46.568598 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:49:46.568598 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:49:46.568598 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:46.568598 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 385/738] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:49:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:46.570450 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72411274-8e85-49fd-ba71-490446532cb0 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:46.633398 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 354/739] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Aug 2 08:49:46 2022] POST /identity/v3/services => generated 251 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:49:46.635019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c845b7-09a7-4b43-b66c-a7d1b5c82ff9 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:46.635509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c845b7-09a7-4b43-b66c-a7d1b5c82ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:46.635949 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c845b7-09a7-4b43-b66c-a7d1b5c82ff9 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:46.637988 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 355/740] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:46.639060 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c845b7-09a7-4b43-b66c-a7d1b5c82ff9 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:46.652589 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:46.747427 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:46.782499 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72411274-8e85-49fd-ba71-490446532cb0 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:46.875822 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87805531-65cf-4344-8f07-d49a0b35680a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:46.877035 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c845b7-09a7-4b43-b66c-a7d1b5c82ff9 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:46.877237 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87805531-65cf-4344-8f07-d49a0b35680a None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:46.877739 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87805531-65cf-4344-8f07-d49a0b35680a None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:46.878239 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87805531-65cf-4344-8f07-d49a0b35680a None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:46.879503 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87805531-65cf-4344-8f07-d49a0b35680a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:46.880303 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87805531-65cf-4344-8f07-d49a0b35680a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:46.883804 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87805531-65cf-4344-8f07-d49a0b35680a None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:46.910030 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 386/741] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:46.912412 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f447c01-958a-486c-b30f-b2a109aafc1f None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:46.913473 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f447c01-958a-486c-b30f-b2a109aafc1f None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:46.913972 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f447c01-958a-486c-b30f-b2a109aafc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:46.944445 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-7f447c01-958a-486c-b30f-b2a109aafc1f None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:46.946411 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-7f447c01-958a-486c-b30f-b2a109aafc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:46.949940 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb87c06-af22-4906-9dd6-6efa80ffde7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:46.951298 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb87c06-af22-4906-9dd6-6efa80ffde7f None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:46.952220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb87c06-af22-4906-9dd6-6efa80ffde7f None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:46.952942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb87c06-af22-4906-9dd6-6efa80ffde7f None admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:46.954733 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb87c06-af22-4906-9dd6-6efa80ffde7f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:46.955606 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb87c06-af22-4906-9dd6-6efa80ffde7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:46.958470 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb87c06-af22-4906-9dd6-6efa80ffde7f None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:46.996991 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 356/742] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Aug 2 08:49:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:46.999151 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb87c06-af22-4906-9dd6-6efa80ffde7f None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:47.075714 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 387/743] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:46 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:49:47.077305 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f447c01-958a-486c-b30f-b2a109aafc1f None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:47.135079 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:47.184850 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:47.192831 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb87c06-af22-4906-9dd6-6efa80ffde7f None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:47.233336 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f447c01-958a-486c-b30f-b2a109aafc1f None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:47.247204 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61d866-14ee-4f92-8001-5c2416c24a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:47.248363 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61d866-14ee-4f92-8001-5c2416c24a9a None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:47.248866 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61d866-14ee-4f92-8001-5c2416c24a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:47.249431 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61d866-14ee-4f92-8001-5c2416c24a9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:47.263922 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc61d866-14ee-4f92-8001-5c2416c24a9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:47.266605 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc61d866-14ee-4f92-8001-5c2416c24a9a None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:47.291444 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2c615-3757-4ae6-b28e-e33d4d2cd5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:47.292689 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2c615-3757-4ae6-b28e-e33d4d2cd5af None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:47.293180 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2c615-3757-4ae6-b28e-e33d4d2cd5af None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:47.293652 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2c615-3757-4ae6-b28e-e33d4d2cd5af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:47.296203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-fc61d866-14ee-4f92-8001-5c2416c24a9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:47.296203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:47.296203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:47.296203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:47.296203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:47.296203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:47.296203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:47.296203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:47.296203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:47.296203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:47.296203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:47.296203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:47.296203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:49:47.296203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:49:47.296203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:49:47.297379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:49:47.297379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:47.297379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:47.297379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:47.297379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:47.297379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:47.297379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:47.297379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:47.297379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:47.297379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:47.297379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:47.297379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:47.297379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:47.297379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:47.297379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:47.297379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:47.297379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:47.305219 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:49:47.305219 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:49:47.305219 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:49:47.305219 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:49:47.305219 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:49:47.305219 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:49:47.305219 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:47.305219 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:47.305219 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 357/744] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:49:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:47.305219 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419049b8-4eec-40fb-92d9-0eb14b4b9344 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:47.305219 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419049b8-4eec-40fb-92d9-0eb14b4b9344 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:47.305854 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419049b8-4eec-40fb-92d9-0eb14b4b9344 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:47.305854 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 358/745] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:47.306404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419049b8-4eec-40fb-92d9-0eb14b4b9344 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:47.403318 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd2c615-3757-4ae6-b28e-e33d4d2cd5af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:47.404833 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd2c615-3757-4ae6-b28e-e33d4d2cd5af None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:47.461094 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:47.493870 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419049b8-4eec-40fb-92d9-0eb14b4b9344 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:47.543452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798388e-5278-4708-ad85-76936e88fc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:47.544417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798388e-5278-4708-ad85-76936e88fc06 None admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:47.544928 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798388e-5278-4708-ad85-76936e88fc06 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:47.545411 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798388e-5278-4708-ad85-76936e88fc06 None admin] PATH_INFO: `/v3/services` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:47.546731 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798388e-5278-4708-ad85-76936e88fc06 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:47.549421 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798388e-5278-4708-ad85-76936e88fc06 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:47.567354 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 388/746] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:49:47 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:49:47.569009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2c615-3757-4ae6-b28e-e33d4d2cd5af None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:47.622938 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 359/747] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Aug 2 08:49:47 2022] POST /identity/v3/services => generated 240 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:49:47.624885 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42e44e-487b-4028-964a-80ff7b312005 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:47.625231 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42e44e-487b-4028-964a-80ff7b312005 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:47.625533 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42e44e-487b-4028-964a-80ff7b312005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:47.660211 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-0e42e44e-487b-4028-964a-80ff7b312005 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:47.662209 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-0e42e44e-487b-4028-964a-80ff7b312005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:47.682598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:47.749485 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2c615-3757-4ae6-b28e-e33d4d2cd5af None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:47.778537 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 360/748] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:49:47.781358 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42e44e-487b-4028-964a-80ff7b312005 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:47.796878 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:47.806088 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50cadf-cc7a-42b4-b756-f1f478d776c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:47.806745 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50cadf-cc7a-42b4-b756-f1f478d776c7 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:47.810487 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50cadf-cc7a-42b4-b756-f1f478d776c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:47.810487 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50cadf-cc7a-42b4-b756-f1f478d776c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:47.810487 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50cadf-cc7a-42b4-b756-f1f478d776c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:47.810487 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50cadf-cc7a-42b4-b756-f1f478d776c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:47.811473 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50cadf-cc7a-42b4-b756-f1f478d776c7 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:47.830138 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 389/749] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:49:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:47.832259 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50cadf-cc7a-42b4-b756-f1f478d776c7 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:47.961513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42e44e-487b-4028-964a-80ff7b312005 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:47.994833 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50cadf-cc7a-42b4-b756-f1f478d776c7 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:48.023441 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b3d3f-be96-4dc3-b3ea-e399d9b26d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:48.025471 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b3d3f-be96-4dc3-b3ea-e399d9b26d18 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:48.025728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b3d3f-be96-4dc3-b3ea-e399d9b26d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:48.026179 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b3d3f-be96-4dc3-b3ea-e399d9b26d18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:48.048983 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f1848-b2c6-4bfe-99ba-c39efb343223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:48.049302 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b3d3f-be96-4dc3-b3ea-e399d9b26d18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:48.050262 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f1848-b2c6-4bfe-99ba-c39efb343223 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:48.050778 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f1848-b2c6-4bfe-99ba-c39efb343223 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:48.051256 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f1848-b2c6-4bfe-99ba-c39efb343223 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:48.051788 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b3d3f-be96-4dc3-b3ea-e399d9b26d18 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:48.056547 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:48.066514 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f1848-b2c6-4bfe-99ba-c39efb343223 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:49:48.074061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-4a7f1848-b2c6-4bfe-99ba-c39efb343223 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:49:48.074061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:48.074061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:48.074061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:48.074061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:48.074061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:48.074061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:48.074061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:48.074061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:48.074061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:48.074061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:48.074061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:48.074061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:49:48.074061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:49:48.074061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:49:48.074061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:49:48.075093 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:49:48.075093 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:49:48.075093 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:49:48.075093 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:49:48.075093 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:48.075093 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:48.075093 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:48.075093 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:48.075093 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:48.075093 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:48.075093 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:48.075093 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:48.075093 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:48.075093 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:48.075093 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:48.075093 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:48.075958 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:48.075958 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:48.075958 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:48.075958 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:48.075958 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:49:48.075958 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:49:48.075958 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:49:48.075958 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:49:48.075958 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:49:48.075958 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:49:48.075958 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:49:48.075958 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:48.079016 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 390/750] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:49:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:48.080206 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f1848-b2c6-4bfe-99ba-c39efb343223 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:48.090863 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-987b3d3f-be96-4dc3-b3ea-e399d9b26d18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:48.090863 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:48.090863 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:48.090863 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:48.090863 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:48.090863 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:48.090863 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:48.090863 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:48.090863 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:48.090863 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:48.090863 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:48.090863 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:48.090863 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:48.090863 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:48.090863 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:48.091880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:48.091880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:48.091880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:48.091880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:48.091880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:48.091880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:48.091880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:48.091880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:48.091880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:48.091880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:48.091880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:48.091880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:48.091880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:48.091880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:48.091880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:48.091880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:48.091880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:48.093212 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:48.093212 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:48.093212 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:48.093212 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:48.093212 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 361/751] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:48.093212 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b3d3f-be96-4dc3-b3ea-e399d9b26d18 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:48.192578 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:48.303184 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b3d3f-be96-4dc3-b3ea-e399d9b26d18 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:48.321270 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f1848-b2c6-4bfe-99ba-c39efb343223 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:48.357256 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd044e86-9ddb-4754-82dc-aadd610b7efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:48.358057 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd044e86-9ddb-4754-82dc-aadd610b7efb None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:48.358369 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd044e86-9ddb-4754-82dc-aadd610b7efb None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:48.358645 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd044e86-9ddb-4754-82dc-aadd610b7efb None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:48.359392 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd044e86-9ddb-4754-82dc-aadd610b7efb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:48.359701 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd044e86-9ddb-4754-82dc-aadd610b7efb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:48.361171 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd044e86-9ddb-4754-82dc-aadd610b7efb None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:48.379000 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 362/752] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:49:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:48.379631 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0c3b7-f9d7-4780-b04c-41b89c870b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:48.379916 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd044e86-9ddb-4754-82dc-aadd610b7efb None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:48.380761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0c3b7-f9d7-4780-b04c-41b89c870b4c None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:48.381240 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0c3b7-f9d7-4780-b04c-41b89c870b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:48.382481 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0c3b7-f9d7-4780-b04c-41b89c870b4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:48.384200 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0c3b7-f9d7-4780-b04c-41b89c870b4c None admin] RBAC: Adding query filter params (role.id=bc21bdc3d9dd4091a04f1e2fef77a8c3, scope.project.id=6910e69702854607889bab124edd60c9, user.id=eb640d92cb9b49019f42351a60efe258) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:48.385791 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0c3b7-f9d7-4780-b04c-41b89c870b4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:48.387663 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0c3b7-f9d7-4780-b04c-41b89c870b4c None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:48.398971 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 391/753] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:49:48 2022] GET /identity/v3/role_assignments?user.id=eb640d92cb9b49019f42351a60efe258&scope.project.id=6910e69702854607889bab124edd60c9&role.id=bc21bdc3d9dd4091a04f1e2fef77a8c3 => generated 259 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:48.400308 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0c3b7-f9d7-4780-b04c-41b89c870b4c None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:48.563618 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:48.681405 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd044e86-9ddb-4754-82dc-aadd610b7efb None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:48.691693 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0c3b7-f9d7-4780-b04c-41b89c870b4c None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:48.727350 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad259b-8928-4544-9152-ccbeba0c7ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:48.728513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad259b-8928-4544-9152-ccbeba0c7ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:48.729038 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad259b-8928-4544-9152-ccbeba0c7ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:48.729516 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad259b-8928-4544-9152-ccbeba0c7ad5 None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:48.730455 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad259b-8928-4544-9152-ccbeba0c7ad5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:48.736598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad259b-8928-4544-9152-ccbeba0c7ad5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:48.739788 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad259b-8928-4544-9152-ccbeba0c7ad5 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:48.746183 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:48.757733 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 363/754] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:48.765919 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad259b-8928-4544-9152-ccbeba0c7ad5 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:48.832502 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69030cb1-ac0b-4d91-af8d-81cfae1ae1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:48.833231 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69030cb1-ac0b-4d91-af8d-81cfae1ae1ce None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:48.833739 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69030cb1-ac0b-4d91-af8d-81cfae1ae1ce None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:48.834767 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69030cb1-ac0b-4d91-af8d-81cfae1ae1ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:48.872611 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69030cb1-ac0b-4d91-af8d-81cfae1ae1ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:48.875116 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69030cb1-ac0b-4d91-af8d-81cfae1ae1ce None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:48.909453 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-69030cb1-ac0b-4d91-af8d-81cfae1ae1ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:48.909453 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:48.909453 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:48.909453 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:48.909453 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:48.909453 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:48.909453 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:48.909453 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:48.909453 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:48.909453 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:48.909453 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:48.909453 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:48.909453 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:48.909453 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:48.909453 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:48.910418 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:48.910418 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:48.910418 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:48.910418 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:48.910418 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:48.910418 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:48.910418 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:48.910418 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:48.910418 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:48.910418 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:48.910418 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:48.910418 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:48.910418 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:48.910418 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:48.910418 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:48.910418 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:48.910418 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:48.911314 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:48.911314 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:48.911314 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:48.911314 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:48.911536 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad259b-8928-4544-9152-ccbeba0c7ad5 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:48.914995 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 392/755] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 515 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:48.921042 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69030cb1-ac0b-4d91-af8d-81cfae1ae1ce None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:48.970490 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:49.044410 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15552a5a-8486-48af-8589-9da28a1cd90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:49.045268 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15552a5a-8486-48af-8589-9da28a1cd90e None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:49.045620 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15552a5a-8486-48af-8589-9da28a1cd90e None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:49.046087 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15552a5a-8486-48af-8589-9da28a1cd90e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:49.055418 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69030cb1-ac0b-4d91-af8d-81cfae1ae1ce None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:49.061750 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15552a5a-8486-48af-8589-9da28a1cd90e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:49.063251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15552a5a-8486-48af-8589-9da28a1cd90e None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:49.082749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-15552a5a-8486-48af-8589-9da28a1cd90e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:49.082749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:49.082749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:49.082749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:49.082749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:49.082749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:49.082749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:49.082749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:49.082749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:49.082749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:49.082749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:49.082749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:49.082749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:49:49.082749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:49:49.082749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:49:49.083672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:49:49.083672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:49.083672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:49.083672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:49.083672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:49.083672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:49.083672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:49.083672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:49.083672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:49.083672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:49.083672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:49.083672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:49.083672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:49.083672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:49.083672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:49.083672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:49.083672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:49.084694 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:49:49.084694 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:49:49.084694 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:49:49.084694 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:49:49.084694 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:49:49.084694 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:49:49.084694 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:49.084694 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:49.084694 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 364/756] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:49:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:49:49.093531 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15552a5a-8486-48af-8589-9da28a1cd90e None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:49.103043 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5dc0f-0406-4625-9786-89ed069d7203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:49.104073 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5dc0f-0406-4625-9786-89ed069d7203 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:49.104624 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5dc0f-0406-4625-9786-89ed069d7203 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:49.105102 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5dc0f-0406-4625-9786-89ed069d7203 None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:49.106061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5dc0f-0406-4625-9786-89ed069d7203 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:49.106578 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5dc0f-0406-4625-9786-89ed069d7203 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:49.108234 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5dc0f-0406-4625-9786-89ed069d7203 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:49.122998 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 393/757] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:49:49.129560 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5dc0f-0406-4625-9786-89ed069d7203 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:49.172675 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:49.252046 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5dc0f-0406-4625-9786-89ed069d7203 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:49.359138 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4ef47-a4bf-4ede-9b43-a670bb29b068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:49.360912 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4ef47-a4bf-4ede-9b43-a670bb29b068 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:49.361710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4ef47-a4bf-4ede-9b43-a670bb29b068 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:49.362214 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4ef47-a4bf-4ede-9b43-a670bb29b068 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:49.387843 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4ef47-a4bf-4ede-9b43-a670bb29b068 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:49.391061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4ef47-a4bf-4ede-9b43-a670bb29b068 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:49.438058 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-bdd4ef47-a4bf-4ede-9b43-a670bb29b068 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:49:49.438058 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:49.438058 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:49.438058 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:49.438058 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:49.438058 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:49.438058 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:49.438058 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:49.438058 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:49.438058 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:49.438058 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:49.438058 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:49.438058 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:49:49.438058 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:49:49.438058 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:49:49.438058 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:49:49.439915 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:49.439915 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:49.439915 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:49:49.439915 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:49.439915 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:49:49.439915 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:49.439915 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:49.439915 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:49.439915 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:49.439915 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:49.439915 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:49.439915 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:49.439915 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:49.439915 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:49.439915 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:49.439915 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:49.439915 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:49.439915 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:49.441967 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:49.441967 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:49.441967 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:49:49.441967 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:49:49.441967 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:49:49.441967 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:49:49.441967 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:49:49.441967 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:49:49.441967 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:49:49.441967 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:49.453797 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 394/758] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Aug 2 08:49:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:49:49.457494 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4ef47-a4bf-4ede-9b43-a670bb29b068 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:49.467927 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15552a5a-8486-48af-8589-9da28a1cd90e None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:49.578605 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fca0ea-38c3-4f5d-8a09-07562f791e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:49.579725 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fca0ea-38c3-4f5d-8a09-07562f791e94 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:49.580225 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fca0ea-38c3-4f5d-8a09-07562f791e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:49.580716 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fca0ea-38c3-4f5d-8a09-07562f791e94 None admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:49.582260 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fca0ea-38c3-4f5d-8a09-07562f791e94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:49.582956 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fca0ea-38c3-4f5d-8a09-07562f791e94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:49.586360 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fca0ea-38c3-4f5d-8a09-07562f791e94 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:49.620007 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 365/759] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:49:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 520 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:49.621833 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e76042-9403-4fd5-9f20-9b292135a79b None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:49.622130 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e76042-9403-4fd5-9f20-9b292135a79b None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:49.622474 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e76042-9403-4fd5-9f20-9b292135a79b None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:49.624477 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 366/760] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:49.626574 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e76042-9403-4fd5-9f20-9b292135a79b None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:49.647936 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:49.669152 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4ef47-a4bf-4ede-9b43-a670bb29b068 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:49.702443 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:49.732499 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc6bb7-4c5e-4267-80cd-a23eca7a3cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:49.734373 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc6bb7-4c5e-4267-80cd-a23eca7a3cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:49.735418 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc6bb7-4c5e-4267-80cd-a23eca7a3cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:49.737243 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc6bb7-4c5e-4267-80cd-a23eca7a3cf9 None admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:49.739429 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc6bb7-4c5e-4267-80cd-a23eca7a3cf9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:49.740545 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc6bb7-4c5e-4267-80cd-a23eca7a3cf9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:49.745148 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc6bb7-4c5e-4267-80cd-a23eca7a3cf9 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:49.774591 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 395/761] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Aug 2 08:49:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:49.776096 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffbbee-4fc5-4db0-8b28-d3fd8d23a569 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:49.776558 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffbbee-4fc5-4db0-8b28-d3fd8d23a569 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:49.777012 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffbbee-4fc5-4db0-8b28-d3fd8d23a569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:49.799113 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-2fffbbee-4fc5-4db0-8b28-d3fd8d23a569 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:49.800605 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-2fffbbee-4fc5-4db0-8b28-d3fd8d23a569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:49.826317 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e76042-9403-4fd5-9f20-9b292135a79b None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:49.889835 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d35b9d-b913-4459-a71c-b75cccc5ca88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:49.891296 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d35b9d-b913-4459-a71c-b75cccc5ca88 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:49.892027 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d35b9d-b913-4459-a71c-b75cccc5ca88 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:49.892907 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d35b9d-b913-4459-a71c-b75cccc5ca88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:49.894807 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d35b9d-b913-4459-a71c-b75cccc5ca88 None admin] RBAC: Adding query filter params (role.id=b5477d3c4e5a4514b64211ec2452d1d8, scope.project.id=6910e69702854607889bab124edd60c9, user.id=58f8e572550b4ab5955d7a94f1563441) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:49.895659 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d35b9d-b913-4459-a71c-b75cccc5ca88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:49.898609 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d35b9d-b913-4459-a71c-b75cccc5ca88 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:49.908410 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 396/762] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:49:49.910146 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 367/763] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:49:49 2022] GET /identity/v3/role_assignments?user.id=58f8e572550b4ab5955d7a94f1563441&scope.project.id=6910e69702854607889bab124edd60c9&role.id=b5477d3c4e5a4514b64211ec2452d1d8 => generated 259 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:49.910284 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fffbbee-4fc5-4db0-8b28-d3fd8d23a569 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:49.959010 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d35b9d-b913-4459-a71c-b75cccc5ca88 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:50.117128 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:50.175001 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fffbbee-4fc5-4db0-8b28-d3fd8d23a569 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:50.223706 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e83d2-e2d1-4b72-b35f-c831bd0afa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:50.224956 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e83d2-e2d1-4b72-b35f-c831bd0afa6a None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:50.225652 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e83d2-e2d1-4b72-b35f-c831bd0afa6a None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:50.226152 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e83d2-e2d1-4b72-b35f-c831bd0afa6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:50.233417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:50.243151 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d35b9d-b913-4459-a71c-b75cccc5ca88 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:50.250129 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e83d2-e2d1-4b72-b35f-c831bd0afa6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:50.254439 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e83d2-e2d1-4b72-b35f-c831bd0afa6a None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:50.304215 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0362b-2451-4277-9455-10f3841975d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:50.304215 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0362b-2451-4277-9455-10f3841975d5 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:50.304215 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0362b-2451-4277-9455-10f3841975d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:50.304215 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0362b-2451-4277-9455-10f3841975d5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:50.304932 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0362b-2451-4277-9455-10f3841975d5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:50.304932 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0362b-2451-4277-9455-10f3841975d5 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:50.315861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-04e0362b-2451-4277-9455-10f3841975d5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 08:49:50.315861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:50.315861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:49:50.315861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:49:50.315861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:49:50.315861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:49:50.315861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:49:50.315861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:49:50.315861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 08:49:50.315861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:50.315861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:49:50.315861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:50.315861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:50.315861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:50.315861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:50.315861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:50.317737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:50.317737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:50.317737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:50.317737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:50.317737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:50.317737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:50.317737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:50.317737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:49:50.317737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:49:50.317737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:49:50.317737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:49:50.317737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:50.317737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:50.317737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:50.317737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:50.317737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:50.320026 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:50.320026 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:50.320026 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:50.320026 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:50.320026 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:50.320026 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:50.320026 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:50.320026 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:50.320026 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:50.320026 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:50.320026 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:50.320026 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:49:50.320026 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:49:50.320026 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 08:49:50.320026 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:50.320026 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 368/764] 10.222.0.20 () {56 vars in 1129 bytes} [Tue Aug 2 08:49:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:49:50.321974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-141e83d2-e2d1-4b72-b35f-c831bd0afa6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:50.321974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:50.321974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:50.321974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:50.321974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:50.321974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:50.321974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:50.321974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:50.321974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:50.321974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:50.321974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:50.321974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:50.321974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:50.321974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:50.321974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:50.323660 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:50.323660 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:50.323660 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:50.323660 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:50.323660 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:50.323660 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:50.323660 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:50.323660 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:50.323660 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:50.323660 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:50.323660 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:50.323660 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:50.323660 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:50.323660 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:50.323660 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:50.323660 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:50.323660 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:50.327405 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:50.327405 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:50.327405 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:50.327405 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:50.327405 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 397/765] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 417 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:50.328585 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0362b-2451-4277-9455-10f3841975d5 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:50.333885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e83d2-e2d1-4b72-b35f-c831bd0afa6a None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:50.565746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0362b-2451-4277-9455-10f3841975d5 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:50.614617 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e83d2-e2d1-4b72-b35f-c831bd0afa6a None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:50.644789 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b9504-fcf9-4ec4-91d9-05751f8193a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:50.645244 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b9504-fcf9-4ec4-91d9-05751f8193a5 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:50.645399 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b9504-fcf9-4ec4-91d9-05751f8193a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:50.645648 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b9504-fcf9-4ec4-91d9-05751f8193a5 None admin] PATH_INFO: `/v3/services` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:50.646342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b9504-fcf9-4ec4-91d9-05751f8193a5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:50.646639 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b9504-fcf9-4ec4-91d9-05751f8193a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:50.648114 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b9504-fcf9-4ec4-91d9-05751f8193a5 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:50.658544 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:50.664265 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 369/766] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Aug 2 08:49:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:50.666542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa288482-69fb-4ad7-92db-a80fa40a030d None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:50.667081 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa288482-69fb-4ad7-92db-a80fa40a030d None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:50.667817 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa288482-69fb-4ad7-92db-a80fa40a030d None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:50.669864 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa3277-0470-491b-8a75-5007fcbfe418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:50.670523 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa3277-0470-491b-8a75-5007fcbfe418 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:50.670802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa3277-0470-491b-8a75-5007fcbfe418 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:50.671092 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa3277-0470-491b-8a75-5007fcbfe418 None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:50.671925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa3277-0470-491b-8a75-5007fcbfe418 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:50.672283 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa3277-0470-491b-8a75-5007fcbfe418 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:50.673693 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa3277-0470-491b-8a75-5007fcbfe418 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:50.673949 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 370/767] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:50.677602 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa288482-69fb-4ad7-92db-a80fa40a030d None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:50.690932 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 398/768] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:50.698146 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0cdb0-3f6d-4a23-aa5b-e2506a080b01 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:50.699132 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0cdb0-3f6d-4a23-aa5b-e2506a080b01 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:50.699724 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0cdb0-3f6d-4a23-aa5b-e2506a080b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:50.726419 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-81f0cdb0-3f6d-4a23-aa5b-e2506a080b01 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:50.727840 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-81f0cdb0-3f6d-4a23-aa5b-e2506a080b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:50.733376 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:50.842054 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 399/769] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:49:50.842935 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0cdb0-3f6d-4a23-aa5b-e2506a080b01 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:50.877127 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa288482-69fb-4ad7-92db-a80fa40a030d None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:50.950599 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3347028-8c8e-48cf-8bc8-272e495a2ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:50.952035 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3347028-8c8e-48cf-8bc8-272e495a2ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:50.952545 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3347028-8c8e-48cf-8bc8-272e495a2ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:50.953060 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3347028-8c8e-48cf-8bc8-272e495a2ed8 None admin] PATH_INFO: `/v3/services` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:50.954401 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3347028-8c8e-48cf-8bc8-272e495a2ed8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:50.954777 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3347028-8c8e-48cf-8bc8-272e495a2ed8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:50.957380 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3347028-8c8e-48cf-8bc8-272e495a2ed8 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:50.974499 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 371/770] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Aug 2 08:49:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:50.974499 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3347028-8c8e-48cf-8bc8-272e495a2ed8 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:51.003579 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0cdb0-3f6d-4a23-aa5b-e2506a080b01 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:51.025446 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:51.047379 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445c90c-3e6c-46e3-9a19-8eee6f99b857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:51.048082 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445c90c-3e6c-46e3-9a19-8eee6f99b857 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:51.048395 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445c90c-3e6c-46e3-9a19-8eee6f99b857 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:51.048668 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445c90c-3e6c-46e3-9a19-8eee6f99b857 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:51.058480 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445c90c-3e6c-46e3-9a19-8eee6f99b857 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:51.060448 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445c90c-3e6c-46e3-9a19-8eee6f99b857 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:51.075232 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-f445c90c-3e6c-46e3-9a19-8eee6f99b857 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:51.075232 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:51.075232 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:51.075232 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:51.075232 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:51.075232 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:51.075232 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:51.075232 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:51.075232 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:51.075232 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:51.075232 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:51.075232 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:51.075232 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:49:51.075232 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:49:51.075232 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:49:51.077016 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:49:51.077016 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:51.077016 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:51.077016 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:51.077016 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:51.077016 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:51.077016 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:51.077016 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:51.077016 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:51.077016 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:51.077016 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:51.077016 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:51.077016 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:51.077016 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:51.077016 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:51.077016 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:51.077016 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:51.078762 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:49:51.078762 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:49:51.078762 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:49:51.078762 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:49:51.078762 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:49:51.078762 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:49:51.078762 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:51.078762 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:51.078762 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 400/771] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:49:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:51.078762 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe767a2-243a-4f6f-8af6-98514ef27450 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:51.078762 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe767a2-243a-4f6f-8af6-98514ef27450 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:51.079898 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe767a2-243a-4f6f-8af6-98514ef27450 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:51.084620 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 401/772] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:51.086018 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe767a2-243a-4f6f-8af6-98514ef27450 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:51.110163 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:51.123123 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3347028-8c8e-48cf-8bc8-272e495a2ed8 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:51.170795 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6147f1-e221-4200-8f1c-266b6c0eeb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:51.171496 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6147f1-e221-4200-8f1c-266b6c0eeb6b None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:51.171773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6147f1-e221-4200-8f1c-266b6c0eeb6b None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:51.172047 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6147f1-e221-4200-8f1c-266b6c0eeb6b None admin] PATH_INFO: `/v3/services/network` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:51.172746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6147f1-e221-4200-8f1c-266b6c0eeb6b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:51.175623 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6147f1-e221-4200-8f1c-266b6c0eeb6b None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:51.190672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-ae6147f1-e221-4200-8f1c-266b6c0eeb6b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 08:49:51.190672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:51.190672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:49:51.190672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:49:51.190672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:49:51.190672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:49:51.190672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:49:51.190672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:49:51.190672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 08:49:51.190672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:51.190672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:49:51.190672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:51.190672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:51.190672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:51.190672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:51.190672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:51.190672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:51.193180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:51.193180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:51.193180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:51.193180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:51.193180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:51.193180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:51.193180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:49:51.193180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:49:51.193180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:49:51.193180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:49:51.193180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:51.193180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:51.193180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:51.193180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:51.193180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:51.193180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:51.195586 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:51.195586 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:51.195586 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:51.195586 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:51.195586 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:51.195586 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:51.195586 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:51.195586 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:51.195586 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:51.195586 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:51.195586 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:49:51.195586 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:49:51.195586 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 08:49:51.195586 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:51.195586 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 372/773] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:49:50 2022] GET /identity/v3/services/network => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:51.197161 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6147f1-e221-4200-8f1c-266b6c0eeb6b None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:51.238065 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe767a2-243a-4f6f-8af6-98514ef27450 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:51.302235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9626412-8518-471a-a1a9-247dd900fab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:51.302980 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9626412-8518-471a-a1a9-247dd900fab2 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:51.303859 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9626412-8518-471a-a1a9-247dd900fab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:51.304198 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9626412-8518-471a-a1a9-247dd900fab2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:51.305286 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9626412-8518-471a-a1a9-247dd900fab2 None admin] RBAC: Adding query filter params (interface=public, service_id=cc59a4fc863c48c7a8246370fd5971fc, region_id=RegionOne) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:51.305707 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9626412-8518-471a-a1a9-247dd900fab2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:51.307589 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9626412-8518-471a-a1a9-247dd900fab2 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:51.317525 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 402/774] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Aug 2 08:49:51 2022] GET /identity/v3/endpoints?service_id=cc59a4fc863c48c7a8246370fd5971fc&interface=public®ion_id=RegionOne => generated 194 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:51.320035 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ade64-cce0-457f-b153-10938494b9e5 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:51.320568 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ade64-cce0-457f-b153-10938494b9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:51.321246 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ade64-cce0-457f-b153-10938494b9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:51.348117 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-b25ade64-cce0-457f-b153-10938494b9e5 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:51.350462 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-b25ade64-cce0-457f-b153-10938494b9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:51.388569 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6147f1-e221-4200-8f1c-266b6c0eeb6b None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:51.411195 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:51.450106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44deddb1-3f80-4f0d-bee2-4fbf950b0881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:51.451117 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44deddb1-3f80-4f0d-bee2-4fbf950b0881 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:51.451504 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44deddb1-3f80-4f0d-bee2-4fbf950b0881 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:51.451914 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44deddb1-3f80-4f0d-bee2-4fbf950b0881 None admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:51.453257 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44deddb1-3f80-4f0d-bee2-4fbf950b0881 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:51.453659 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44deddb1-3f80-4f0d-bee2-4fbf950b0881 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:51.455960 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44deddb1-3f80-4f0d-bee2-4fbf950b0881 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:51.476366 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 403/775] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:49:51.476366 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ade64-cce0-457f-b153-10938494b9e5 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:51.485763 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 373/776] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:49:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:51.486731 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44deddb1-3f80-4f0d-bee2-4fbf950b0881 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:51.512414 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:51.622875 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44deddb1-3f80-4f0d-bee2-4fbf950b0881 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:51.654040 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ade64-cce0-457f-b153-10938494b9e5 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:51.682554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6164c0-f243-4e6c-97b0-96ebbd6a42d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:51.684017 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6164c0-f243-4e6c-97b0-96ebbd6a42d6 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:51.684520 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6164c0-f243-4e6c-97b0-96ebbd6a42d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:51.685229 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6164c0-f243-4e6c-97b0-96ebbd6a42d6 None admin] PATH_INFO: `/v3/services` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:51.686715 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6164c0-f243-4e6c-97b0-96ebbd6a42d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:51.689658 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6164c0-f243-4e6c-97b0-96ebbd6a42d6 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:51.701040 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 374/777] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Aug 2 08:49:51 2022] GET /identity/v3/services => generated 772 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:51.702908 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6164c0-f243-4e6c-97b0-96ebbd6a42d6 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:51.714949 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250daa0d-e63e-4c68-9379-8803b0d177e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:51.716242 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250daa0d-e63e-4c68-9379-8803b0d177e8 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:51.717033 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250daa0d-e63e-4c68-9379-8803b0d177e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:51.717799 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250daa0d-e63e-4c68-9379-8803b0d177e8 None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:51.719182 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250daa0d-e63e-4c68-9379-8803b0d177e8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:51.720055 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250daa0d-e63e-4c68-9379-8803b0d177e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:51.723109 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250daa0d-e63e-4c68-9379-8803b0d177e8 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:51.740708 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 404/778] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Aug 2 08:49:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:51.742737 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250daa0d-e63e-4c68-9379-8803b0d177e8 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:51.808188 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:51.839146 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:51.870737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6164c0-f243-4e6c-97b0-96ebbd6a42d6 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:51.912689 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250daa0d-e63e-4c68-9379-8803b0d177e8 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:51.921166 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60803931-3404-4e8f-8b2b-e85345c34739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:51.921166 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60803931-3404-4e8f-8b2b-e85345c34739 None admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:51.921466 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60803931-3404-4e8f-8b2b-e85345c34739 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:51.921802 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60803931-3404-4e8f-8b2b-e85345c34739 None admin] PATH_INFO: `/v3/projects/6910e69702854607889bab124edd60c9/users/7bfcddefa71546d28078a38325c723a9/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:51.925344 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60803931-3404-4e8f-8b2b-e85345c34739 None admin] RBAC: Authorizing `identity:create_grant(project_id=6910e69702854607889bab124edd60c9, user_id=7bfcddefa71546d28078a38325c723a9, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:51.925872 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60803931-3404-4e8f-8b2b-e85345c34739 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:51.968521 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f29f8-2482-43b9-aa31-02939e20596a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:51.969570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f29f8-2482-43b9-aa31-02939e20596a None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:51.969756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f29f8-2482-43b9-aa31-02939e20596a None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:51.970078 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f29f8-2482-43b9-aa31-02939e20596a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:51.984331 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f29f8-2482-43b9-aa31-02939e20596a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:49:51.989715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-ae0f29f8-2482-43b9-aa31-02939e20596a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:51.989715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:51.989715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:51.989715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:51.989715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:51.989715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:51.989715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:51.989715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:51.989715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:51.989715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:51.989715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:51.989715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:51.989715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:49:51.989715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:49:51.989715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:49:51.989715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:49:51.992097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:49:51.992097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:49:51.992097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:49:51.992097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:49:51.992097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:51.992097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:51.992097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:51.992097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:51.992097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:51.992097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:51.992097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:51.992097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:51.992097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:51.992097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:51.992097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:51.992097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:51.993911 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:51.993911 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:51.993911 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:51.993911 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:51.993911 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:49:51.993911 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:49:51.993911 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:49:51.993911 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:49:51.993911 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:49:51.993911 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:49:51.993911 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:51.993911 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:51.996191 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 405/779] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Aug 2 08:49:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:51.997235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f29f8-2482-43b9-aa31-02939e20596a None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:52.013175 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 375/780] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Aug 2 08:49:51 2022] PUT /identity/v3/projects/6910e69702854607889bab124edd60c9/users/7bfcddefa71546d28078a38325c723a9/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:49:52.016477 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60803931-3404-4e8f-8b2b-e85345c34739 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:52.236791 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60803931-3404-4e8f-8b2b-e85345c34739 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:52.258106 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:52.267594 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f29f8-2482-43b9-aa31-02939e20596a None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:52.290523 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c169d-2d1d-4d6c-bab1-8978556974ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:52.290523 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c169d-2d1d-4d6c-bab1-8978556974ff None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:52.290523 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c169d-2d1d-4d6c-bab1-8978556974ff None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:52.290523 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c169d-2d1d-4d6c-bab1-8978556974ff None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:52.291120 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c169d-2d1d-4d6c-bab1-8978556974ff None admin] RBAC: Adding query filter params (name=service) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:52.291385 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c169d-2d1d-4d6c-bab1-8978556974ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:52.293245 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c169d-2d1d-4d6c-bab1-8978556974ff None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:52.301407 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:52.309850 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 376/781] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Aug 2 08:49:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:52.317075 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c169d-2d1d-4d6c-bab1-8978556974ff None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:52.348403 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76707b4a-92f3-41be-96a4-7593c83ff7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:52.349438 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76707b4a-92f3-41be-96a4-7593c83ff7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:52.350408 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76707b4a-92f3-41be-96a4-7593c83ff7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:52.351104 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76707b4a-92f3-41be-96a4-7593c83ff7e1 None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:52.351973 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76707b4a-92f3-41be-96a4-7593c83ff7e1 None admin] RBAC: Adding query filter params (type=network) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:52.353053 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76707b4a-92f3-41be-96a4-7593c83ff7e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:52.354695 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76707b4a-92f3-41be-96a4-7593c83ff7e1 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:52.360938 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 406/782] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Aug 2 08:49:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:52.369266 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76707b4a-92f3-41be-96a4-7593c83ff7e1 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:52.515852 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c169d-2d1d-4d6c-bab1-8978556974ff None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:52.595452 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76707b4a-92f3-41be-96a4-7593c83ff7e1 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:52.634110 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7735b0d-3cec-462d-a560-5adda9770655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:52.634783 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7735b0d-3cec-462d-a560-5adda9770655 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:52.635065 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7735b0d-3cec-462d-a560-5adda9770655 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:52.635339 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7735b0d-3cec-462d-a560-5adda9770655 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:52.658949 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d19b3e-17b5-4f2d-8cff-52a7aa2f8f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:52.659600 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d19b3e-17b5-4f2d-8cff-52a7aa2f8f4e None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:52.659883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d19b3e-17b5-4f2d-8cff-52a7aa2f8f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:52.660154 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d19b3e-17b5-4f2d-8cff-52a7aa2f8f4e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:52.660963 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d19b3e-17b5-4f2d-8cff-52a7aa2f8f4e None admin] RBAC: Adding query filter params (interface=public, service_id=d55cb65ad2bd4ff186eef513f0a9c717, region_id=RegionOne) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:52.661274 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d19b3e-17b5-4f2d-8cff-52a7aa2f8f4e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:52.663312 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d19b3e-17b5-4f2d-8cff-52a7aa2f8f4e None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:52.665967 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7735b0d-3cec-462d-a560-5adda9770655 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:52.667548 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7735b0d-3cec-462d-a560-5adda9770655 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:52.682015 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 407/783] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Aug 2 08:49:52 2022] GET /identity/v3/endpoints?service_id=d55cb65ad2bd4ff186eef513f0a9c717&interface=public®ion_id=RegionOne => generated 194 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:52.690172 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d19b3e-17b5-4f2d-8cff-52a7aa2f8f4e None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:52.694773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-c7735b0d-3cec-462d-a560-5adda9770655 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:52.694773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:52.694773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:52.694773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:52.694773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:52.694773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:52.694773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:52.694773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:52.694773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:52.694773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:52.694773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:52.694773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:52.694773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:52.694773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:52.694773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:52.695712 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:52.695712 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:52.695712 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:52.695712 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:52.695712 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:52.695712 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:52.695712 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:52.695712 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:52.695712 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:52.695712 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:52.695712 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:52.695712 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:52.695712 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:52.695712 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:52.695712 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:52.695712 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:52.695712 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:52.697002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:52.697002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:52.697002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:52.697002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:52.699063 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 377/784] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:49:52.707144 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7735b0d-3cec-462d-a560-5adda9770655 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:52.722220 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:52.840662 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:52.867561 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d19b3e-17b5-4f2d-8cff-52a7aa2f8f4e None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:52.925428 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774f491-b29b-44ef-9f27-59ec108e0395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:52.925733 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7735b0d-3cec-462d-a560-5adda9770655 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:52.926675 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774f491-b29b-44ef-9f27-59ec108e0395 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:52.927374 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774f491-b29b-44ef-9f27-59ec108e0395 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:52.928142 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774f491-b29b-44ef-9f27-59ec108e0395 None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:52.929964 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774f491-b29b-44ef-9f27-59ec108e0395 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:52.932697 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774f491-b29b-44ef-9f27-59ec108e0395 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:52.939706 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 408/785] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Aug 2 08:49:52 2022] GET /identity/v3/services => generated 772 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:49:52.941732 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad78b2-489b-4276-aaa9-d64dcb2eb39e None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:52.942202 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad78b2-489b-4276-aaa9-d64dcb2eb39e None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:52.942726 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad78b2-489b-4276-aaa9-d64dcb2eb39e None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:52.944990 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 409/786] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:52.969822 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e594f9c-41c2-47a3-b903-d745f2a534cf None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:52.970361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e594f9c-41c2-47a3-b903-d745f2a534cf None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:52.970790 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e594f9c-41c2-47a3-b903-d745f2a534cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:52.977794 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ec8f7-2187-459d-89e0-351bb0bd924b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:52.978984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ec8f7-2187-459d-89e0-351bb0bd924b None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:52.979560 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ec8f7-2187-459d-89e0-351bb0bd924b None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:52.980055 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ec8f7-2187-459d-89e0-351bb0bd924b None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:52.981555 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ec8f7-2187-459d-89e0-351bb0bd924b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:52.982174 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ec8f7-2187-459d-89e0-351bb0bd924b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:52.985511 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ec8f7-2187-459d-89e0-351bb0bd924b None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:53.016008 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 378/787] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:49:53.018211 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-9e594f9c-41c2-47a3-b903-d745f2a534cf None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:53.020548 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-9e594f9c-41c2-47a3-b903-d745f2a534cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:53.030642 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ec8f7-2187-459d-89e0-351bb0bd924b None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:53.203880 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 410/788] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:49:53.227590 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e594f9c-41c2-47a3-b903-d745f2a534cf None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:53.244755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ec8f7-2187-459d-89e0-351bb0bd924b None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:53.258150 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:53.264311 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:53.297739 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5daf4-63c0-4de6-951b-be5b08dbee44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:53.299316 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5daf4-63c0-4de6-951b-be5b08dbee44 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:53.299493 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5daf4-63c0-4de6-951b-be5b08dbee44 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:53.299805 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5daf4-63c0-4de6-951b-be5b08dbee44 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:53.310690 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec5daf4-63c0-4de6-951b-be5b08dbee44 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:53.313032 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec5daf4-63c0-4de6-951b-be5b08dbee44 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:53.329815 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-2ec5daf4-63c0-4de6-951b-be5b08dbee44 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:49:53.329815 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:53.329815 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:53.329815 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:53.329815 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:53.329815 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:53.329815 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:53.329815 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:53.329815 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:53.329815 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:53.329815 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:53.329815 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:53.329815 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:49:53.329815 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:49:53.329815 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:49:53.329815 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:49:53.330897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:53.330897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:53.330897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:49:53.330897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:53.330897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:49:53.330897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:53.330897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:53.330897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:53.330897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:53.330897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:53.330897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:53.330897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:53.330897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:53.330897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:53.330897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:53.330897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:53.330897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:53.330897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:53.332221 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:53.332221 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:53.332221 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:49:53.332221 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:49:53.332221 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:49:53.332221 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:49:53.332221 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:49:53.332221 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:49:53.332221 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:49:53.332221 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:53.339013 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 379/789] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Aug 2 08:49:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:53.342254 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5daf4-63c0-4de6-951b-be5b08dbee44 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:53.441908 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e594f9c-41c2-47a3-b903-d745f2a534cf None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:53.512020 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff4629-3a60-43e7-a189-914c1b3980d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:53.513080 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff4629-3a60-43e7-a189-914c1b3980d4 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:53.513552 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff4629-3a60-43e7-a189-914c1b3980d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:53.514012 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff4629-3a60-43e7-a189-914c1b3980d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:53.533682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff4629-3a60-43e7-a189-914c1b3980d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:49:53.544303 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-85ff4629-3a60-43e7-a189-914c1b3980d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:49:53.544303 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:53.544303 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:53.544303 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:53.544303 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:53.544303 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:53.544303 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:53.544303 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:53.544303 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:53.544303 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:53.544303 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:53.544303 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:53.544303 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:49:53.544303 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:49:53.544303 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:49:53.544303 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:49:53.545421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:49:53.545421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:49:53.545421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:49:53.545421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:49:53.545421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:53.545421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:53.545421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:53.545421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:53.545421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:53.545421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:53.545421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:53.545421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:53.545421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:53.545421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:53.545421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:53.545421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:53.546294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:53.546294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:53.546294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:53.546294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:53.546294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:49:53.546294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:49:53.546294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:49:53.546294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:49:53.546294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:49:53.546294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:49:53.546294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:49:53.546294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:53.547217 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 411/790] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:49:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:49:53.561568 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff4629-3a60-43e7-a189-914c1b3980d4 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:53.572762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5daf4-63c0-4de6-951b-be5b08dbee44 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:53.625703 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e9e8e-11b0-46f7-ae26-bdea4182a4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:53.627149 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e9e8e-11b0-46f7-ae26-bdea4182a4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:53.627646 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e9e8e-11b0-46f7-ae26-bdea4182a4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:53.628187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e9e8e-11b0-46f7-ae26-bdea4182a4f3 None admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:53.629930 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e9e8e-11b0-46f7-ae26-bdea4182a4f3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:53.640718 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e9e8e-11b0-46f7-ae26-bdea4182a4f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:53.642749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e9e8e-11b0-46f7-ae26-bdea4182a4f3 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:53.680295 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 380/791] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Aug 2 08:49:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:49:53.687554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e9e8e-11b0-46f7-ae26-bdea4182a4f3 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:53.736693 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:53.764276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:53.766681 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff4629-3a60-43e7-a189-914c1b3980d4 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:53.844113 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7d773-1655-440b-abc4-b54b278b490c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:53.844794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7d773-1655-440b-abc4-b54b278b490c None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:53.845081 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7d773-1655-440b-abc4-b54b278b490c None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:53.845361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7d773-1655-440b-abc4-b54b278b490c None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:53.846109 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7d773-1655-440b-abc4-b54b278b490c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:53.846418 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7d773-1655-440b-abc4-b54b278b490c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:53.847821 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7d773-1655-440b-abc4-b54b278b490c None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:53.859336 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 412/792] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:49:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:53.866450 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7d773-1655-440b-abc4-b54b278b490c None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:53.966492 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e9e8e-11b0-46f7-ae26-bdea4182a4f3 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:54.074401 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a1f37-fee9-4f61-8730-2ec4a9a67f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:54.075868 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a1f37-fee9-4f61-8730-2ec4a9a67f36 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:54.076406 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a1f37-fee9-4f61-8730-2ec4a9a67f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:54.076890 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a1f37-fee9-4f61-8730-2ec4a9a67f36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:54.105727 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a1f37-fee9-4f61-8730-2ec4a9a67f36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:54.108567 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a1f37-fee9-4f61-8730-2ec4a9a67f36 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:54.133089 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7d773-1655-440b-abc4-b54b278b490c None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:54.157832 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-ca0a1f37-fee9-4f61-8730-2ec4a9a67f36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:54.157832 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:54.157832 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:54.157832 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:54.157832 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:54.157832 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:54.157832 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:54.157832 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:54.157832 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:54.157832 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:54.157832 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:54.157832 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:54.157832 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:54.157832 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:54.157832 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:54.158839 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:54.158839 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:54.158839 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:54.158839 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:54.158839 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:54.158839 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:54.158839 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:54.158839 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:54.158839 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:54.158839 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:54.158839 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:54.158839 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:54.158839 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:54.158839 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:54.158839 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:54.158839 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:54.158839 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:54.159770 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:54.159770 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:54.159770 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:54.159770 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:54.160603 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 381/793] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 473 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:54.174970 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a1f37-fee9-4f61-8730-2ec4a9a67f36 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:54.218011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4aa76-b4b2-4221-b1e3-cad105b45e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:54.219040 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4aa76-b4b2-4221-b1e3-cad105b45e58 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:54.219529 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4aa76-b4b2-4221-b1e3-cad105b45e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:54.220050 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4aa76-b4b2-4221-b1e3-cad105b45e58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:54.229888 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:54.235469 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f4aa76-b4b2-4221-b1e3-cad105b45e58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:54.237304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f4aa76-b4b2-4221-b1e3-cad105b45e58 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:54.255969 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-03f4aa76-b4b2-4221-b1e3-cad105b45e58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:54.255969 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:54.255969 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:54.255969 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:54.255969 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:54.255969 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:54.255969 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:54.255969 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:54.255969 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:54.255969 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:54.255969 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:54.255969 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:54.255969 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:54.255969 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:54.255969 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:54.257534 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:54.257534 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:54.257534 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:54.257534 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:54.257534 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:54.257534 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:54.257534 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:54.257534 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:54.257534 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:54.257534 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:54.257534 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:54.257534 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:54.257534 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:54.257534 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:54.257534 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:54.257534 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:54.257534 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:54.258869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:54.258869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:54.258869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:54.258869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:54.261468 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 413/794] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:54.263084 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552b1b2-aa6d-4c73-a84b-976239a3e04d None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:54.263600 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552b1b2-aa6d-4c73-a84b-976239a3e04d None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:54.264084 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552b1b2-aa6d-4c73-a84b-976239a3e04d None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:54.270260 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 414/795] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:54.271452 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552b1b2-aa6d-4c73-a84b-976239a3e04d None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:54.377635 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:54.421552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a1f37-fee9-4f61-8730-2ec4a9a67f36 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:54.464648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552b1b2-aa6d-4c73-a84b-976239a3e04d None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:54.489179 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825d68a-f1d0-452d-854b-89aa9e4ec51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:54.490177 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825d68a-f1d0-452d-854b-89aa9e4ec51e None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:54.491599 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825d68a-f1d0-452d-854b-89aa9e4ec51e None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:54.492078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825d68a-f1d0-452d-854b-89aa9e4ec51e None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:54.493343 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825d68a-f1d0-452d-854b-89aa9e4ec51e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:54.493973 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825d68a-f1d0-452d-854b-89aa9e4ec51e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:54.496823 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825d68a-f1d0-452d-854b-89aa9e4ec51e None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:54.528569 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 382/796] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:49:54.531090 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def56d6d-1180-4f21-9058-1bd57ab5b5ee None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:54.531576 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def56d6d-1180-4f21-9058-1bd57ab5b5ee None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:54.532053 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def56d6d-1180-4f21-9058-1bd57ab5b5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:54.534427 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5a5b7-3e83-4142-a9a5-e68898626e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:54.535749 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5a5b7-3e83-4142-a9a5-e68898626e35 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:54.536928 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5a5b7-3e83-4142-a9a5-e68898626e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:54.538299 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5a5b7-3e83-4142-a9a5-e68898626e35 None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:54.539899 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5a5b7-3e83-4142-a9a5-e68898626e35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:54.540869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5a5b7-3e83-4142-a9a5-e68898626e35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:54.543747 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5a5b7-3e83-4142-a9a5-e68898626e35 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:54.565614 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-def56d6d-1180-4f21-9058-1bd57ab5b5ee None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:54.566957 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 415/797] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:54.567713 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-def56d6d-1180-4f21-9058-1bd57ab5b5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:54.569672 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5a5b7-3e83-4142-a9a5-e68898626e35 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:54.665167 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:54.702777 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 383/798] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:49:54.704240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def56d6d-1180-4f21-9058-1bd57ab5b5ee None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:54.798585 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5a5b7-3e83-4142-a9a5-e68898626e35 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:54.863882 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:54.872810 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7fd004-52d2-4295-9fb7-300490489d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:54.873925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fd004-52d2-4295-9fb7-300490489d29 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:54.874395 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fd004-52d2-4295-9fb7-300490489d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:54.874859 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fd004-52d2-4295-9fb7-300490489d29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:54.890417 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7fd004-52d2-4295-9fb7-300490489d29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:54.894000 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7fd004-52d2-4295-9fb7-300490489d29 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:54.916312 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-af7fd004-52d2-4295-9fb7-300490489d29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:54.916312 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:54.916312 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:54.916312 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:54.916312 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:54.916312 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:54.916312 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:54.916312 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:54.916312 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:54.916312 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:54.916312 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:54.916312 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:54.916312 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:49:54.916312 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:49:54.916312 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:49:54.917394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:49:54.917394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:54.917394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:54.917394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:54.917394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:54.917394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:54.917394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:54.917394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:54.917394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:54.917394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:54.917394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:54.917394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:54.917394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:54.917394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:54.917394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:54.917394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:54.917394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:54.918299 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:49:54.918299 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:49:54.918299 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:49:54.918299 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:49:54.918299 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:49:54.918299 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:49:54.918299 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:54.918299 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:54.918299 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 416/799] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:49:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:54.919519 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7fd004-52d2-4295-9fb7-300490489d29 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:54.933079 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def56d6d-1180-4f21-9058-1bd57ab5b5ee None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:54.998492 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c40c3f5-6a51-4bd6-b07d-faea5ec4ed7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:54.999301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40c3f5-6a51-4bd6-b07d-faea5ec4ed7c None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:54.999705 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40c3f5-6a51-4bd6-b07d-faea5ec4ed7c None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:54.999984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40c3f5-6a51-4bd6-b07d-faea5ec4ed7c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:55.012577 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c40c3f5-6a51-4bd6-b07d-faea5ec4ed7c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:55.014639 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c40c3f5-6a51-4bd6-b07d-faea5ec4ed7c None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:55.028509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-6c40c3f5-6a51-4bd6-b07d-faea5ec4ed7c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:49:55.028509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:55.028509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:55.028509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:55.028509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:55.028509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:55.028509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:55.028509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:55.028509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:55.028509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:55.028509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:55.028509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:55.028509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:49:55.028509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:49:55.028509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:49:55.028509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:49:55.030335 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:55.030335 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:55.030335 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:49:55.030335 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:55.030335 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:49:55.030335 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:55.030335 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:55.030335 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:55.030335 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:55.030335 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:55.030335 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:55.030335 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:55.030335 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:55.030335 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:55.030335 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:55.030335 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:55.030335 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:55.030335 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:55.031654 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:55.031654 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:55.031654 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:49:55.031654 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:49:55.031654 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:49:55.031654 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:49:55.031654 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:49:55.031654 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:49:55.031654 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:49:55.031654 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:55.031654 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 384/800] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:49:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:55.031654 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190bb09-1970-42bc-8fee-61660a7b8a3c None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:55.031654 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190bb09-1970-42bc-8fee-61660a7b8a3c None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:55.036979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190bb09-1970-42bc-8fee-61660a7b8a3c None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:55.036979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 385/801] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:55.036979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190bb09-1970-42bc-8fee-61660a7b8a3c None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:55.090964 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7fd004-52d2-4295-9fb7-300490489d29 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:55.104255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:55.141505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ec0ed-2113-461f-a32c-a8c4a6920e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:55.142421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ec0ed-2113-461f-a32c-a8c4a6920e9f None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:55.142718 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ec0ed-2113-461f-a32c-a8c4a6920e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:55.142994 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ec0ed-2113-461f-a32c-a8c4a6920e9f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:55.143651 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ec0ed-2113-461f-a32c-a8c4a6920e9f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:55.145129 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ec0ed-2113-461f-a32c-a8c4a6920e9f None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:55.155914 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-1d3ec0ed-2113-461f-a32c-a8c4a6920e9f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 08:49:55.155914 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:55.155914 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:49:55.155914 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:49:55.155914 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:49:55.155914 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:49:55.155914 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:49:55.155914 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:49:55.155914 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 08:49:55.155914 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:55.155914 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:49:55.155914 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:55.155914 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:55.155914 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:55.155914 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:55.155914 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:55.157321 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:55.157321 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:55.157321 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:55.157321 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:55.157321 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:55.157321 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:55.157321 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:55.157321 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:49:55.157321 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:49:55.157321 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:49:55.157321 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:49:55.157321 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:55.157321 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:55.157321 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:55.157321 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:55.157321 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:55.158613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:55.158613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:55.158613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:55.158613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:55.158613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:55.158613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:55.158613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:55.158613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:55.158613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:55.158613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:55.158613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:55.158613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:49:55.158613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:49:55.158613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 08:49:55.158613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:55.158613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 417/802] 10.222.0.20 () {56 vars in 1129 bytes} [Tue Aug 2 08:49:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:55.160929 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ec0ed-2113-461f-a32c-a8c4a6920e9f None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:55.201264 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190bb09-1970-42bc-8fee-61660a7b8a3c None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:55.260486 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:55.270039 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d34aa-53ba-4424-b23f-b08657829fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:55.276118 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d34aa-53ba-4424-b23f-b08657829fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:55.276118 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d34aa-53ba-4424-b23f-b08657829fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:55.276118 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d34aa-53ba-4424-b23f-b08657829fe3 None admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:55.276118 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d34aa-53ba-4424-b23f-b08657829fe3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:55.276118 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d34aa-53ba-4424-b23f-b08657829fe3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:55.276882 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d34aa-53ba-4424-b23f-b08657829fe3 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:55.308215 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 386/803] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:49:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:55.308215 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb4260-51e6-4f3d-98e9-5e866c33a430 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:55.308215 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb4260-51e6-4f3d-98e9-5e866c33a430 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:55.308215 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb4260-51e6-4f3d-98e9-5e866c33a430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:55.325268 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-dfcb4260-51e6-4f3d-98e9-5e866c33a430 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:55.327456 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-dfcb4260-51e6-4f3d-98e9-5e866c33a430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:55.345512 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ec0ed-2113-461f-a32c-a8c4a6920e9f None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:55.390237 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421d412-5dce-4942-8d0f-92d8e6a0f65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:55.390996 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421d412-5dce-4942-8d0f-92d8e6a0f65a None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:55.391470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421d412-5dce-4942-8d0f-92d8e6a0f65a None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:55.391957 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421d412-5dce-4942-8d0f-92d8e6a0f65a None admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:55.393533 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9421d412-5dce-4942-8d0f-92d8e6a0f65a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:55.394093 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9421d412-5dce-4942-8d0f-92d8e6a0f65a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:55.396376 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9421d412-5dce-4942-8d0f-92d8e6a0f65a None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:55.427622 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 418/804] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Aug 2 08:49:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:55.427622 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421d412-5dce-4942-8d0f-92d8e6a0f65a None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:55.445409 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 387/805] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:49:55.447025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb4260-51e6-4f3d-98e9-5e866c33a430 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:55.482227 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:55.598603 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421d412-5dce-4942-8d0f-92d8e6a0f65a None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:55.627105 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb4260-51e6-4f3d-98e9-5e866c33a430 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:55.654881 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02245b0e-d6e3-44c6-a70c-f69ebfd0f047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:55.655848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02245b0e-d6e3-44c6-a70c-f69ebfd0f047 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:55.656266 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02245b0e-d6e3-44c6-a70c-f69ebfd0f047 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:55.656591 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02245b0e-d6e3-44c6-a70c-f69ebfd0f047 None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:55.657518 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02245b0e-d6e3-44c6-a70c-f69ebfd0f047 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:55.657862 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02245b0e-d6e3-44c6-a70c-f69ebfd0f047 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:55.660013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02245b0e-d6e3-44c6-a70c-f69ebfd0f047 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:55.665078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:55.669332 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 419/806] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Aug 2 08:49:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:55.670500 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02245b0e-d6e3-44c6-a70c-f69ebfd0f047 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:55.683630 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cda873-e15a-4e59-ab5e-6fcdb29f209b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:55.684798 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cda873-e15a-4e59-ab5e-6fcdb29f209b None admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:55.684798 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cda873-e15a-4e59-ab5e-6fcdb29f209b None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:55.685132 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cda873-e15a-4e59-ab5e-6fcdb29f209b None admin] PATH_INFO: `/v3/projects/6910e69702854607889bab124edd60c9/users/eb640d92cb9b49019f42351a60efe258/roles/bc21bdc3d9dd4091a04f1e2fef77a8c3` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:55.702263 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cda873-e15a-4e59-ab5e-6fcdb29f209b None admin] RBAC: Authorizing `identity:create_grant(project_id=6910e69702854607889bab124edd60c9, user_id=eb640d92cb9b49019f42351a60efe258, role_id=bc21bdc3d9dd4091a04f1e2fef77a8c3)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:55.703730 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cda873-e15a-4e59-ab5e-6fcdb29f209b None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:55.790225 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:55.796247 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02245b0e-d6e3-44c6-a70c-f69ebfd0f047 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:55.815547 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 388/807] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Aug 2 08:49:55 2022] PUT /identity/v3/projects/6910e69702854607889bab124edd60c9/users/eb640d92cb9b49019f42351a60efe258/roles/bc21bdc3d9dd4091a04f1e2fef77a8c3 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:49:55.816411 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cda873-e15a-4e59-ab5e-6fcdb29f209b None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:55.853973 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df271ab4-3f2a-4d59-9c19-08ec7003284a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:55.855499 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df271ab4-3f2a-4d59-9c19-08ec7003284a None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:55.856207 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df271ab4-3f2a-4d59-9c19-08ec7003284a None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:55.856659 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df271ab4-3f2a-4d59-9c19-08ec7003284a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:55.877672 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df271ab4-3f2a-4d59-9c19-08ec7003284a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:55.880560 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df271ab4-3f2a-4d59-9c19-08ec7003284a None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:55.906628 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-df271ab4-3f2a-4d59-9c19-08ec7003284a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:55.906628 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:55.906628 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:55.906628 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:55.906628 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:55.906628 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:55.906628 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:55.906628 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:55.906628 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:55.906628 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:55.906628 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:55.906628 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:55.906628 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:55.906628 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:55.906628 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:55.908228 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:55.908228 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:55.908228 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:55.908228 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:55.908228 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:55.908228 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:55.908228 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:55.908228 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:55.908228 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:55.908228 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:55.908228 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:55.908228 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:55.908228 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:55.908228 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:55.908228 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:55.908228 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:55.908228 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:55.911646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:55.911646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:55.911646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:55.911646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:55.911646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 420/808] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:55.911646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad919e-48d9-43fb-927f-c2d58affa86c None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:55.911646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad919e-48d9-43fb-927f-c2d58affa86c None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:55.911646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad919e-48d9-43fb-927f-c2d58affa86c None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:55.911646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 421/809] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:55.914951 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad919e-48d9-43fb-927f-c2d58affa86c None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:55.976767 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cda873-e15a-4e59-ab5e-6fcdb29f209b None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:56.037082 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f261e0b-39c3-497d-8a0c-4b6fa63cbfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:56.038861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f261e0b-39c3-497d-8a0c-4b6fa63cbfbf None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:56.039915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f261e0b-39c3-497d-8a0c-4b6fa63cbfbf None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:56.040518 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f261e0b-39c3-497d-8a0c-4b6fa63cbfbf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:56.057446 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f261e0b-39c3-497d-8a0c-4b6fa63cbfbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:49:56.060525 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad919e-48d9-43fb-927f-c2d58affa86c None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:56.062601 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-2f261e0b-39c3-497d-8a0c-4b6fa63cbfbf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:49:56.062601 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:56.062601 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:56.062601 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:56.062601 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:56.062601 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:56.062601 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:56.062601 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:56.062601 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:56.062601 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:56.062601 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:56.062601 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:56.062601 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:49:56.062601 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:49:56.062601 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:49:56.062601 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:49:56.064794 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:49:56.064794 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:49:56.064794 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:49:56.064794 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:49:56.064794 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:56.064794 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:56.064794 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:56.064794 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:56.064794 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:56.064794 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:56.064794 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:56.064794 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:56.064794 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:56.064794 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:56.064794 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:56.064794 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:56.066417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:56.066417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:56.066417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:56.066417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:56.066417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:49:56.066417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:49:56.066417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:49:56.066417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:49:56.066417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:49:56.066417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:49:56.066417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:49:56.066417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:56.066417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 389/810] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:49:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:56.066417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f261e0b-39c3-497d-8a0c-4b6fa63cbfbf None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:56.119486 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:56.125166 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cbfcb-806b-46bc-a374-d889d9359421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:56.126257 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cbfcb-806b-46bc-a374-d889d9359421 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:56.126633 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cbfcb-806b-46bc-a374-d889d9359421 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:56.127052 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cbfcb-806b-46bc-a374-d889d9359421 None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:56.127924 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898cbfcb-806b-46bc-a374-d889d9359421 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:56.128261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898cbfcb-806b-46bc-a374-d889d9359421 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:56.129696 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898cbfcb-806b-46bc-a374-d889d9359421 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:56.137605 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 422/811] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Aug 2 08:49:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:56.140629 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2e5ad-94c1-49ee-9b7a-bf18e958832a None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:56.140985 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2e5ad-94c1-49ee-9b7a-bf18e958832a None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:56.141325 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2e5ad-94c1-49ee-9b7a-bf18e958832a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:56.165081 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-f2c2e5ad-94c1-49ee-9b7a-bf18e958832a None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:56.166327 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-f2c2e5ad-94c1-49ee-9b7a-bf18e958832a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:56.180377 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:56.218803 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f261e0b-39c3-497d-8a0c-4b6fa63cbfbf None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:56.262176 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20402529-19cd-4523-86e4-d48b3ad144ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:56.262830 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20402529-19cd-4523-86e4-d48b3ad144ab None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:56.263115 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20402529-19cd-4523-86e4-d48b3ad144ab None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:56.263396 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20402529-19cd-4523-86e4-d48b3ad144ab None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:56.264116 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20402529-19cd-4523-86e4-d48b3ad144ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:56.264460 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20402529-19cd-4523-86e4-d48b3ad144ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:56.272283 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 423/812] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:49:56.273207 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20402529-19cd-4523-86e4-d48b3ad144ab None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:56.273295 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2e5ad-94c1-49ee-9b7a-bf18e958832a None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:56.291572 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 390/813] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:56.293033 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20402529-19cd-4523-86e4-d48b3ad144ab None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:56.451843 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2e5ad-94c1-49ee-9b7a-bf18e958832a None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:56.452876 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:56.466760 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20402529-19cd-4523-86e4-d48b3ad144ab None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:56.514218 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991a02a-5876-4435-94f2-bcffe94dbc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:56.515304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991a02a-5876-4435-94f2-bcffe94dbc37 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:56.515683 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991a02a-5876-4435-94f2-bcffe94dbc37 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:56.516213 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991a02a-5876-4435-94f2-bcffe94dbc37 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:56.517469 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991a02a-5876-4435-94f2-bcffe94dbc37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:56.517679 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991a02a-5876-4435-94f2-bcffe94dbc37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:56.520323 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991a02a-5876-4435-94f2-bcffe94dbc37 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:56.520490 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841d943-7375-4e4d-bd6d-4baa116600db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:56.521126 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841d943-7375-4e4d-bd6d-4baa116600db None admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:56.522780 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841d943-7375-4e4d-bd6d-4baa116600db None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:56.523064 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841d943-7375-4e4d-bd6d-4baa116600db None admin] PATH_INFO: `/v3/endpoints` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:56.523819 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841d943-7375-4e4d-bd6d-4baa116600db None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:56.525272 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841d943-7375-4e4d-bd6d-4baa116600db None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:56.543445 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 424/814] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:49:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:56.543445 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991a02a-5876-4435-94f2-bcffe94dbc37 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:56.548870 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:56.665562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991a02a-5876-4435-94f2-bcffe94dbc37 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:56.674284 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 391/815] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 08:49:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:49:56.675127 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841d943-7375-4e4d-bd6d-4baa116600db None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:56.733475 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53df74-b5d0-4c16-8f19-3f6f722e8a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:56.734154 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53df74-b5d0-4c16-8f19-3f6f722e8a8a None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:56.734501 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53df74-b5d0-4c16-8f19-3f6f722e8a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:56.734873 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53df74-b5d0-4c16-8f19-3f6f722e8a8a None admin] PATH_INFO: `/v3/services/network` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:56.735688 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53df74-b5d0-4c16-8f19-3f6f722e8a8a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:56.737335 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53df74-b5d0-4c16-8f19-3f6f722e8a8a None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:56.755140 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-7e53df74-b5d0-4c16-8f19-3f6f722e8a8a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 08:49:56.755140 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:56.755140 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:49:56.755140 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:49:56.755140 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:49:56.755140 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:49:56.755140 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:49:56.755140 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:49:56.755140 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 08:49:56.755140 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:56.755140 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:49:56.755140 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:56.755140 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:56.755140 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:56.755140 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:56.755140 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:56.755140 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:56.757156 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:56.757156 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:56.757156 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:56.757156 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:56.757156 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:56.757156 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:56.757156 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:49:56.757156 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:49:56.757156 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:49:56.757156 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:49:56.757156 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:56.757156 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:56.757156 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:56.757156 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:56.757156 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:56.757156 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:56.758282 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:56.758282 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:56.758282 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:56.758282 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:56.758282 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:56.758282 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:56.758282 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:56.758282 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:56.758282 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:56.758282 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:56.758282 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:49:56.758282 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:49:56.758282 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 08:49:56.758282 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:56.764760 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 425/816] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:49:56 2022] GET /identity/v3/services/network => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:56.766299 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53df74-b5d0-4c16-8f19-3f6f722e8a8a None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:56.866153 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:56.873901 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841d943-7375-4e4d-bd6d-4baa116600db None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:56.928896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd8a3a-87b6-4885-a874-c313837fe3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:56.929308 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53df74-b5d0-4c16-8f19-3f6f722e8a8a None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:56.929575 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd8a3a-87b6-4885-a874-c313837fe3ac None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:56.929855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd8a3a-87b6-4885-a874-c313837fe3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:56.930130 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd8a3a-87b6-4885-a874-c313837fe3ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:56.939022 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd8a3a-87b6-4885-a874-c313837fe3ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:56.941013 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd8a3a-87b6-4885-a874-c313837fe3ac None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:56.957391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-63fd8a3a-87b6-4885-a874-c313837fe3ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:56.957391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:56.957391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:56.957391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:56.957391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:56.957391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:56.957391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:56.957391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:56.957391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:56.957391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:56.957391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:56.957391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:56.957391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:49:56.957391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:49:56.957391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:49:56.958353 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:49:56.958353 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:56.958353 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:56.958353 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:56.958353 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:56.958353 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:56.958353 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:56.958353 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:56.958353 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:56.958353 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:56.958353 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:56.958353 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:56.958353 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:56.958353 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:56.958353 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:56.958353 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:56.958353 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:56.959394 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:49:56.959394 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:49:56.959394 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:49:56.959394 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:49:56.959394 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:49:56.959394 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:49:56.959394 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:56.959394 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:56.959394 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 392/817] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:49:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:56.960410 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd8a3a-87b6-4885-a874-c313837fe3ac None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:56.975515 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:56.998551 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a70caa-e5a4-4d64-993c-4f7cf44b546a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:56.999233 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a70caa-e5a4-4d64-993c-4f7cf44b546a None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:57.005380 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a70caa-e5a4-4d64-993c-4f7cf44b546a None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:57.005380 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a70caa-e5a4-4d64-993c-4f7cf44b546a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:57.015436 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a70caa-e5a4-4d64-993c-4f7cf44b546a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:57.017315 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a70caa-e5a4-4d64-993c-4f7cf44b546a None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:57.040009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-e1a70caa-e5a4-4d64-993c-4f7cf44b546a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:57.040009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:57.040009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:57.040009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:57.040009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:57.040009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:57.040009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:57.040009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:57.040009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:57.040009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:57.040009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:57.040009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:57.040009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:57.040009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:57.040009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:57.041214 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:57.041214 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:57.041214 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:57.041214 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:57.041214 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:57.041214 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:57.041214 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:57.041214 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:57.041214 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:57.041214 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:57.041214 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:57.041214 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:57.041214 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:57.041214 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:57.041214 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:57.041214 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:57.041214 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:57.042207 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:57.042207 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:57.042207 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:57.042207 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:57.042207 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 426/818] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:57.042532 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a70caa-e5a4-4d64-993c-4f7cf44b546a None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:57.094486 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd8a3a-87b6-4885-a874-c313837fe3ac None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:57.138490 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71547af-fe83-46c4-87d2-d0a054fce8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:57.143687 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71547af-fe83-46c4-87d2-d0a054fce8d2 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:57.143687 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71547af-fe83-46c4-87d2-d0a054fce8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:57.143687 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71547af-fe83-46c4-87d2-d0a054fce8d2 None admin] PATH_INFO: `/v3/services` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:57.143687 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71547af-fe83-46c4-87d2-d0a054fce8d2 None admin] RBAC: Adding query filter params (name=network) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:57.143687 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71547af-fe83-46c4-87d2-d0a054fce8d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:57.143687 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71547af-fe83-46c4-87d2-d0a054fce8d2 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:57.151100 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 393/819] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Aug 2 08:49:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:57.151792 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71547af-fe83-46c4-87d2-d0a054fce8d2 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:57.190430 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a70caa-e5a4-4d64-993c-4f7cf44b546a None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:57.209574 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:57.229545 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574e2d1-124e-4a66-9c10-a71c70d10cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:57.230190 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574e2d1-124e-4a66-9c10-a71c70d10cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:57.230476 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574e2d1-124e-4a66-9c10-a71c70d10cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:57.230753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574e2d1-124e-4a66-9c10-a71c70d10cd9 None admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:57.231819 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574e2d1-124e-4a66-9c10-a71c70d10cd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:57.232137 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574e2d1-124e-4a66-9c10-a71c70d10cd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:57.233908 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574e2d1-124e-4a66-9c10-a71c70d10cd9 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:57.249209 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 427/820] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:49:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:57.250095 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574e2d1-124e-4a66-9c10-a71c70d10cd9 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:57.257094 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:57.299501 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71547af-fe83-46c4-87d2-d0a054fce8d2 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:57.344495 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a5d64-9d9d-42d2-ab89-ed62eceb57a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:57.345243 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a5d64-9d9d-42d2-ab89-ed62eceb57a1 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:57.345593 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a5d64-9d9d-42d2-ab89-ed62eceb57a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:57.345954 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a5d64-9d9d-42d2-ab89-ed62eceb57a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:57.346735 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a5d64-9d9d-42d2-ab89-ed62eceb57a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:57.347107 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a5d64-9d9d-42d2-ab89-ed62eceb57a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:57.348802 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a5d64-9d9d-42d2-ab89-ed62eceb57a1 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:57.363407 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 394/821] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:57.364415 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a5d64-9d9d-42d2-ab89-ed62eceb57a1 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:57.381883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574e2d1-124e-4a66-9c10-a71c70d10cd9 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:57.434210 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81dc28-876a-4f37-b8d6-edc3719c0c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:57.435231 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81dc28-876a-4f37-b8d6-edc3719c0c15 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:57.435630 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81dc28-876a-4f37-b8d6-edc3719c0c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:57.435985 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81dc28-876a-4f37-b8d6-edc3719c0c15 None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:57.437312 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81dc28-876a-4f37-b8d6-edc3719c0c15 None admin] RBAC: Adding query filter params (type=network) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:57.437693 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81dc28-876a-4f37-b8d6-edc3719c0c15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:57.439315 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81dc28-876a-4f37-b8d6-edc3719c0c15 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:57.446765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 428/822] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Aug 2 08:49:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:57.458402 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81dc28-876a-4f37-b8d6-edc3719c0c15 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:57.505490 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:57.518667 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a5d64-9d9d-42d2-ab89-ed62eceb57a1 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:57.573721 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:57.579405 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7b8a3-e64c-4cd0-a157-9b003c608658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:57.580331 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7b8a3-e64c-4cd0-a157-9b003c608658 None admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:57.580666 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7b8a3-e64c-4cd0-a157-9b003c608658 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:57.580953 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7b8a3-e64c-4cd0-a157-9b003c608658 None admin] PATH_INFO: `/v3/projects/6910e69702854607889bab124edd60c9/users/58f8e572550b4ab5955d7a94f1563441/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:57.583599 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7b8a3-e64c-4cd0-a157-9b003c608658 None admin] RBAC: Authorizing `identity:create_grant(project_id=6910e69702854607889bab124edd60c9, user_id=58f8e572550b4ab5955d7a94f1563441, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:57.585941 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7b8a3-e64c-4cd0-a157-9b003c608658 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:57.601887 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81dc28-876a-4f37-b8d6-edc3719c0c15 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:57.662220 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911bf1a-abe6-4c92-a804-b691cdddf8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:57.663039 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911bf1a-abe6-4c92-a804-b691cdddf8cd None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:57.663203 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911bf1a-abe6-4c92-a804-b691cdddf8cd None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:57.663456 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911bf1a-abe6-4c92-a804-b691cdddf8cd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:57.676730 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 395/823] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Aug 2 08:49:57 2022] PUT /identity/v3/projects/6910e69702854607889bab124edd60c9/users/58f8e572550b4ab5955d7a94f1563441/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:49:57.677061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b911bf1a-abe6-4c92-a804-b691cdddf8cd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:57.678149 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7b8a3-e64c-4cd0-a157-9b003c608658 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:57.682167 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b911bf1a-abe6-4c92-a804-b691cdddf8cd None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:57.694794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-b911bf1a-abe6-4c92-a804-b691cdddf8cd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:49:57.694794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:57.694794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:57.694794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:57.694794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:57.694794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:57.694794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:57.694794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:57.694794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:57.694794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:57.694794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:57.694794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:57.694794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:49:57.694794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:49:57.694794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:49:57.694794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:49:57.695883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:57.695883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:57.695883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:49:57.695883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:57.695883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:49:57.695883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:57.695883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:57.695883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:57.695883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:57.695883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:57.695883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:57.695883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:57.695883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:57.695883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:57.695883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:57.695883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:57.695883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:57.695883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:57.696925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:57.696925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:57.696925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:49:57.696925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:49:57.696925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:49:57.696925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:49:57.696925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:49:57.696925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:49:57.696925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:49:57.696925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:57.696925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 429/824] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Aug 2 08:49:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:57.710067 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911bf1a-abe6-4c92-a804-b691cdddf8cd None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:57.824517 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7b8a3-e64c-4cd0-a157-9b003c608658 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:57.873000 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa799a0-3b58-4d7f-b431-b580d08e951e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:57.874041 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa799a0-3b58-4d7f-b431-b580d08e951e None admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:57.874538 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa799a0-3b58-4d7f-b431-b580d08e951e None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:57.875023 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa799a0-3b58-4d7f-b431-b580d08e951e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:57.876335 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa799a0-3b58-4d7f-b431-b580d08e951e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:57.878182 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa799a0-3b58-4d7f-b431-b580d08e951e None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:57.914382 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:57.918368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911bf1a-abe6-4c92-a804-b691cdddf8cd None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:57.962041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50128b4-076c-4103-9194-56cf1e5006b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:57.962596 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50128b4-076c-4103-9194-56cf1e5006b0 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:57.963025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50128b4-076c-4103-9194-56cf1e5006b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:57.963307 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50128b4-076c-4103-9194-56cf1e5006b0 None admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:57.964242 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50128b4-076c-4103-9194-56cf1e5006b0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:57.964650 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50128b4-076c-4103-9194-56cf1e5006b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:57.966052 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50128b4-076c-4103-9194-56cf1e5006b0 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:57.977256 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 396/825] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 08:49:57 2022] POST /identity/v3/endpoints => generated 337 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:49:57.997354 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 430/826] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Aug 2 08:49:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:58.003795 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa799a0-3b58-4d7f-b431-b580d08e951e None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:58.074691 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:58.166065 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa799a0-3b58-4d7f-b431-b580d08e951e None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:58.202068 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613e4f7-0c06-402a-9479-30f238083888 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:58.202401 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613e4f7-0c06-402a-9479-30f238083888 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:58.202632 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613e4f7-0c06-402a-9479-30f238083888 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:58.205508 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 431/827] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:58.210431 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4913a5b-4ace-4973-a207-a7e5a0e78be9 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:58.210743 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4913a5b-4ace-4973-a207-a7e5a0e78be9 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:58.210979 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4913a5b-4ace-4973-a207-a7e5a0e78be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:58.219309 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab18ff1-7152-4941-8a5b-52a596f87499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:58.219988 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab18ff1-7152-4941-8a5b-52a596f87499 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:58.220299 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab18ff1-7152-4941-8a5b-52a596f87499 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:58.220586 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab18ff1-7152-4941-8a5b-52a596f87499 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:58.247589 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-c4913a5b-4ace-4973-a207-a7e5a0e78be9 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:58.249615 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-c4913a5b-4ace-4973-a207-a7e5a0e78be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:58.327378 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab18ff1-7152-4941-8a5b-52a596f87499 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:58.329956 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab18ff1-7152-4941-8a5b-52a596f87499 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:58.360655 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 432/828] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:49:58.386108 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4913a5b-4ace-4973-a207-a7e5a0e78be9 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:58.393318 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:58.473993 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 397/829] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:49:58 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 08:49:58.480181 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab18ff1-7152-4941-8a5b-52a596f87499 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:58.535963 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:58.550804 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4913a5b-4ace-4973-a207-a7e5a0e78be9 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:58.602826 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299732c-a625-47dd-8bfc-fa5e9d612b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:58.604577 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299732c-a625-47dd-8bfc-fa5e9d612b62 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:58.605372 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299732c-a625-47dd-8bfc-fa5e9d612b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:58.605852 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299732c-a625-47dd-8bfc-fa5e9d612b62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:58.619248 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab18ff1-7152-4941-8a5b-52a596f87499 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:58.623138 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299732c-a625-47dd-8bfc-fa5e9d612b62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:49:58.629570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-6299732c-a625-47dd-8bfc-fa5e9d612b62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:58.629570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:58.629570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:58.629570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:58.629570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:58.629570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:58.629570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:58.629570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:58.629570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:58.629570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:58.629570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:58.629570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:58.629570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:49:58.629570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:49:58.629570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:49:58.629570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:49:58.630633 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:49:58.630633 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:49:58.630633 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:49:58.630633 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:49:58.630633 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:58.630633 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:58.630633 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:58.630633 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:58.630633 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:58.630633 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:58.630633 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:58.630633 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:58.630633 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:58.630633 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:58.630633 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:58.630633 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:58.632101 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:58.632101 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:58.632101 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:58.632101 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:58.632101 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:49:58.632101 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:49:58.632101 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:49:58.632101 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:49:58.632101 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:49:58.632101 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:49:58.632101 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:49:58.632101 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:58.635688 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 433/830] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Aug 2 08:49:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:49:58.641192 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299732c-a625-47dd-8bfc-fa5e9d612b62 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:58.672797 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52432505-cfb9-468f-8d4d-5619b7cd76f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:58.673529 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52432505-cfb9-468f-8d4d-5619b7cd76f3 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:58.673814 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52432505-cfb9-468f-8d4d-5619b7cd76f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:58.674094 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52432505-cfb9-468f-8d4d-5619b7cd76f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:58.691110 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52432505-cfb9-468f-8d4d-5619b7cd76f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:58.692772 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52432505-cfb9-468f-8d4d-5619b7cd76f3 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:58.697567 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:58.716487 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-52432505-cfb9-468f-8d4d-5619b7cd76f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:58.716487 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:58.716487 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:58.716487 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:58.716487 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:58.716487 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:58.716487 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:58.716487 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:58.716487 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:58.716487 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:58.716487 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:58.716487 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:58.716487 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:58.716487 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:58.716487 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:58.717609 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:58.717609 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:58.717609 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:58.717609 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:58.717609 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:58.717609 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:58.717609 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:58.717609 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:58.717609 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:58.717609 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:58.717609 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:58.717609 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:58.717609 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:58.717609 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:58.717609 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:58.717609 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:58.717609 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:58.718928 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:58.718928 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:58.718928 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:58.718928 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:58.718928 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 398/831] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:58.724351 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52432505-cfb9-468f-8d4d-5619b7cd76f3 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:58.767849 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299732c-a625-47dd-8bfc-fa5e9d612b62 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:58.808819 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795f014-27dc-4149-8ace-d2797f40a73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:58.809813 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795f014-27dc-4149-8ace-d2797f40a73f None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:58.810320 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795f014-27dc-4149-8ace-d2797f40a73f None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:58.810788 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795f014-27dc-4149-8ace-d2797f40a73f None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:58.811705 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795f014-27dc-4149-8ace-d2797f40a73f None admin] RBAC: Adding query filter params (name=service) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:58.812243 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795f014-27dc-4149-8ace-d2797f40a73f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:58.814026 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795f014-27dc-4149-8ace-d2797f40a73f None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:58.828963 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 434/832] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Aug 2 08:49:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:58.830609 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795f014-27dc-4149-8ace-d2797f40a73f None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:58.840630 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52432505-cfb9-468f-8d4d-5619b7cd76f3 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:58.845284 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:58.879443 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a384b5-e41c-465d-8a9e-123967a84f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:58.880079 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a384b5-e41c-465d-8a9e-123967a84f7e None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:58.880427 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a384b5-e41c-465d-8a9e-123967a84f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:58.880722 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a384b5-e41c-465d-8a9e-123967a84f7e None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:58.882022 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a384b5-e41c-465d-8a9e-123967a84f7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:58.882335 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a384b5-e41c-465d-8a9e-123967a84f7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:58.884049 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a384b5-e41c-465d-8a9e-123967a84f7e None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:58.906063 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 399/833] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:58.907197 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a384b5-e41c-465d-8a9e-123967a84f7e None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:58.959434 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795f014-27dc-4149-8ace-d2797f40a73f None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:58.977233 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:59.014255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232c25e-85df-4f45-bc50-fd4fa5c46c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:59.015330 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232c25e-85df-4f45-bc50-fd4fa5c46c63 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:59.015808 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232c25e-85df-4f45-bc50-fd4fa5c46c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:59.016315 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232c25e-85df-4f45-bc50-fd4fa5c46c63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:59.036067 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e232c25e-85df-4f45-bc50-fd4fa5c46c63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:59.037885 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a384b5-e41c-465d-8a9e-123967a84f7e None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:59.039503 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e232c25e-85df-4f45-bc50-fd4fa5c46c63 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:59.068041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-e232c25e-85df-4f45-bc50-fd4fa5c46c63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:59.068041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:59.068041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:59.068041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:59.068041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:59.068041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:59.068041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:59.068041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:59.068041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:59.068041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:59.068041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:59.068041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:59.068041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:49:59.068041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:49:59.068041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:49:59.070352 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:49:59.070352 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:59.070352 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:59.070352 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:59.070352 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:59.070352 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:59.070352 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:59.070352 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:59.070352 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:59.070352 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:59.070352 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:59.070352 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:59.070352 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:59.070352 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:59.070352 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:59.070352 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:59.070352 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:59.072116 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:49:59.072116 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:49:59.072116 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:49:59.072116 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:59.081820 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 435/834] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:49:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:49:59.086896 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232c25e-85df-4f45-bc50-fd4fa5c46c63 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:59.102974 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e4ae5-3ca9-43f0-ac5f-cadaeba5c551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:59.103971 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e4ae5-3ca9-43f0-ac5f-cadaeba5c551 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:59.104494 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e4ae5-3ca9-43f0-ac5f-cadaeba5c551 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:59.104964 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e4ae5-3ca9-43f0-ac5f-cadaeba5c551 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:59.117780 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e4ae5-3ca9-43f0-ac5f-cadaeba5c551 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:59.120492 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e4ae5-3ca9-43f0-ac5f-cadaeba5c551 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:59.142175 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-4b4e4ae5-3ca9-43f0-ac5f-cadaeba5c551 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:59.142175 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:59.142175 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:59.142175 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:59.142175 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:59.142175 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:59.142175 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:59.142175 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:59.142175 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:59.142175 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:59.142175 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:59.142175 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:59.142175 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:49:59.142175 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:49:59.142175 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:49:59.143927 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:49:59.143927 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:59.143927 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:59.143927 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:59.143927 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:59.143927 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:59.143927 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:59.143927 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:59.143927 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:59.143927 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:59.143927 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:59.143927 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:59.143927 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:59.143927 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:59.143927 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:59.143927 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:59.143927 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:59.146578 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:49:59.146578 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:49:59.146578 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:49:59.146578 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:49:59.146578 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:49:59.146578 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:49:59.146578 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:49:59.146578 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:49:59.148323 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 400/835] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:49:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:49:59.153956 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e4ae5-3ca9-43f0-ac5f-cadaeba5c551 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:59.211487 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:59.283569 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232c25e-85df-4f45-bc50-fd4fa5c46c63 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:59.345788 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13231d-c98f-4d73-973f-47ffb63bbe9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:59.346976 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13231d-c98f-4d73-973f-47ffb63bbe9d None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:59.347540 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13231d-c98f-4d73-973f-47ffb63bbe9d None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:59.347709 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e4ae5-3ca9-43f0-ac5f-cadaeba5c551 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:59.348211 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13231d-c98f-4d73-973f-47ffb63bbe9d None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:59.349572 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13231d-c98f-4d73-973f-47ffb63bbe9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:59.350727 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13231d-c98f-4d73-973f-47ffb63bbe9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:59.353381 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13231d-c98f-4d73-973f-47ffb63bbe9d None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:59.384340 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 436/836] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:49:59.387567 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13231d-c98f-4d73-973f-47ffb63bbe9d None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:59.388434 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:59.423996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77760106-e5ad-4984-9abf-c01585112c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:59.425012 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77760106-e5ad-4984-9abf-c01585112c63 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:59.425575 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77760106-e5ad-4984-9abf-c01585112c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:59.426458 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77760106-e5ad-4984-9abf-c01585112c63 None admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:59.428584 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77760106-e5ad-4984-9abf-c01585112c63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:59.429691 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77760106-e5ad-4984-9abf-c01585112c63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:59.432542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77760106-e5ad-4984-9abf-c01585112c63 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:59.465308 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 401/837] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:49:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:49:59.465308 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09451d-0877-4ef4-874a-7cfb1ce0951a None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:59.465308 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09451d-0877-4ef4-874a-7cfb1ce0951a None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:59.465308 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09451d-0877-4ef4-874a-7cfb1ce0951a None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:59.465308 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 402/838] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:49:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:49:59.467058 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09451d-0877-4ef4-874a-7cfb1ce0951a None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:59.554649 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13231d-c98f-4d73-973f-47ffb63bbe9d None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:59.582865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:59.602063 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9cd99c-19db-4d5c-aa31-248732e213b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:59.602737 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cd99c-19db-4d5c-aa31-248732e213b1 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:59.603019 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cd99c-19db-4d5c-aa31-248732e213b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:59.603299 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cd99c-19db-4d5c-aa31-248732e213b1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:59.610149 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09451d-0877-4ef4-874a-7cfb1ce0951a None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:59.612428 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9cd99c-19db-4d5c-aa31-248732e213b1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:59.614161 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9cd99c-19db-4d5c-aa31-248732e213b1 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:59.628761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-6e9cd99c-19db-4d5c-aa31-248732e213b1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:49:59.628761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:49:59.628761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:49:59.628761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:49:59.628761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:49:59.628761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:49:59.628761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:49:59.628761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:49:59.628761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:49:59.628761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:49:59.628761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:49:59.628761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:49:59.628761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:49:59.628761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:49:59.628761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:49:59.628761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:49:59.629794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:49:59.629794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:49:59.629794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:49:59.629794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:59.629794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:49:59.629794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:49:59.629794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:49:59.629794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:49:59.629794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:49:59.629794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:49:59.629794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:49:59.629794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:49:59.629794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:49:59.629794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:49:59.629794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:49:59.629794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:49:59.629794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:49:59.629794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:49:59.631528 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:49:59.631528 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:49:59.631528 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:49:59.631528 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:49:59.631528 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:49:59.631528 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:49:59.631528 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:49:59.631528 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:49:59.631528 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:49:59.631528 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:49:59.631528 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 437/839] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Aug 2 08:49:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:49:59.632795 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c51fda-8260-4855-b90d-d0407e152ff5 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:59.633083 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c51fda-8260-4855-b90d-d0407e152ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:59.633357 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c51fda-8260-4855-b90d-d0407e152ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:59.655723 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-c8c51fda-8260-4855-b90d-d0407e152ff5 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:49:59.656877 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-c8c51fda-8260-4855-b90d-d0407e152ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:49:59.672469 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad09fbd-3168-42a6-85eb-eb8208756e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:59.673378 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad09fbd-3168-42a6-85eb-eb8208756e03 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:59.673674 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad09fbd-3168-42a6-85eb-eb8208756e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:59.673929 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad09fbd-3168-42a6-85eb-eb8208756e03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:59.674732 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad09fbd-3168-42a6-85eb-eb8208756e03 None admin] RBAC: Adding query filter params (role.id=b5477d3c4e5a4514b64211ec2452d1d8, scope.project.id=6910e69702854607889bab124edd60c9, user.id=7bfcddefa71546d28078a38325c723a9) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:59.675044 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad09fbd-3168-42a6-85eb-eb8208756e03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:59.676550 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad09fbd-3168-42a6-85eb-eb8208756e03 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:59.688302 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 403/840] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:49:59 2022] GET /identity/v3/role_assignments?user.id=7bfcddefa71546d28078a38325c723a9&scope.project.id=6910e69702854607889bab124edd60c9&role.id=b5477d3c4e5a4514b64211ec2452d1d8 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:59.688302 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad09fbd-3168-42a6-85eb-eb8208756e03 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:59.745058 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:49:59.764346 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 438/841] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:49:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:49:59.788692 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c51fda-8260-4855-b90d-d0407e152ff5 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:59.842738 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad09fbd-3168-42a6-85eb-eb8208756e03 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:59.906805 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca2354-3fda-4ed3-80f6-bdf99f097eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:49:59.907875 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca2354-3fda-4ed3-80f6-bdf99f097eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:49:59.908178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca2354-3fda-4ed3-80f6-bdf99f097eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:49:59.908463 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca2354-3fda-4ed3-80f6-bdf99f097eb9 None admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:49:59.909450 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca2354-3fda-4ed3-80f6-bdf99f097eb9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:49:59.909787 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca2354-3fda-4ed3-80f6-bdf99f097eb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:49:59.911329 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca2354-3fda-4ed3-80f6-bdf99f097eb9 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:49:59.941979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 404/842] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Aug 2 08:49:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:49:59.942999 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c51fda-8260-4855-b90d-d0407e152ff5 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:49:59.950615 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca2354-3fda-4ed3-80f6-bdf99f097eb9 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:49:59.966560 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:00.002538 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7432c1-42ae-4563-82c1-170df1b606bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:00.005313 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7432c1-42ae-4563-82c1-170df1b606bf None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:00.006053 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7432c1-42ae-4563-82c1-170df1b606bf None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:00.008220 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7432c1-42ae-4563-82c1-170df1b606bf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:00.008220 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7432c1-42ae-4563-82c1-170df1b606bf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:00.009762 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7432c1-42ae-4563-82c1-170df1b606bf None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:00.020476 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-cf7432c1-42ae-4563-82c1-170df1b606bf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 08:50:00.020476 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:00.020476 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:50:00.020476 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:50:00.020476 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:50:00.020476 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:50:00.020476 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:50:00.020476 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:50:00.020476 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 08:50:00.020476 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:00.020476 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:50:00.020476 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:00.020476 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:00.020476 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:00.020476 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:00.020476 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:00.020476 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:00.023788 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:00.023788 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:00.023788 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:00.023788 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:00.023788 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:00.023788 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:00.023788 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:50:00.023788 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:50:00.023788 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:50:00.023788 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:50:00.023788 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:00.023788 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:00.023788 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:00.023788 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:00.023788 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:00.023788 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:00.027432 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:00.027432 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:00.027432 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:00.027432 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:00.027432 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:00.027432 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:00.027432 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:00.027432 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:00.027432 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:00.027432 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:00.027432 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:50:00.027432 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:50:00.027432 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 08:50:00.027432 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:00.027432 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 439/843] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Aug 2 08:49:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:00.031406 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7432c1-42ae-4563-82c1-170df1b606bf None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:00.093586 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:00.100868 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca2354-3fda-4ed3-80f6-bdf99f097eb9 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:00.156453 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf80bc8-86ef-444a-8efb-9255db2658ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:00.157157 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf80bc8-86ef-444a-8efb-9255db2658ce None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:00.157437 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf80bc8-86ef-444a-8efb-9255db2658ce None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:00.157710 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf80bc8-86ef-444a-8efb-9255db2658ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:00.232343 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7432c1-42ae-4563-82c1-170df1b606bf None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:00.244363 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf80bc8-86ef-444a-8efb-9255db2658ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:00.246054 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf80bc8-86ef-444a-8efb-9255db2658ce None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:00.278238 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2312f18-7683-47a5-a0b5-2de5d6729b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:00.278768 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2312f18-7683-47a5-a0b5-2de5d6729b77 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:00.279054 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2312f18-7683-47a5-a0b5-2de5d6729b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:00.279334 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2312f18-7683-47a5-a0b5-2de5d6729b77 None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:00.280583 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2312f18-7683-47a5-a0b5-2de5d6729b77 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:00.280898 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2312f18-7683-47a5-a0b5-2de5d6729b77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:00.282413 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2312f18-7683-47a5-a0b5-2de5d6729b77 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:00.291926 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 440/844] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Aug 2 08:50:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:00.293501 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af0557-7e73-4935-8d97-9ee7901fecae None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:00.293787 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af0557-7e73-4935-8d97-9ee7901fecae None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:00.294062 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af0557-7e73-4935-8d97-9ee7901fecae None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:00.295530 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 441/845] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:50:00.300505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af0557-7e73-4935-8d97-9ee7901fecae None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:00.355700 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:00.421870 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:00.437119 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 405/846] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:49:59 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:50:00.439409 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005c3c0-b658-48db-975d-d873ac2ed18b None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:00.439904 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005c3c0-b658-48db-975d-d873ac2ed18b None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:00.440429 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005c3c0-b658-48db-975d-d873ac2ed18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:00.442577 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af0557-7e73-4935-8d97-9ee7901fecae None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:00.463331 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-b005c3c0-b658-48db-975d-d873ac2ed18b None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:00.464580 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-b005c3c0-b658-48db-975d-d873ac2ed18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:00.489755 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d94a6-733a-4db2-9d62-95c34bdb4de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:00.490412 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d94a6-733a-4db2-9d62-95c34bdb4de3 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:00.490697 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d94a6-733a-4db2-9d62-95c34bdb4de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:00.490989 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d94a6-733a-4db2-9d62-95c34bdb4de3 None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:00.491667 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d94a6-733a-4db2-9d62-95c34bdb4de3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:00.491972 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d94a6-733a-4db2-9d62-95c34bdb4de3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:00.493458 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d94a6-733a-4db2-9d62-95c34bdb4de3 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:00.499316 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 442/847] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Aug 2 08:50:00 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:00.499925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d94a6-733a-4db2-9d62-95c34bdb4de3 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:00.584995 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 406/848] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:50:00.608269 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005c3c0-b658-48db-975d-d873ac2ed18b None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:00.671059 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d94a6-733a-4db2-9d62-95c34bdb4de3 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:00.676293 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:00.726497 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28572bcb-a5e8-4be3-829f-7c823818507e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:00.727213 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28572bcb-a5e8-4be3-829f-7c823818507e None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:00.727990 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28572bcb-a5e8-4be3-829f-7c823818507e None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:00.728308 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28572bcb-a5e8-4be3-829f-7c823818507e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:00.743547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28572bcb-a5e8-4be3-829f-7c823818507e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:00.744729 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28572bcb-a5e8-4be3-829f-7c823818507e None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:00.757545 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005c3c0-b658-48db-975d-d873ac2ed18b None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:00.767509 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-28572bcb-a5e8-4be3-829f-7c823818507e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:50:00.767509 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:00.767509 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:00.767509 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:00.767509 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:00.767509 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:00.767509 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:00.767509 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:00.767509 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:00.767509 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:00.767509 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:00.767509 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:00.767509 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:50:00.767509 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:50:00.767509 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:50:00.769153 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:50:00.769153 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:00.769153 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:00.769153 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:00.769153 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:00.769153 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:00.769153 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:00.769153 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:00.769153 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:00.769153 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:00.769153 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:00.769153 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:00.769153 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:00.769153 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:00.769153 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:00.769153 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:00.769153 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:00.770211 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:50:00.770211 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:50:00.770211 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:50:00.770211 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:00.774390 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 443/849] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:50:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:00.776211 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28572bcb-a5e8-4be3-829f-7c823818507e None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:00.788543 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:00.798573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed75d2-18c7-4b57-a0e0-bc4572627989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:00.799258 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed75d2-18c7-4b57-a0e0-bc4572627989 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:00.799541 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed75d2-18c7-4b57-a0e0-bc4572627989 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:00.803966 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed75d2-18c7-4b57-a0e0-bc4572627989 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:00.813675 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed75d2-18c7-4b57-a0e0-bc4572627989 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:50:00.820125 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-13ed75d2-18c7-4b57-a0e0-bc4572627989 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:50:00.820125 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:00.820125 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:00.820125 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:00.820125 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:00.820125 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:00.820125 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:00.820125 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:00.820125 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:00.820125 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:00.820125 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:00.820125 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:00.820125 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:50:00.820125 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:50:00.820125 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:50:00.820125 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:50:00.821426 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:50:00.821426 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:50:00.821426 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:50:00.821426 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:50:00.821426 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:00.821426 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:00.821426 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:00.821426 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:00.821426 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:00.821426 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:00.821426 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:00.821426 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:00.821426 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:00.821426 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:00.821426 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:00.821426 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:00.823239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:00.823239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:00.823239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:00.823239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:00.823239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:50:00.823239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:50:00.823239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:50:00.823239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:50:00.823239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:50:00.823239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:50:00.823239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:50:00.823239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:00.823239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 407/850] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:50:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:50:00.827854 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed75d2-18c7-4b57-a0e0-bc4572627989 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:00.967038 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28572bcb-a5e8-4be3-829f-7c823818507e None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:00.977306 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed75d2-18c7-4b57-a0e0-bc4572627989 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:01.012302 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6310f-3489-45a7-9750-b126a22436ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:01.013518 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6310f-3489-45a7-9750-b126a22436ad None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:01.014013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6310f-3489-45a7-9750-b126a22436ad None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:01.014754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6310f-3489-45a7-9750-b126a22436ad None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:01.016148 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb6310f-3489-45a7-9750-b126a22436ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:01.016688 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb6310f-3489-45a7-9750-b126a22436ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:01.018823 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb6310f-3489-45a7-9750-b126a22436ad None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:01.032741 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f9b0e-e353-4cba-9432-d2932998fffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:01.034074 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f9b0e-e353-4cba-9432-d2932998fffc None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:01.034695 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f9b0e-e353-4cba-9432-d2932998fffc None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:01.035184 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f9b0e-e353-4cba-9432-d2932998fffc None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:01.036394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 444/851] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:01.036708 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f9b0e-e353-4cba-9432-d2932998fffc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:01.037904 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f9b0e-e353-4cba-9432-d2932998fffc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:01.044467 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f9b0e-e353-4cba-9432-d2932998fffc None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:01.044830 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6310f-3489-45a7-9750-b126a22436ad None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:01.065281 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 408/852] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:50:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:01.071466 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f9b0e-e353-4cba-9432-d2932998fffc None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:01.077165 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:01.153068 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:01.205766 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6310f-3489-45a7-9750-b126a22436ad None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:01.215303 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f9b0e-e353-4cba-9432-d2932998fffc None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:01.246188 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3640c-46a0-4c04-89b1-bf873038adff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:01.247175 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3640c-46a0-4c04-89b1-bf873038adff None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:01.247688 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3640c-46a0-4c04-89b1-bf873038adff None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:01.248151 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3640c-46a0-4c04-89b1-bf873038adff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:01.257230 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22003a-9430-4e82-bf99-398d095dfe01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:01.258004 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22003a-9430-4e82-bf99-398d095dfe01 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:01.258355 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22003a-9430-4e82-bf99-398d095dfe01 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:01.258716 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22003a-9430-4e82-bf99-398d095dfe01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:01.259337 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe3640c-46a0-4c04-89b1-bf873038adff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:01.261630 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe3640c-46a0-4c04-89b1-bf873038adff None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:01.272554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22003a-9430-4e82-bf99-398d095dfe01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:01.274143 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22003a-9430-4e82-bf99-398d095dfe01 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:01.278281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-cbe3640c-46a0-4c04-89b1-bf873038adff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:50:01.278281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:01.278281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:01.278281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:01.278281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:01.278281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:01.278281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:01.278281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:01.278281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:01.278281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:01.278281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:01.278281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:01.278281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:50:01.278281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:50:01.278281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:50:01.279193 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:50:01.279193 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:01.279193 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:01.279193 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:01.279193 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:01.279193 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:01.279193 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:01.279193 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:01.279193 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:01.279193 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:01.279193 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:01.279193 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:01.279193 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:01.279193 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:01.279193 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:01.279193 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:01.279193 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:01.280079 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:50:01.280079 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:50:01.280079 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:50:01.280079 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:50:01.280079 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:50:01.280079 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:50:01.280079 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:50:01.280079 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:01.282782 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 445/853] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:50:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:01.292991 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3640c-46a0-4c04-89b1-bf873038adff None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:01.298728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-cd22003a-9430-4e82-bf99-398d095dfe01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:50:01.298728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:01.298728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:01.298728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:01.298728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:01.298728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:01.298728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:01.298728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:01.298728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:01.298728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:01.298728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:01.298728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:01.298728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:50:01.298728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:50:01.298728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:50:01.299736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:50:01.299736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:01.299736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:01.299736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:01.299736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:01.299736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:01.299736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:01.299736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:01.299736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:01.299736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:01.299736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:01.299736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:01.299736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:01.299736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:01.299736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:01.299736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:01.299736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:01.300702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:50:01.300702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:50:01.300702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:50:01.300702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:01.304462 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 409/854] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:50:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:50:01.308380 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22003a-9430-4e82-bf99-398d095dfe01 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:01.408396 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:01.438316 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3640c-46a0-4c04-89b1-bf873038adff None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:01.473352 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22003a-9430-4e82-bf99-398d095dfe01 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:01.480690 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:01.485893 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db6ee4-9b87-42b2-b76c-9253793d322b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:01.486551 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db6ee4-9b87-42b2-b76c-9253793d322b None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:01.486837 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db6ee4-9b87-42b2-b76c-9253793d322b None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:01.487120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db6ee4-9b87-42b2-b76c-9253793d322b None admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:01.487909 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db6ee4-9b87-42b2-b76c-9253793d322b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:01.488224 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db6ee4-9b87-42b2-b76c-9253793d322b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:01.489950 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db6ee4-9b87-42b2-b76c-9253793d322b None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:01.511209 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 446/855] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:50:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:01.512881 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db6ee4-9b87-42b2-b76c-9253793d322b None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:01.534223 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5906c4-7747-4c64-bbc8-08ff28dcae7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:01.535280 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5906c4-7747-4c64-bbc8-08ff28dcae7f None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:01.535902 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5906c4-7747-4c64-bbc8-08ff28dcae7f None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:01.536473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5906c4-7747-4c64-bbc8-08ff28dcae7f None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:01.538138 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5906c4-7747-4c64-bbc8-08ff28dcae7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:01.539011 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5906c4-7747-4c64-bbc8-08ff28dcae7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:01.540905 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5906c4-7747-4c64-bbc8-08ff28dcae7f None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:01.555525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 410/856] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:01.562524 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5906c4-7747-4c64-bbc8-08ff28dcae7f None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:01.670213 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db6ee4-9b87-42b2-b76c-9253793d322b None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:01.727078 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b56200-5ac0-4cba-a9a1-fdc1ec6bea74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:01.729312 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b56200-5ac0-4cba-a9a1-fdc1ec6bea74 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:01.729886 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b56200-5ac0-4cba-a9a1-fdc1ec6bea74 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:01.730539 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b56200-5ac0-4cba-a9a1-fdc1ec6bea74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:01.732082 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b56200-5ac0-4cba-a9a1-fdc1ec6bea74 None admin] RBAC: Adding query filter params (role.id=bc21bdc3d9dd4091a04f1e2fef77a8c3, scope.project.id=6910e69702854607889bab124edd60c9, user.id=eb640d92cb9b49019f42351a60efe258) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:01.733103 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b56200-5ac0-4cba-a9a1-fdc1ec6bea74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:01.734952 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b56200-5ac0-4cba-a9a1-fdc1ec6bea74 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:01.735225 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5906c4-7747-4c64-bbc8-08ff28dcae7f None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:01.740550 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:01.746579 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 447/857] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:50:01 2022] GET /identity/v3/role_assignments?user.id=eb640d92cb9b49019f42351a60efe258&scope.project.id=6910e69702854607889bab124edd60c9&role.id=bc21bdc3d9dd4091a04f1e2fef77a8c3 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:01.785781 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46bc42-c830-4260-9cec-91d493349ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:01.787098 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46bc42-c830-4260-9cec-91d493349ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:01.788313 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46bc42-c830-4260-9cec-91d493349ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:01.788872 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46bc42-c830-4260-9cec-91d493349ab4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:01.798887 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46bc42-c830-4260-9cec-91d493349ab4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:01.800868 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46bc42-c830-4260-9cec-91d493349ab4 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:01.817743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-ba46bc42-c830-4260-9cec-91d493349ab4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:50:01.817743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:01.817743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:01.817743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:01.817743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:01.817743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:01.817743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:01.817743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:01.817743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:01.817743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:01.817743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:01.817743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:01.817743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:50:01.817743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:50:01.817743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:50:01.817743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:50:01.819447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:01.819447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:01.819447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:50:01.819447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:50:01.819447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:50:01.819447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:50:01.819447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:01.819447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:01.819447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:01.819447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:01.819447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:01.819447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:01.819447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:01.819447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:01.819447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:01.819447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:01.819447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:01.819447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:01.820583 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:01.820583 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:01.820583 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:50:01.820583 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:50:01.820583 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:50:01.820583 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:50:01.820583 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:50:01.820583 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:50:01.820583 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:50:01.820583 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:01.823893 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 411/858] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:50:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:01.829827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b56200-5ac0-4cba-a9a1-fdc1ec6bea74 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:01.982801 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b56200-5ac0-4cba-a9a1-fdc1ec6bea74 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:02.028921 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5a981-6008-4bcf-a3e4-892257141014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:02.029745 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5a981-6008-4bcf-a3e4-892257141014 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:02.030030 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5a981-6008-4bcf-a3e4-892257141014 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:02.030308 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5a981-6008-4bcf-a3e4-892257141014 None admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:02.031422 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd5a981-6008-4bcf-a3e4-892257141014 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:02.031977 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd5a981-6008-4bcf-a3e4-892257141014 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:02.033690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd5a981-6008-4bcf-a3e4-892257141014 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:02.057721 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 448/859] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Aug 2 08:50:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:02.063420 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46bc42-c830-4260-9cec-91d493349ab4 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:02.080371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee8f72-d9b6-4e3d-b7be-b9c35c814fc0 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:02.080680 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee8f72-d9b6-4e3d-b7be-b9c35c814fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:02.080982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee8f72-d9b6-4e3d-b7be-b9c35c814fc0 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:02.082906 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 449/860] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:02 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:50:02.090253 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccff91e-3a6d-460e-9e51-db580a7de986 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:02.090614 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccff91e-3a6d-460e-9e51-db580a7de986 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:02.090814 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccff91e-3a6d-460e-9e51-db580a7de986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:02.106344 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:02.114114 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-cccff91e-3a6d-460e-9e51-db580a7de986 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:02.116446 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-cccff91e-3a6d-460e-9e51-db580a7de986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:02.193046 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:02.211424 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 450/861] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:50:02.225657 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46bc42-c830-4260-9cec-91d493349ab4 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:02.235184 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccff91e-3a6d-460e-9e51-db580a7de986 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:02.290671 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e82f98-4c96-4163-9f81-180d4218785e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:02.291390 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e82f98-4c96-4163-9f81-180d4218785e None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:02.291799 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e82f98-4c96-4163-9f81-180d4218785e None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:02.292105 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e82f98-4c96-4163-9f81-180d4218785e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:02.396224 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccff91e-3a6d-460e-9e51-db580a7de986 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:02.423923 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e82f98-4c96-4163-9f81-180d4218785e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:02.426809 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e82f98-4c96-4163-9f81-180d4218785e None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:02.451541 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a73950-5ae6-495c-a4e4-0304f9b4a598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:02.452609 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a73950-5ae6-495c-a4e4-0304f9b4a598 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:02.453085 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a73950-5ae6-495c-a4e4-0304f9b4a598 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:02.453530 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a73950-5ae6-495c-a4e4-0304f9b4a598 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:02.454741 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a73950-5ae6-495c-a4e4-0304f9b4a598 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:02.457217 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a73950-5ae6-495c-a4e4-0304f9b4a598 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:02.465342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:02.477748 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-c1a73950-5ae6-495c-a4e4-0304f9b4a598 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 08:50:02.477748 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:02.477748 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:50:02.477748 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:50:02.477748 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:50:02.477748 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:50:02.477748 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:50:02.477748 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:50:02.477748 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 08:50:02.477748 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:02.477748 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:50:02.477748 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:02.477748 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:02.477748 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:02.477748 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:02.477748 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:02.487009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:02.487009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:02.487009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:02.487009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:02.487009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:02.487009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:02.487009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:02.487009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:50:02.487009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:50:02.487009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:50:02.487009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:50:02.487009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:02.487009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:02.487009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:02.487009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:02.487009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:02.487887 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:02.487887 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:02.487887 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:02.487887 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:02.487887 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:02.487887 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:02.487887 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:02.487887 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:02.487887 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:02.487887 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:02.487887 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:02.487887 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:50:02.487887 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:50:02.487887 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 08:50:02.487887 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:02.487887 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 451/862] 10.222.0.20 () {56 vars in 1132 bytes} [Tue Aug 2 08:50:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:50:02.490208 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a73950-5ae6-495c-a4e4-0304f9b4a598 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:02.568466 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:02.586667 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 412/863] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:50:02 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:50:02.594513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e82f98-4c96-4163-9f81-180d4218785e None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:02.633804 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a73950-5ae6-495c-a4e4-0304f9b4a598 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:02.682132 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf34bb3-cc3b-4008-9278-77e4505456df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:02.682839 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf34bb3-cc3b-4008-9278-77e4505456df None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:02.683221 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf34bb3-cc3b-4008-9278-77e4505456df None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:02.684025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf34bb3-cc3b-4008-9278-77e4505456df None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:02.685174 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf34bb3-cc3b-4008-9278-77e4505456df None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:02.685605 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf34bb3-cc3b-4008-9278-77e4505456df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:02.687104 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf34bb3-cc3b-4008-9278-77e4505456df None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:02.695560 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 452/864] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Aug 2 08:50:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:02.701104 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf34bb3-cc3b-4008-9278-77e4505456df None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:02.740757 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e82f98-4c96-4163-9f81-180d4218785e None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:02.782526 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:02.800240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985a377-914d-4070-b3d0-1e3108473216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:02.801003 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985a377-914d-4070-b3d0-1e3108473216 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:02.801281 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985a377-914d-4070-b3d0-1e3108473216 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:02.801757 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985a377-914d-4070-b3d0-1e3108473216 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:02.821168 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985a377-914d-4070-b3d0-1e3108473216 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:02.823030 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985a377-914d-4070-b3d0-1e3108473216 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:02.830409 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf34bb3-cc3b-4008-9278-77e4505456df None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:02.846880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-b985a377-914d-4070-b3d0-1e3108473216 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:50:02.846880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:02.846880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:02.846880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:02.846880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:02.846880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:02.846880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:02.846880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:02.846880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:02.846880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:02.846880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:02.846880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:02.846880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:50:02.846880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:50:02.846880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:50:02.847929 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:50:02.847929 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:02.847929 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:02.847929 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:02.847929 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:02.847929 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:02.847929 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:02.847929 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:02.847929 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:02.847929 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:02.847929 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:02.847929 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:02.847929 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:02.847929 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:02.847929 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:02.847929 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:02.847929 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:02.848896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:50:02.848896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:50:02.848896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:50:02.848896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:02.852084 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 413/865] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:50:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:02.859141 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:02.860845 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985a377-914d-4070-b3d0-1e3108473216 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:02.904511 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda9e3c-6163-42e2-a851-241fdb10add1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:02.905561 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda9e3c-6163-42e2-a851-241fdb10add1 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:02.906060 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda9e3c-6163-42e2-a851-241fdb10add1 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:02.906553 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda9e3c-6163-42e2-a851-241fdb10add1 None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:02.907469 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda9e3c-6163-42e2-a851-241fdb10add1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:02.908024 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda9e3c-6163-42e2-a851-241fdb10add1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:02.909811 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda9e3c-6163-42e2-a851-241fdb10add1 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:02.916696 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 453/866] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Aug 2 08:50:02 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:03.015275 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985a377-914d-4070-b3d0-1e3108473216 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:03.065649 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0a764-a728-400f-b181-35792ae0d781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:03.066813 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0a764-a728-400f-b181-35792ae0d781 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:03.067353 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0a764-a728-400f-b181-35792ae0d781 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:03.067842 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0a764-a728-400f-b181-35792ae0d781 None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:03.069590 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0a764-a728-400f-b181-35792ae0d781 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:03.070180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0a764-a728-400f-b181-35792ae0d781 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:03.072340 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0a764-a728-400f-b181-35792ae0d781 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:03.077710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bbd75-2776-4c68-a74a-520b585a1139 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:03.078588 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bbd75-2776-4c68-a74a-520b585a1139 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:03.079365 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bbd75-2776-4c68-a74a-520b585a1139 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:03.082295 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 454/867] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:50:03.092513 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93b093-ad3e-4d60-9eb7-a0ca938f5597 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:03.093205 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93b093-ad3e-4d60-9eb7-a0ca938f5597 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:03.093707 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93b093-ad3e-4d60-9eb7-a0ca938f5597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:03.098830 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 414/868] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:03.103347 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0a764-a728-400f-b181-35792ae0d781 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:03.121077 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-8f93b093-ad3e-4d60-9eb7-a0ca938f5597 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:03.122450 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-8f93b093-ad3e-4d60-9eb7-a0ca938f5597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:03.159286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:03.231046 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 455/869] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:50:03.249236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93b093-ad3e-4d60-9eb7-a0ca938f5597 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:03.269831 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0a764-a728-400f-b181-35792ae0d781 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:03.330435 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb2da1-943d-459f-8deb-339e4e875899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:03.331106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb2da1-943d-459f-8deb-339e4e875899 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:03.331381 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb2da1-943d-459f-8deb-339e4e875899 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:03.331664 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb2da1-943d-459f-8deb-339e4e875899 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:03.339700 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb2da1-943d-459f-8deb-339e4e875899 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:03.341281 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb2da1-943d-459f-8deb-339e4e875899 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:03.358050 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-55fb2da1-943d-459f-8deb-339e4e875899 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:50:03.358050 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:03.358050 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:03.358050 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:03.358050 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:03.358050 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:03.358050 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:03.358050 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:03.358050 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:03.358050 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:03.358050 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:03.358050 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:03.358050 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:50:03.358050 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:50:03.358050 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:50:03.359039 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:50:03.359039 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:03.359039 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:03.359039 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:03.359039 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:03.359039 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:03.359039 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:03.359039 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:03.359039 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:03.359039 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:03.359039 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:03.359039 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:03.359039 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:03.359039 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:03.359039 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:03.359039 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:03.359039 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:03.360189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:50:03.360189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:50:03.360189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:50:03.360189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:50:03.360189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:50:03.360189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:50:03.360189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:50:03.360189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:03.360189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 415/870] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:50:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:03.369154 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb2da1-943d-459f-8deb-339e4e875899 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:03.420605 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93b093-ad3e-4d60-9eb7-a0ca938f5597 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:03.442683 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:03.483006 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc08e4-897c-42fa-8ef9-17b3d7d4e769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:03.484080 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc08e4-897c-42fa-8ef9-17b3d7d4e769 None admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:03.484658 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc08e4-897c-42fa-8ef9-17b3d7d4e769 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:03.485154 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc08e4-897c-42fa-8ef9-17b3d7d4e769 None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:03.486478 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc08e4-897c-42fa-8ef9-17b3d7d4e769 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:03.488328 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc08e4-897c-42fa-8ef9-17b3d7d4e769 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:03.542134 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:03.555345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb2da1-943d-459f-8deb-339e4e875899 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:03.605383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 456/871] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Aug 2 08:50:03 2022] POST /identity/v3/services => generated 251 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:50:03.624767 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fb576-1b15-4f79-9f60-b31d8d16cc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:03.631461 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fb576-1b15-4f79-9f60-b31d8d16cc44 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:03.631461 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fb576-1b15-4f79-9f60-b31d8d16cc44 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:03.631461 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fb576-1b15-4f79-9f60-b31d8d16cc44 None admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:03.631461 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fb576-1b15-4f79-9f60-b31d8d16cc44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:03.631461 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fb576-1b15-4f79-9f60-b31d8d16cc44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:03.633097 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fb576-1b15-4f79-9f60-b31d8d16cc44 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:03.650930 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 416/872] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:50:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:03.657338 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc08e4-897c-42fa-8ef9-17b3d7d4e769 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:03.787994 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc08e4-897c-42fa-8ef9-17b3d7d4e769 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:03.827570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d92af-bb60-4764-bd61-e387d0a642ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:03.828784 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d92af-bb60-4764-bd61-e387d0a642ae None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:03.829317 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d92af-bb60-4764-bd61-e387d0a642ae None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:03.829809 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d92af-bb60-4764-bd61-e387d0a642ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:03.830891 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d92af-bb60-4764-bd61-e387d0a642ae None admin] RBAC: Adding query filter params (role.id=b5477d3c4e5a4514b64211ec2452d1d8, scope.project.id=6910e69702854607889bab124edd60c9, user.id=58f8e572550b4ab5955d7a94f1563441) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:03.832031 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d92af-bb60-4764-bd61-e387d0a642ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:03.834401 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d92af-bb60-4764-bd61-e387d0a642ae None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:03.842624 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 457/873] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:50:03 2022] GET /identity/v3/role_assignments?user.id=58f8e572550b4ab5955d7a94f1563441&scope.project.id=6910e69702854607889bab124edd60c9&role.id=b5477d3c4e5a4514b64211ec2452d1d8 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:04.231494 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547d0ba-87b7-4ece-8275-a291ca9adfc3 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:04.231962 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547d0ba-87b7-4ece-8275-a291ca9adfc3 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:04.232444 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547d0ba-87b7-4ece-8275-a291ca9adfc3 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:04.235178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 417/874] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:50:04.244376 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cfb04-71e4-4448-956a-23fcbd2b1310 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:04.244812 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cfb04-71e4-4448-956a-23fcbd2b1310 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:04.245235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cfb04-71e4-4448-956a-23fcbd2b1310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:04.274166 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-528cfb04-71e4-4448-956a-23fcbd2b1310 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:04.274796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-528cfb04-71e4-4448-956a-23fcbd2b1310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:04.323122 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:04.364193 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 458/875] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:04 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:50:04.389461 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547d0ba-87b7-4ece-8275-a291ca9adfc3 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:04.525400 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547d0ba-87b7-4ece-8275-a291ca9adfc3 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:04.564859 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3b6c2-8765-4e17-91aa-20e5469c8871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:04.565912 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3b6c2-8765-4e17-91aa-20e5469c8871 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:04.566400 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3b6c2-8765-4e17-91aa-20e5469c8871 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:04.566880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3b6c2-8765-4e17-91aa-20e5469c8871 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:04.579518 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e3b6c2-8765-4e17-91aa-20e5469c8871 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:50:04.587438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-86e3b6c2-8765-4e17-91aa-20e5469c8871 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:50:04.587438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:04.587438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:04.587438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:04.587438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:04.587438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:04.587438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:04.587438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:04.587438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:04.587438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:04.587438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:04.587438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:04.587438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:50:04.587438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:50:04.587438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:50:04.587438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:50:04.589289 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:50:04.589289 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:50:04.589289 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:50:04.589289 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:50:04.589289 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:04.589289 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:04.589289 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:04.589289 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:04.589289 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:04.589289 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:04.589289 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:04.589289 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:04.589289 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:04.589289 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:04.589289 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:04.589289 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:04.590889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:04.590889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:04.590889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:04.590889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:04.590889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:50:04.590889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:50:04.590889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:50:04.590889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:50:04.590889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:50:04.590889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:50:04.590889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:50:04.590889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:04.594705 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 418/876] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Aug 2 08:50:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:04.604749 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528cfb04-71e4-4448-956a-23fcbd2b1310 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:04.779335 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528cfb04-71e4-4448-956a-23fcbd2b1310 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:04.838751 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bbc10-94a1-482e-8b95-694dda80a0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:04.839793 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bbc10-94a1-482e-8b95-694dda80a0e0 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:04.840338 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bbc10-94a1-482e-8b95-694dda80a0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:04.840833 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bbc10-94a1-482e-8b95-694dda80a0e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:04.842135 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791bbc10-94a1-482e-8b95-694dda80a0e0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:04.842674 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791bbc10-94a1-482e-8b95-694dda80a0e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:04.845299 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791bbc10-94a1-482e-8b95-694dda80a0e0 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:04.860506 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 459/877] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Aug 2 08:50:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:04.867007 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3b6c2-8765-4e17-91aa-20e5469c8871 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:04.883594 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:04.985162 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3b6c2-8765-4e17-91aa-20e5469c8871 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:05.024405 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04457ca6-0e8d-44af-84f9-57465fd6e725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:05.025062 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04457ca6-0e8d-44af-84f9-57465fd6e725 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:05.025346 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04457ca6-0e8d-44af-84f9-57465fd6e725 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:05.025621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04457ca6-0e8d-44af-84f9-57465fd6e725 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:05.037509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04457ca6-0e8d-44af-84f9-57465fd6e725 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:05.038913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04457ca6-0e8d-44af-84f9-57465fd6e725 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:05.057501 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-04457ca6-0e8d-44af-84f9-57465fd6e725 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:50:05.057501 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:05.057501 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:05.057501 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:05.057501 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:05.057501 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:05.057501 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:05.057501 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:05.057501 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:05.057501 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:05.057501 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:05.057501 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:05.057501 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:50:05.057501 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:50:05.057501 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:50:05.058465 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:50:05.058465 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:05.058465 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:05.058465 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:05.058465 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:05.058465 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:05.058465 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:05.058465 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:05.058465 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:05.058465 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:05.058465 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:05.058465 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:05.058465 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:05.058465 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:05.058465 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:05.058465 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:05.058465 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:05.059349 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:50:05.059349 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:50:05.059349 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:50:05.059349 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:05.063858 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 419/878] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:50:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:05.065353 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bbc10-94a1-482e-8b95-694dda80a0e0 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:05.132136 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:05.146366 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6e85c-651e-44c4-bfd6-63a211779590 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:05.151613 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6e85c-651e-44c4-bfd6-63a211779590 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:05.151613 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6e85c-651e-44c4-bfd6-63a211779590 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:05.151613 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 420/879] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:50:05.153681 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da927e-4669-45fe-8e99-dad166ae7817 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:05.153971 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da927e-4669-45fe-8e99-dad166ae7817 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:05.154249 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da927e-4669-45fe-8e99-dad166ae7817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:05.175002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-a9da927e-4669-45fe-8e99-dad166ae7817 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:05.176356 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-a9da927e-4669-45fe-8e99-dad166ae7817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:05.236200 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bbc10-94a1-482e-8b95-694dda80a0e0 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:05.271798 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:05.293720 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68514df6-770a-403b-aca2-30534d4878db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:05.293720 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68514df6-770a-403b-aca2-30534d4878db None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:05.293720 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68514df6-770a-403b-aca2-30534d4878db None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:05.293720 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68514df6-770a-403b-aca2-30534d4878db None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:05.294128 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68514df6-770a-403b-aca2-30534d4878db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:05.294128 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68514df6-770a-403b-aca2-30534d4878db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:05.295077 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68514df6-770a-403b-aca2-30534d4878db None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:05.302847 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 421/880] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:05 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:50:05.324649 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da927e-4669-45fe-8e99-dad166ae7817 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:05.324834 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 460/881] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:05.326321 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68514df6-770a-403b-aca2-30534d4878db None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:05.472685 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:05.490670 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68514df6-770a-403b-aca2-30534d4878db None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:05.513582 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da927e-4669-45fe-8e99-dad166ae7817 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:05.556789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91373cd-ee6a-43fb-9898-25aaca69f8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:05.557388 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91373cd-ee6a-43fb-9898-25aaca69f8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:05.557674 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91373cd-ee6a-43fb-9898-25aaca69f8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:05.557953 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91373cd-ee6a-43fb-9898-25aaca69f8c6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:05.578417 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91373cd-ee6a-43fb-9898-25aaca69f8c6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:05.586578 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91373cd-ee6a-43fb-9898-25aaca69f8c6 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:05.603054 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510dadc-5139-4600-8203-d2acc810b4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:05.604869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-a91373cd-ee6a-43fb-9898-25aaca69f8c6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:50:05.604869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:05.604869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:05.604869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:05.604869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:05.604869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:05.604869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:05.604869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:05.604869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:05.604869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:05.604869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:05.604869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:05.604869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:50:05.604869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:50:05.604869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:50:05.604869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:50:05.605816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:05.605816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:05.605816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:50:05.605816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:50:05.605816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:50:05.605816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:50:05.605816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:05.605816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:05.605816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:05.605816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:05.605816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:05.605816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:05.605816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:05.605816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:05.605816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:05.605816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:05.605816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:05.605816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:05.606786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:05.606786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:05.606786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:50:05.606786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:50:05.606786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:50:05.606786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:50:05.606786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:50:05.606786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:50:05.606786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:50:05.606786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:05.609681 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510dadc-5139-4600-8203-d2acc810b4cc None admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:05.610319 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510dadc-5139-4600-8203-d2acc810b4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:05.610980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510dadc-5139-4600-8203-d2acc810b4cc None admin] PATH_INFO: `/v3/services` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:05.611113 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 461/882] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Aug 2 08:50:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:50:05.612457 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91373cd-ee6a-43fb-9898-25aaca69f8c6 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:05.613968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510dadc-5139-4600-8203-d2acc810b4cc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:05.621164 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510dadc-5139-4600-8203-d2acc810b4cc None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:05.733327 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91373cd-ee6a-43fb-9898-25aaca69f8c6 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:05.744366 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 422/883] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Aug 2 08:50:05 2022] POST /identity/v3/services => generated 269 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:50:05.798672 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e2bbe-4493-43de-b5fd-21bd198df333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:05.799613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e2bbe-4493-43de-b5fd-21bd198df333 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:05.800114 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e2bbe-4493-43de-b5fd-21bd198df333 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:05.800624 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e2bbe-4493-43de-b5fd-21bd198df333 None admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:05.801740 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e2bbe-4493-43de-b5fd-21bd198df333 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:05.802222 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e2bbe-4493-43de-b5fd-21bd198df333 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:05.804581 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e2bbe-4493-43de-b5fd-21bd198df333 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:05.822513 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:05.831381 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 462/884] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Aug 2 08:50:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:05.838096 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510dadc-5139-4600-8203-d2acc810b4cc None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:05.902575 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:05.961415 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510dadc-5139-4600-8203-d2acc810b4cc None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:06.003724 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd0052-9eb7-4363-90ee-fefa28a3bae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:06.004805 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd0052-9eb7-4363-90ee-fefa28a3bae8 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:06.005220 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc8d4a-6896-4774-98af-1517d96f9660 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:06.006419 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd0052-9eb7-4363-90ee-fefa28a3bae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:06.006503 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc8d4a-6896-4774-98af-1517d96f9660 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:06.006574 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd0052-9eb7-4363-90ee-fefa28a3bae8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:06.006651 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc8d4a-6896-4774-98af-1517d96f9660 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:06.007830 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 463/885] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:50:06.013508 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cbd8e-8fe2-4377-b191-817ed50a9d27 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:06.013787 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cbd8e-8fe2-4377-b191-817ed50a9d27 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:06.014053 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cbd8e-8fe2-4377-b191-817ed50a9d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:06.045616 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-982cbd8e-8fe2-4377-b191-817ed50a9d27 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:06.046839 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-982cbd8e-8fe2-4377-b191-817ed50a9d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:06.086491 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd0052-9eb7-4363-90ee-fefa28a3bae8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:06.088443 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd0052-9eb7-4363-90ee-fefa28a3bae8 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:06.124686 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 464/886] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:06 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:50:06.126545 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e866474-3f7a-455b-a9b6-6979be89d39d None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:06.126830 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e866474-3f7a-455b-a9b6-6979be89d39d None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:06.127111 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e866474-3f7a-455b-a9b6-6979be89d39d None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:06.133261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 465/887] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:50:06.135028 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00718d-4e28-4fae-a8a5-47d8bbe5f122 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:06.135028 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00718d-4e28-4fae-a8a5-47d8bbe5f122 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:06.135247 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00718d-4e28-4fae-a8a5-47d8bbe5f122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:06.155366 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-fd00718d-4e28-4fae-a8a5-47d8bbe5f122 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:06.157054 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-fd00718d-4e28-4fae-a8a5-47d8bbe5f122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:06.157294 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:06.215332 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 423/888] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:50:05 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:50:06.216596 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd0052-9eb7-4363-90ee-fefa28a3bae8 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:06.242329 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 466/889] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:06 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:50:06.243802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00718d-4e28-4fae-a8a5-47d8bbe5f122 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:06.363041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:06.363448 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd0052-9eb7-4363-90ee-fefa28a3bae8 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:06.392875 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7a2b4-9304-4f10-8527-a629e8668a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:06.393801 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7a2b4-9304-4f10-8527-a629e8668a3f None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:06.394091 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7a2b4-9304-4f10-8527-a629e8668a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:06.394359 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7a2b4-9304-4f10-8527-a629e8668a3f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:06.395009 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7a2b4-9304-4f10-8527-a629e8668a3f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:06.397286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7a2b4-9304-4f10-8527-a629e8668a3f None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:06.401996 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00718d-4e28-4fae-a8a5-47d8bbe5f122 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:06.408746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-e8a7a2b4-9304-4f10-8527-a629e8668a3f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 08:50:06.408746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:06.408746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:50:06.408746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:50:06.408746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:50:06.408746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:50:06.408746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:50:06.408746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:50:06.408746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 08:50:06.408746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:06.408746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:50:06.408746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:06.408746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:06.408746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:06.408746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:06.408746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:06.408746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:06.410202 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:06.410202 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:06.410202 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:06.410202 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:06.410202 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:06.410202 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:06.410202 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:50:06.410202 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:50:06.410202 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:50:06.410202 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:50:06.410202 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:06.410202 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:06.410202 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:06.410202 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:06.410202 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:06.410202 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:06.413160 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:06.413160 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:06.413160 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:06.413160 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:06.413160 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:06.413160 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:06.413160 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:06.413160 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:06.413160 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:06.413160 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:06.413160 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:50:06.413160 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:50:06.413160 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 08:50:06.413160 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:06.415821 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 424/890] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Aug 2 08:50:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:06.417522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7a2b4-9304-4f10-8527-a629e8668a3f None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:06.442211 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:06.457127 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccbf1ac-cc88-40bd-bbd1-a59f9d3b20cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:06.458626 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbf1ac-cc88-40bd-bbd1-a59f9d3b20cf None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:06.460689 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbf1ac-cc88-40bd-bbd1-a59f9d3b20cf None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:06.460689 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbf1ac-cc88-40bd-bbd1-a59f9d3b20cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:06.478419 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccbf1ac-cc88-40bd-bbd1-a59f9d3b20cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:06.480975 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccbf1ac-cc88-40bd-bbd1-a59f9d3b20cf None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:06.499421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-0ccbf1ac-cc88-40bd-bbd1-a59f9d3b20cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:50:06.499421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:06.499421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:06.499421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:06.499421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:06.499421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:06.499421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:06.499421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:06.499421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:06.499421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:06.499421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:06.499421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:06.499421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:50:06.499421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:50:06.499421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:50:06.500846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:50:06.500846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:06.500846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:06.500846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:06.500846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:06.500846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:06.500846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:06.500846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:06.500846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:06.500846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:06.500846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:06.500846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:06.500846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:06.500846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:06.500846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:06.500846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:06.500846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:06.502395 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:50:06.502395 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:50:06.502395 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:50:06.502395 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:06.506655 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 467/891] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:50:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:06.507699 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccbf1ac-cc88-40bd-bbd1-a59f9d3b20cf None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:06.548268 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7a2b4-9304-4f10-8527-a629e8668a3f None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:06.605146 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381cbf45-581b-419a-9961-72e0f7bf73e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:06.605735 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cbf45-581b-419a-9961-72e0f7bf73e8 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:06.606018 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cbf45-581b-419a-9961-72e0f7bf73e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:06.606292 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cbf45-581b-419a-9961-72e0f7bf73e8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:06.606930 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381cbf45-581b-419a-9961-72e0f7bf73e8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:06.608349 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381cbf45-581b-419a-9961-72e0f7bf73e8 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:06.620880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-381cbf45-581b-419a-9961-72e0f7bf73e8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:50:06.620880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:06.620880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:50:06.620880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:50:06.620880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:50:06.620880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:50:06.620880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:50:06.620880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:50:06.620880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:50:06.620880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:06.620880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:50:06.620880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:06.620880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:06.620880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:06.620880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:06.620880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:06.620880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:06.622081 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:06.622081 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:06.622081 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:06.622081 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:06.622081 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:06.622081 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:06.622081 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:50:06.622081 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:50:06.622081 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:50:06.622081 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:50:06.622081 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:06.622081 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:06.622081 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:06.622081 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:06.622081 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:06.622081 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:06.623273 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:06.623273 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:06.623273 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:06.623273 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:06.623273 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:06.623273 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:06.623273 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:06.623273 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:06.623273 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:06.623273 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:06.623273 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:50:06.623273 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:50:06.623273 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:50:06.623273 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:06.623273 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 425/892] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Aug 2 08:50:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:06.624471 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381cbf45-581b-419a-9961-72e0f7bf73e8 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:06.667911 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccbf1ac-cc88-40bd-bbd1-a59f9d3b20cf None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:06.687590 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:06.712626 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb450e6-1500-4fef-925d-cf4a06819912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:06.713803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb450e6-1500-4fef-925d-cf4a06819912 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:06.714112 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb450e6-1500-4fef-925d-cf4a06819912 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:06.714399 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb450e6-1500-4fef-925d-cf4a06819912 None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:06.715104 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb450e6-1500-4fef-925d-cf4a06819912 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:06.715415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb450e6-1500-4fef-925d-cf4a06819912 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:06.716867 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb450e6-1500-4fef-925d-cf4a06819912 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:06.721971 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 468/893] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Aug 2 08:50:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:06.722948 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb450e6-1500-4fef-925d-cf4a06819912 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:06.736579 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:06.759247 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381cbf45-581b-419a-9961-72e0f7bf73e8 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:06.796996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee6570-5141-477f-af13-99e7e14f752b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:06.797625 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee6570-5141-477f-af13-99e7e14f752b None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:06.797907 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee6570-5141-477f-af13-99e7e14f752b None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:06.798186 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee6570-5141-477f-af13-99e7e14f752b None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:06.798887 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee6570-5141-477f-af13-99e7e14f752b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:06.799195 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee6570-5141-477f-af13-99e7e14f752b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:06.800613 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee6570-5141-477f-af13-99e7e14f752b None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:06.815680 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 426/894] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:06.821681 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee6570-5141-477f-af13-99e7e14f752b None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:06.844342 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb450e6-1500-4fef-925d-cf4a06819912 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:06.886349 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78da2d-b255-4627-8b57-8af43f41b6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:06.887167 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78da2d-b255-4627-8b57-8af43f41b6bf None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:06.887649 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78da2d-b255-4627-8b57-8af43f41b6bf None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:06.888124 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78da2d-b255-4627-8b57-8af43f41b6bf None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:06.889040 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b78da2d-b255-4627-8b57-8af43f41b6bf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:06.889384 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b78da2d-b255-4627-8b57-8af43f41b6bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:06.891064 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b78da2d-b255-4627-8b57-8af43f41b6bf None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:06.897529 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 469/895] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Aug 2 08:50:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:06.898944 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78da2d-b255-4627-8b57-8af43f41b6bf None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:06.964263 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:06.983259 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee6570-5141-477f-af13-99e7e14f752b None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:07.034323 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2f562-958e-46f3-8b8e-a11823778c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:07.035107 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2f562-958e-46f3-8b8e-a11823778c40 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:07.035368 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2f562-958e-46f3-8b8e-a11823778c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:07.035881 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2f562-958e-46f3-8b8e-a11823778c40 None admin] PATH_INFO: `/v3/services` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:07.036387 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2f562-958e-46f3-8b8e-a11823778c40 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:07.036733 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2f562-958e-46f3-8b8e-a11823778c40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:07.038732 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2f562-958e-46f3-8b8e-a11823778c40 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:07.046240 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78da2d-b255-4627-8b57-8af43f41b6bf None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:07.046826 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 427/896] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Aug 2 08:50:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:07.047183 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2f562-958e-46f3-8b8e-a11823778c40 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:07.057677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:07.108534 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf6c69-f749-4ad1-9d95-fca713c5e14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:07.109204 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf6c69-f749-4ad1-9d95-fca713c5e14c None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:07.109605 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf6c69-f749-4ad1-9d95-fca713c5e14c None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:07.110213 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf6c69-f749-4ad1-9d95-fca713c5e14c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:07.120025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf6c69-f749-4ad1-9d95-fca713c5e14c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:07.121920 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf6c69-f749-4ad1-9d95-fca713c5e14c None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:07.135630 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-6cdf6c69-f749-4ad1-9d95-fca713c5e14c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:50:07.135630 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:07.135630 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:07.135630 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:07.135630 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:07.135630 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:07.135630 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:07.135630 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:07.135630 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:07.135630 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:07.135630 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:07.135630 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:07.135630 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:50:07.135630 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:50:07.135630 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:50:07.136779 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:50:07.136779 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:07.136779 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:07.136779 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:07.136779 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:07.136779 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:07.136779 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:07.136779 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:07.136779 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:07.136779 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:07.136779 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:07.136779 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:07.136779 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:07.136779 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:07.136779 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:07.136779 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:07.136779 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:07.137927 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:50:07.137927 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:50:07.137927 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:50:07.137927 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:50:07.137927 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:50:07.137927 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:50:07.137927 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:50:07.137927 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:07.141691 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 470/897] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:50:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:07.142533 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf6c69-f749-4ad1-9d95-fca713c5e14c None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:07.189630 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2f562-958e-46f3-8b8e-a11823778c40 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:07.235318 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccaf487-b13e-4b83-a388-ed18fba0a45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:07.235990 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccaf487-b13e-4b83-a388-ed18fba0a45b None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:07.236262 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccaf487-b13e-4b83-a388-ed18fba0a45b None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:07.236535 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccaf487-b13e-4b83-a388-ed18fba0a45b None admin] PATH_INFO: `/v3/services` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:07.237223 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccaf487-b13e-4b83-a388-ed18fba0a45b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:07.237525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccaf487-b13e-4b83-a388-ed18fba0a45b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:07.238959 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccaf487-b13e-4b83-a388-ed18fba0a45b None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:07.256207 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 428/898] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Aug 2 08:50:07 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:07.256207 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccaf487-b13e-4b83-a388-ed18fba0a45b None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:07.299712 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:07.309677 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf6c69-f749-4ad1-9d95-fca713c5e14c None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:07.344061 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:07.384530 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1da011-ad8f-417f-9780-e2ed12cf1edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:07.385326 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1da011-ad8f-417f-9780-e2ed12cf1edd None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:07.385614 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1da011-ad8f-417f-9780-e2ed12cf1edd None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:07.385892 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1da011-ad8f-417f-9780-e2ed12cf1edd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:07.386699 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1da011-ad8f-417f-9780-e2ed12cf1edd None admin] RBAC: Adding query filter params (interface=public, service_id=35a78555a02a44038aeed6a50129ac31, region_id=RegionOne) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:07.387183 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1da011-ad8f-417f-9780-e2ed12cf1edd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:07.388622 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1da011-ad8f-417f-9780-e2ed12cf1edd None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:07.395178 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 471/899] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Aug 2 08:50:07 2022] GET /identity/v3/endpoints?service_id=35a78555a02a44038aeed6a50129ac31&interface=public®ion_id=RegionOne => generated 194 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:07.402115 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1da011-ad8f-417f-9780-e2ed12cf1edd None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:07.419003 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccaf487-b13e-4b83-a388-ed18fba0a45b None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:07.463967 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825f41b-1f69-41ed-9c2a-5ae054d7558a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:07.464744 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825f41b-1f69-41ed-9c2a-5ae054d7558a None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:07.465109 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825f41b-1f69-41ed-9c2a-5ae054d7558a None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:07.465507 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825f41b-1f69-41ed-9c2a-5ae054d7558a None admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:07.466357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825f41b-1f69-41ed-9c2a-5ae054d7558a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:07.466791 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825f41b-1f69-41ed-9c2a-5ae054d7558a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:07.468514 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825f41b-1f69-41ed-9c2a-5ae054d7558a None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:07.482931 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 429/900] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:50:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:07.488974 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825f41b-1f69-41ed-9c2a-5ae054d7558a None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:07.569151 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1da011-ad8f-417f-9780-e2ed12cf1edd None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:07.618425 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825f41b-1f69-41ed-9c2a-5ae054d7558a None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:07.627416 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3592f26-b4fc-40f6-bde0-a69b3d22bd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:07.628289 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3592f26-b4fc-40f6-bde0-a69b3d22bd19 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:07.628698 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3592f26-b4fc-40f6-bde0-a69b3d22bd19 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:07.629109 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3592f26-b4fc-40f6-bde0-a69b3d22bd19 None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:07.629969 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3592f26-b4fc-40f6-bde0-a69b3d22bd19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:07.631501 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3592f26-b4fc-40f6-bde0-a69b3d22bd19 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:07.638424 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 472/901] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Aug 2 08:50:07 2022] GET /identity/v3/services => generated 1268 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:50:07.665327 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ac164-34bc-49c5-a1f7-11b1216baa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:07.665996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ac164-34bc-49c5-a1f7-11b1216baa3e None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:07.666283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ac164-34bc-49c5-a1f7-11b1216baa3e None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:07.666565 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ac164-34bc-49c5-a1f7-11b1216baa3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:07.667411 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ac164-34bc-49c5-a1f7-11b1216baa3e None admin] RBAC: Adding query filter params (role.id=bfacecd6591f4b43ab2b69bda06ea9b0, scope.project.id=6910e69702854607889bab124edd60c9, user.id=eb640d92cb9b49019f42351a60efe258) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:07.667727 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ac164-34bc-49c5-a1f7-11b1216baa3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:07.669293 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ac164-34bc-49c5-a1f7-11b1216baa3e None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:07.676803 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 430/902] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:50:07 2022] GET /identity/v3/role_assignments?user.id=eb640d92cb9b49019f42351a60efe258&scope.project.id=6910e69702854607889bab124edd60c9&role.id=bfacecd6591f4b43ab2b69bda06ea9b0 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:07.678988 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:08.020466 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47aa546-7623-494a-b616-fc700aa91eb3 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:08.020690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47aa546-7623-494a-b616-fc700aa91eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:08.021080 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47aa546-7623-494a-b616-fc700aa91eb3 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:08.022983 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 473/903] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:50:08.028796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d9b54-0d11-48c5-a611-111b68e79651 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:08.029648 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d9b54-0d11-48c5-a611-111b68e79651 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:08.029648 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d9b54-0d11-48c5-a611-111b68e79651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:08.049063 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-b40d9b54-0d11-48c5-a611-111b68e79651 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:08.050271 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-b40d9b54-0d11-48c5-a611-111b68e79651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:08.132579 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 431/904] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:08 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:50:08.155278 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47aa546-7623-494a-b616-fc700aa91eb3 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:08.189448 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:08.271615 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47aa546-7623-494a-b616-fc700aa91eb3 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:08.310956 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f41244-7c64-4084-9f6f-5c5af5bb988a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:08.311610 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f41244-7c64-4084-9f6f-5c5af5bb988a None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:08.311886 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f41244-7c64-4084-9f6f-5c5af5bb988a None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:08.312170 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f41244-7c64-4084-9f6f-5c5af5bb988a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:08.312818 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f41244-7c64-4084-9f6f-5c5af5bb988a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:08.314195 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f41244-7c64-4084-9f6f-5c5af5bb988a None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:08.324368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-51f41244-7c64-4084-9f6f-5c5af5bb988a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 08:50:08.324368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:08.324368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:50:08.324368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:50:08.324368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:50:08.324368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:50:08.324368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:50:08.324368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:50:08.324368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 08:50:08.324368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:08.324368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:50:08.324368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:08.324368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:08.324368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:08.324368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:08.324368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:08.326770 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:08.326770 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:08.326770 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:08.326770 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:08.326770 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:08.326770 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:08.326770 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:08.326770 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:50:08.326770 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:50:08.326770 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:50:08.326770 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:50:08.326770 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:08.326770 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:08.326770 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:08.326770 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:08.326770 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:08.328426 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:08.328426 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:08.328426 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:08.328426 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:08.328426 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:08.328426 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:08.328426 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:08.328426 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:08.328426 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:08.328426 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:08.328426 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:08.328426 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:50:08.328426 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:50:08.328426 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 08:50:08.328426 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:08.328426 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 474/905] 10.222.0.20 () {56 vars in 1132 bytes} [Tue Aug 2 08:50:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:08.331755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d9b54-0d11-48c5-a611-111b68e79651 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:08.445298 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d9b54-0d11-48c5-a611-111b68e79651 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:08.470615 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:08.486035 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9ece1-4cda-4b35-acfa-6c220f405587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:08.486688 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9ece1-4cda-4b35-acfa-6c220f405587 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:08.486972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9ece1-4cda-4b35-acfa-6c220f405587 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:08.487251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9ece1-4cda-4b35-acfa-6c220f405587 None admin] PATH_INFO: `/v3/services` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:08.487964 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9ece1-4cda-4b35-acfa-6c220f405587 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:08.488303 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9ece1-4cda-4b35-acfa-6c220f405587 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:08.490269 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9ece1-4cda-4b35-acfa-6c220f405587 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:08.496947 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 432/906] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Aug 2 08:50:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:08.501999 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f41244-7c64-4084-9f6f-5c5af5bb988a None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:08.613046 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:08.623278 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f41244-7c64-4084-9f6f-5c5af5bb988a None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:08.660696 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5281f0-d290-4515-847b-5c1e231e1581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:08.662292 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5281f0-d290-4515-847b-5c1e231e1581 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:08.662795 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5281f0-d290-4515-847b-5c1e231e1581 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:08.663255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5281f0-d290-4515-847b-5c1e231e1581 None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:08.664204 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5281f0-d290-4515-847b-5c1e231e1581 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:08.664694 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5281f0-d290-4515-847b-5c1e231e1581 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:08.666262 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5281f0-d290-4515-847b-5c1e231e1581 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:08.672742 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 475/907] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Aug 2 08:50:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:08.684296 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9ece1-4cda-4b35-acfa-6c220f405587 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:08.794466 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9ece1-4cda-4b35-acfa-6c220f405587 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:08.830242 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240650d-756a-4be5-b33f-e47c0a50fef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:08.830926 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240650d-756a-4be5-b33f-e47c0a50fef3 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:08.831207 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240650d-756a-4be5-b33f-e47c0a50fef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:08.831529 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240650d-756a-4be5-b33f-e47c0a50fef3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:08.832337 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240650d-756a-4be5-b33f-e47c0a50fef3 None admin] RBAC: Adding query filter params (interface=public, service_id=cb3d0f6de69b46168fff7709ac209703, region_id=RegionOne) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:08.832647 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240650d-756a-4be5-b33f-e47c0a50fef3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:08.834084 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240650d-756a-4be5-b33f-e47c0a50fef3 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:08.842472 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 433/908] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Aug 2 08:50:08 2022] GET /identity/v3/endpoints?service_id=cb3d0f6de69b46168fff7709ac209703&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:08.847692 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5281f0-d290-4515-847b-5c1e231e1581 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:08.969256 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5281f0-d290-4515-847b-5c1e231e1581 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:09.010601 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06ecd4-2412-4894-8347-ab47b624fe57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:09.011233 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06ecd4-2412-4894-8347-ab47b624fe57 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:09.011524 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06ecd4-2412-4894-8347-ab47b624fe57 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:09.011797 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06ecd4-2412-4894-8347-ab47b624fe57 None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:09.012545 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06ecd4-2412-4894-8347-ab47b624fe57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:09.013979 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06ecd4-2412-4894-8347-ab47b624fe57 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:09.020631 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 476/909] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Aug 2 08:50:08 2022] GET /identity/v3/services => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:50:09.545271 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea20fc5-d44c-4321-a19a-292c6229b321 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:09.545770 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea20fc5-d44c-4321-a19a-292c6229b321 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:09.545770 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea20fc5-d44c-4321-a19a-292c6229b321 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:09.547535 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 434/910] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:50:09.553629 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3ad19-75b6-44cd-9e18-c0be6c093076 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:09.554163 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3ad19-75b6-44cd-9e18-c0be6c093076 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:09.554240 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3ad19-75b6-44cd-9e18-c0be6c093076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:09.576598 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-05f3ad19-75b6-44cd-9e18-c0be6c093076 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:09.577902 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-05f3ad19-75b6-44cd-9e18-c0be6c093076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:09.595693 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:09.660304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 477/911] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:09 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:50:09.676429 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea20fc5-d44c-4321-a19a-292c6229b321 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:09.736646 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:09.795789 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea20fc5-d44c-4321-a19a-292c6229b321 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:09.834280 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf619fad-8432-4038-adf3-a481b8c5a546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:09.834915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf619fad-8432-4038-adf3-a481b8c5a546 None admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:09.835038 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b158a1a-29bf-4f11-a131-d7e7e761b2f6 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:09.835207 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf619fad-8432-4038-adf3-a481b8c5a546 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:09.835306 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b158a1a-29bf-4f11-a131-d7e7e761b2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:09.835472 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf619fad-8432-4038-adf3-a481b8c5a546 None admin] PATH_INFO: `/v3/services` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:09.835588 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b158a1a-29bf-4f11-a131-d7e7e761b2f6 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:09.836211 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf619fad-8432-4038-adf3-a481b8c5a546 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:09.837605 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf619fad-8432-4038-adf3-a481b8c5a546 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:09.840937 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 478/912] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:50:09.842661 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3846b-7d61-4d87-a04a-af60da03f33f None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:09.842957 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3846b-7d61-4d87-a04a-af60da03f33f None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:09.843394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3846b-7d61-4d87-a04a-af60da03f33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:09.862417 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-39b3846b-7d61-4d87-a04a-af60da03f33f None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:09.863768 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-39b3846b-7d61-4d87-a04a-af60da03f33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:09.892913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 435/913] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Aug 2 08:50:09 2022] POST /identity/v3/services => generated 241 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:50:09.902213 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e17b4-3716-458d-ab75-e35b42f0cf87 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:09.903074 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e17b4-3716-458d-ab75-e35b42f0cf87 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:09.903584 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e17b4-3716-458d-ab75-e35b42f0cf87 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:09.905850 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 436/914] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:50:09.913243 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3c8fb-6302-46d4-bc21-7ec1f6c08b3e None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:09.913597 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3c8fb-6302-46d4-bc21-7ec1f6c08b3e None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:09.913801 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3c8fb-6302-46d4-bc21-7ec1f6c08b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:09.934452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-aea3c8fb-6302-46d4-bc21-7ec1f6c08b3e None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:09.935698 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-aea3c8fb-6302-46d4-bc21-7ec1f6c08b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:09.980476 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 479/915] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:50:10.003042 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3846b-7d61-4d87-a04a-af60da03f33f None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:10.024152 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 437/916] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:50:10.047910 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3c8fb-6302-46d4-bc21-7ec1f6c08b3e None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:10.097658 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:10.099744 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:10.135846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3846b-7d61-4d87-a04a-af60da03f33f None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:10.186032 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3c8fb-6302-46d4-bc21-7ec1f6c08b3e None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:10.186551 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380200c5-05c1-49fe-a06b-c4dd3c72e844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:10.187449 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380200c5-05c1-49fe-a06b-c4dd3c72e844 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:10.187986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380200c5-05c1-49fe-a06b-c4dd3c72e844 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:10.188482 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380200c5-05c1-49fe-a06b-c4dd3c72e844 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:10.189412 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380200c5-05c1-49fe-a06b-c4dd3c72e844 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:10.191049 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380200c5-05c1-49fe-a06b-c4dd3c72e844 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:10.205052 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-380200c5-05c1-49fe-a06b-c4dd3c72e844 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 08:50:10.205052 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:10.205052 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:50:10.205052 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:50:10.205052 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:50:10.205052 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:50:10.205052 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:50:10.205052 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:50:10.205052 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 08:50:10.205052 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:10.205052 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:50:10.205052 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:10.205052 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:10.205052 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:10.205052 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:10.205052 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:10.205052 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:10.206149 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:10.206149 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:10.206149 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:10.206149 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:10.206149 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:10.206149 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:10.206149 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:50:10.206149 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:50:10.206149 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:50:10.206149 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:50:10.206149 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:10.206149 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:10.206149 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:10.206149 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:10.206149 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:10.206149 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:10.207255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:10.207255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:10.207255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:10.207255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:10.207255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:10.207255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:10.207255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:10.207255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:10.207255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:10.207255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:10.207255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:50:10.207255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:50:10.207255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 08:50:10.207255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:10.216527 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 480/917] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Aug 2 08:50:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:50:10.219023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380200c5-05c1-49fe-a06b-c4dd3c72e844 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:10.227429 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4a3cb-0200-480c-b62f-04f28bf8beb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:10.228112 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4a3cb-0200-480c-b62f-04f28bf8beb4 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:10.228432 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4a3cb-0200-480c-b62f-04f28bf8beb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:10.228710 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4a3cb-0200-480c-b62f-04f28bf8beb4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:10.242991 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4a3cb-0200-480c-b62f-04f28bf8beb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:50:10.248304 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-c1b4a3cb-0200-480c-b62f-04f28bf8beb4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:50:10.248304 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:10.248304 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:10.248304 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:10.248304 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:10.248304 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:10.248304 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:10.248304 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:10.248304 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:10.248304 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:10.248304 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:10.248304 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:10.248304 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:50:10.248304 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:50:10.248304 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:50:10.248304 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:50:10.249399 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:50:10.249399 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:50:10.249399 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:50:10.249399 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:50:10.249399 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:10.249399 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:10.249399 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:10.249399 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:10.249399 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:10.249399 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:10.249399 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:10.249399 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:10.249399 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:10.249399 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:10.249399 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:10.249399 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:10.251363 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:10.251363 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:10.251363 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:10.251363 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:10.251363 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:50:10.251363 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:50:10.251363 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:50:10.251363 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:50:10.251363 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:50:10.251363 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:50:10.251363 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:50:10.251363 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:10.251363 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 438/918] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Aug 2 08:50:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:50:10.255933 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4a3cb-0200-480c-b62f-04f28bf8beb4 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:10.386972 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380200c5-05c1-49fe-a06b-c4dd3c72e844 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:10.400412 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:10.405432 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4a3cb-0200-480c-b62f-04f28bf8beb4 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:10.452337 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcf069-19dd-4182-aa96-55e444bd1882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:10.452895 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae45548-42a0-4539-bf32-3842173df9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:10.453358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcf069-19dd-4182-aa96-55e444bd1882 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:10.453571 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae45548-42a0-4539-bf32-3842173df9e6 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:10.453820 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae45548-42a0-4539-bf32-3842173df9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:10.453928 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcf069-19dd-4182-aa96-55e444bd1882 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:10.454394 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae45548-42a0-4539-bf32-3842173df9e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:10.454494 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcf069-19dd-4182-aa96-55e444bd1882 None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:10.454884 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae45548-42a0-4539-bf32-3842173df9e6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:10.455693 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae45548-42a0-4539-bf32-3842173df9e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:10.455804 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dcf069-19dd-4182-aa96-55e444bd1882 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:10.456107 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dcf069-19dd-4182-aa96-55e444bd1882 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:10.456610 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae45548-42a0-4539-bf32-3842173df9e6 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:10.459413 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dcf069-19dd-4182-aa96-55e444bd1882 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:10.468440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 439/919] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Aug 2 08:50:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:10.469194 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 481/920] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Aug 2 08:50:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:10.474980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae45548-42a0-4539-bf32-3842173df9e6 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:10.477113 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcf069-19dd-4182-aa96-55e444bd1882 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:10.482475 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:10.606144 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae45548-42a0-4539-bf32-3842173df9e6 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:10.608047 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcf069-19dd-4182-aa96-55e444bd1882 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:10.650420 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcb410-d079-4515-840f-13140e651675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:10.651108 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcb410-d079-4515-840f-13140e651675 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:10.651482 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcb410-d079-4515-840f-13140e651675 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:10.651761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcb410-d079-4515-840f-13140e651675 None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:10.652674 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adcb410-d079-4515-840f-13140e651675 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:10.653079 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adcb410-d079-4515-840f-13140e651675 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:10.654251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61fe9b-7d01-4634-b421-6a9bee0b7482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:10.654662 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adcb410-d079-4515-840f-13140e651675 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:10.655103 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61fe9b-7d01-4634-b421-6a9bee0b7482 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:10.655496 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61fe9b-7d01-4634-b421-6a9bee0b7482 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:10.655869 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61fe9b-7d01-4634-b421-6a9bee0b7482 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:10.666681 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 482/921] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Aug 2 08:50:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:10.668124 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcb410-d079-4515-840f-13140e651675 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:10.670724 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61fe9b-7d01-4634-b421-6a9bee0b7482 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:10.672361 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61fe9b-7d01-4634-b421-6a9bee0b7482 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:10.689132 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-2e61fe9b-7d01-4634-b421-6a9bee0b7482 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:50:10.689132 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:10.689132 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:10.689132 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:10.689132 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:10.689132 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:10.689132 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:10.689132 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:10.689132 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:10.689132 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:10.689132 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:10.689132 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:10.689132 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:50:10.689132 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:50:10.689132 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:50:10.690542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:50:10.690542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:10.690542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:10.690542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:10.690542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:10.690542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:10.690542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:10.690542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:10.690542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:10.690542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:10.690542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:10.690542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:10.690542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:10.690542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:10.690542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:10.690542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:10.690542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:10.692435 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:50:10.692435 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:50:10.692435 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:50:10.692435 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:10.692435 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 440/922] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:10.699233 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61fe9b-7d01-4634-b421-6a9bee0b7482 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:10.717203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:10.750369 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:10.796950 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcb410-d079-4515-840f-13140e651675 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:10.818429 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61fe9b-7d01-4634-b421-6a9bee0b7482 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:10.838133 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c841b-101b-479d-bb7c-4c61a5392471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:10.839034 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c841b-101b-479d-bb7c-4c61a5392471 None admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:10.839493 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c841b-101b-479d-bb7c-4c61a5392471 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:10.839920 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c841b-101b-479d-bb7c-4c61a5392471 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:10.840812 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c841b-101b-479d-bb7c-4c61a5392471 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:10.842477 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c841b-101b-479d-bb7c-4c61a5392471 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:10.858549 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1bc1f-6b26-402d-be37-f3bf763c7ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:10.859267 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1bc1f-6b26-402d-be37-f3bf763c7ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:10.859549 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1bc1f-6b26-402d-be37-f3bf763c7ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:10.859841 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1bc1f-6b26-402d-be37-f3bf763c7ec3 None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:10.860549 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1bc1f-6b26-402d-be37-f3bf763c7ec3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:10.860856 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1bc1f-6b26-402d-be37-f3bf763c7ec3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:10.862310 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1bc1f-6b26-402d-be37-f3bf763c7ec3 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:10.875801 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 441/923] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:10.881890 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1bc1f-6b26-402d-be37-f3bf763c7ec3 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:10.936276 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 483/924] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 08:50:10 2022] POST /identity/v3/endpoints => generated 346 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:50:10.996098 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:11.033354 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1bc1f-6b26-402d-be37-f3bf763c7ec3 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:11.088847 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a926a38d-6821-42be-90df-e52c16112239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:11.089911 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926a38d-6821-42be-90df-e52c16112239 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:11.090395 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926a38d-6821-42be-90df-e52c16112239 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:11.090864 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926a38d-6821-42be-90df-e52c16112239 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:11.101481 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a926a38d-6821-42be-90df-e52c16112239 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:11.103389 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a926a38d-6821-42be-90df-e52c16112239 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:11.118980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-a926a38d-6821-42be-90df-e52c16112239 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:50:11.118980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:11.118980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:11.118980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:11.118980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:11.118980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:11.118980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:11.118980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:11.118980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:11.118980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:11.118980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:11.118980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:11.118980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:50:11.118980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:50:11.118980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:50:11.118980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:50:11.119996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:11.119996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:11.119996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:50:11.119996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:50:11.119996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:50:11.119996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:50:11.119996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:11.119996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:11.119996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:11.119996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:11.119996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:11.119996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:11.119996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:11.119996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:11.119996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:11.119996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:11.119996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:11.119996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:11.121375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:11.121375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:11.121375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:50:11.121375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:50:11.121375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:50:11.121375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:50:11.121375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:50:11.121375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:50:11.121375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:50:11.121375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:11.124048 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 442/925] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Aug 2 08:50:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:50:11.131318 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c841b-101b-479d-bb7c-4c61a5392471 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:11.258480 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c841b-101b-479d-bb7c-4c61a5392471 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:11.266748 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71313316-e16d-44a2-b403-45e8003fc34a None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:11.267052 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71313316-e16d-44a2-b403-45e8003fc34a None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:11.267316 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71313316-e16d-44a2-b403-45e8003fc34a None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:11.269025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 443/926] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:50:11.278423 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431dee3-6ee9-4718-83cb-8241e9efa5c0 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:11.278423 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431dee3-6ee9-4718-83cb-8241e9efa5c0 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:11.278423 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431dee3-6ee9-4718-83cb-8241e9efa5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:11.298033 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:11.299438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-f431dee3-6ee9-4718-83cb-8241e9efa5c0 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:11.301050 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-f431dee3-6ee9-4718-83cb-8241e9efa5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:11.310101 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e1ffc-8aa1-4944-bb5f-d9e64f551e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:11.310880 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e1ffc-8aa1-4944-bb5f-d9e64f551e0c None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:11.311171 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e1ffc-8aa1-4944-bb5f-d9e64f551e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:11.311449 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e1ffc-8aa1-4944-bb5f-d9e64f551e0c None admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:11.312318 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e1ffc-8aa1-4944-bb5f-d9e64f551e0c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:11.312634 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e1ffc-8aa1-4944-bb5f-d9e64f551e0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:11.314096 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e1ffc-8aa1-4944-bb5f-d9e64f551e0c None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:11.334814 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 484/927] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Aug 2 08:50:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:11.340331 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e1ffc-8aa1-4944-bb5f-d9e64f551e0c None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:11.389769 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 444/928] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:50:11.413501 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431dee3-6ee9-4718-83cb-8241e9efa5c0 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:11.456094 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e1ffc-8aa1-4944-bb5f-d9e64f551e0c None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:11.477117 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:11.498502 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76e695-b54b-4298-9e35-5cd6a3698c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:11.499300 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76e695-b54b-4298-9e35-5cd6a3698c90 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:11.499687 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76e695-b54b-4298-9e35-5cd6a3698c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:11.500053 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76e695-b54b-4298-9e35-5cd6a3698c90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:11.513988 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76e695-b54b-4298-9e35-5cd6a3698c90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:11.515713 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76e695-b54b-4298-9e35-5cd6a3698c90 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:11.521282 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431dee3-6ee9-4718-83cb-8241e9efa5c0 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:11.534294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-ac76e695-b54b-4298-9e35-5cd6a3698c90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:50:11.534294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:11.534294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:11.534294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:11.534294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:11.534294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:11.534294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:11.534294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:11.534294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:11.534294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:11.534294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:11.534294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:11.534294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:50:11.534294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:50:11.534294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:50:11.535240 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:50:11.535240 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:11.535240 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:11.535240 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:11.535240 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:11.535240 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:11.535240 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:11.535240 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:11.535240 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:11.535240 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:11.535240 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:11.535240 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:11.535240 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:11.535240 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:11.535240 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:11.535240 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:11.535240 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:11.536131 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:50:11.536131 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:50:11.536131 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:50:11.536131 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:11.536131 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 485/929] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:50:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:11.542689 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76e695-b54b-4298-9e35-5cd6a3698c90 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:11.558655 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896ffc0-4b8f-4e1e-9f38-e4bed453d10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:11.559335 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896ffc0-4b8f-4e1e-9f38-e4bed453d10a None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:11.559614 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896ffc0-4b8f-4e1e-9f38-e4bed453d10a None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:11.559881 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896ffc0-4b8f-4e1e-9f38-e4bed453d10a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:11.560542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896ffc0-4b8f-4e1e-9f38-e4bed453d10a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:11.561915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896ffc0-4b8f-4e1e-9f38-e4bed453d10a None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:11.571473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-a896ffc0-4b8f-4e1e-9f38-e4bed453d10a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 08:50:11.571473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:11.571473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:50:11.571473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:50:11.571473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:50:11.571473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:50:11.571473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:50:11.571473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:50:11.571473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 08:50:11.571473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:11.571473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:50:11.571473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:11.571473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:11.571473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:11.571473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:11.571473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:11.573692 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:11.573692 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:11.573692 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:11.573692 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:11.573692 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:11.573692 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:11.573692 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:11.573692 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:50:11.573692 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:50:11.573692 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:50:11.573692 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:50:11.573692 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:11.573692 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:11.573692 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:11.573692 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:11.573692 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:11.575397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:11.575397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:11.575397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:11.575397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:11.575397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:11.575397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:11.575397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:11.575397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:11.575397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:11.575397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:11.575397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:11.575397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:50:11.575397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:50:11.575397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 08:50:11.575397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:11.575397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 445/930] 10.222.0.20 () {56 vars in 1132 bytes} [Tue Aug 2 08:50:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:50:11.580623 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:11.584415 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896ffc0-4b8f-4e1e-9f38-e4bed453d10a None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:11.680239 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76e695-b54b-4298-9e35-5cd6a3698c90 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:11.722002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896ffc0-4b8f-4e1e-9f38-e4bed453d10a None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:11.727060 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af3632-93cb-44f8-88af-ebbd381116e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:11.727832 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af3632-93cb-44f8-88af-ebbd381116e0 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:11.728257 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af3632-93cb-44f8-88af-ebbd381116e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:11.728628 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af3632-93cb-44f8-88af-ebbd381116e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:11.729441 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af3632-93cb-44f8-88af-ebbd381116e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:11.729844 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af3632-93cb-44f8-88af-ebbd381116e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:11.731341 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af3632-93cb-44f8-88af-ebbd381116e0 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:11.750833 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 486/931] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:11.751835 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af3632-93cb-44f8-88af-ebbd381116e0 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:11.754989 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:11.770735 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a63a6-c687-4b1c-92c2-6a528958291f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:11.772690 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a63a6-c687-4b1c-92c2-6a528958291f None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:11.773123 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a63a6-c687-4b1c-92c2-6a528958291f None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:11.773785 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a63a6-c687-4b1c-92c2-6a528958291f None admin] PATH_INFO: `/v3/services` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:11.775122 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a63a6-c687-4b1c-92c2-6a528958291f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:11.775575 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a63a6-c687-4b1c-92c2-6a528958291f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:11.777145 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a63a6-c687-4b1c-92c2-6a528958291f None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:11.784855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 446/932] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Aug 2 08:50:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:11.790527 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a63a6-c687-4b1c-92c2-6a528958291f None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:11.869266 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:11.877430 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af3632-93cb-44f8-88af-ebbd381116e0 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:11.928570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc3b09-1df6-4156-8c62-d048ed96d379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:11.928803 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a63a6-c687-4b1c-92c2-6a528958291f None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:11.929723 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc3b09-1df6-4156-8c62-d048ed96d379 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:11.930510 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc3b09-1df6-4156-8c62-d048ed96d379 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:11.931034 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc3b09-1df6-4156-8c62-d048ed96d379 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:11.941172 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc3b09-1df6-4156-8c62-d048ed96d379 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:11.943695 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc3b09-1df6-4156-8c62-d048ed96d379 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:11.960819 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-77dc3b09-1df6-4156-8c62-d048ed96d379 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:50:11.960819 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:11.960819 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:11.960819 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:11.960819 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:11.960819 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:11.960819 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:11.960819 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:11.960819 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:11.960819 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:11.960819 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:11.960819 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:11.960819 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:50:11.960819 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:50:11.960819 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:50:11.961802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:50:11.961802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:11.961802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:11.961802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:11.961802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:11.961802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:11.961802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:11.961802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:11.961802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:11.961802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:11.961802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:11.961802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:11.961802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:11.961802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:11.961802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:11.961802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:11.961802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:11.962708 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:50:11.962708 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:50:11.962708 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:50:11.962708 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:50:11.962708 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:50:11.962708 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:50:11.962708 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:50:11.962708 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:11.962708 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 487/933] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:50:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:11.969690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc3b09-1df6-4156-8c62-d048ed96d379 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:11.973093 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ca519-645e-4a30-b058-e49a4c7cc7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:11.975402 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ca519-645e-4a30-b058-e49a4c7cc7b9 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:11.975851 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ca519-645e-4a30-b058-e49a4c7cc7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:11.976328 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ca519-645e-4a30-b058-e49a4c7cc7b9 None admin] PATH_INFO: `/v3/services` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:11.977196 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ca519-645e-4a30-b058-e49a4c7cc7b9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:11.977671 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ca519-645e-4a30-b058-e49a4c7cc7b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:11.979211 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ca519-645e-4a30-b058-e49a4c7cc7b9 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:11.991993 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 447/934] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Aug 2 08:50:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:11.993658 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ca519-645e-4a30-b058-e49a4c7cc7b9 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:12.053832 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:12.113424 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ca519-645e-4a30-b058-e49a4c7cc7b9 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:12.116985 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc3b09-1df6-4156-8c62-d048ed96d379 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:12.157190 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22f848-3cfb-4248-9d65-96326ece6f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:12.157885 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22f848-3cfb-4248-9d65-96326ece6f6f None admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:12.158167 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22f848-3cfb-4248-9d65-96326ece6f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:12.158439 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22f848-3cfb-4248-9d65-96326ece6f6f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:12.159151 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22f848-3cfb-4248-9d65-96326ece6f6f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:12.159537 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20978e94-924a-48c2-8c99-a133c1dd78a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:12.160186 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20978e94-924a-48c2-8c99-a133c1dd78a2 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:12.160590 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20978e94-924a-48c2-8c99-a133c1dd78a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:12.160704 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22f848-3cfb-4248-9d65-96326ece6f6f None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:12.160871 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20978e94-924a-48c2-8c99-a133c1dd78a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:12.162423 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20978e94-924a-48c2-8c99-a133c1dd78a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:12.162776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20978e94-924a-48c2-8c99-a133c1dd78a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:12.164239 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20978e94-924a-48c2-8c99-a133c1dd78a2 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:12.177266 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 488/935] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:50:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:12.178625 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2bdab-52df-4fc1-aa71-cef6e4afea07 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:12.178942 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2bdab-52df-4fc1-aa71-cef6e4afea07 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:12.179186 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2bdab-52df-4fc1-aa71-cef6e4afea07 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:12.180661 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 489/936] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:50:12.185326 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2bdab-52df-4fc1-aa71-cef6e4afea07 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:12.201891 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:12.239226 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 448/937] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 08:50:11 2022] POST /identity/v3/endpoints => generated 347 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:50:12.241195 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9e68b-b89e-400f-8cf6-488d3516ab0e None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:12.241645 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9e68b-b89e-400f-8cf6-488d3516ab0e None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:12.242075 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9e68b-b89e-400f-8cf6-488d3516ab0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:12.263834 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-3ac9e68b-b89e-400f-8cf6-488d3516ab0e None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:12.265460 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-3ac9e68b-b89e-400f-8cf6-488d3516ab0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:12.327878 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2bdab-52df-4fc1-aa71-cef6e4afea07 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:12.358057 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 449/938] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:50:12.376109 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941387ee-2045-4dd0-9678-3a0940083c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:12.376959 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941387ee-2045-4dd0-9678-3a0940083c14 None admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:12.377244 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941387ee-2045-4dd0-9678-3a0940083c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:12.377521 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941387ee-2045-4dd0-9678-3a0940083c14 None admin] PATH_INFO: `/v3/projects/6910e69702854607889bab124edd60c9/users/eb640d92cb9b49019f42351a60efe258/roles/bfacecd6591f4b43ab2b69bda06ea9b0` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:12.379992 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941387ee-2045-4dd0-9678-3a0940083c14 None admin] RBAC: Authorizing `identity:create_grant(project_id=6910e69702854607889bab124edd60c9, user_id=eb640d92cb9b49019f42351a60efe258, role_id=bfacecd6591f4b43ab2b69bda06ea9b0)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:12.382230 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941387ee-2045-4dd0-9678-3a0940083c14 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:12.382507 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9e68b-b89e-400f-8cf6-488d3516ab0e None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:12.438355 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:12.484565 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 490/939] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Aug 2 08:50:12 2022] PUT /identity/v3/projects/6910e69702854607889bab124edd60c9/users/eb640d92cb9b49019f42351a60efe258/roles/bfacecd6591f4b43ab2b69bda06ea9b0 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:50:12.518026 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9e68b-b89e-400f-8cf6-488d3516ab0e None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:12.565922 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653122e-32c8-4b53-80a6-a090ea30ef4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:12.566590 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653122e-32c8-4b53-80a6-a090ea30ef4e None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:12.566867 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653122e-32c8-4b53-80a6-a090ea30ef4e None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:12.567137 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653122e-32c8-4b53-80a6-a090ea30ef4e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:12.568388 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653122e-32c8-4b53-80a6-a090ea30ef4e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:12.570281 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653122e-32c8-4b53-80a6-a090ea30ef4e None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:12.580400 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-c653122e-32c8-4b53-80a6-a090ea30ef4e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:50:12.580400 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:12.580400 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:50:12.580400 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:50:12.580400 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:50:12.580400 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:50:12.580400 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:50:12.580400 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:50:12.580400 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:50:12.580400 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:12.580400 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:50:12.580400 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:12.580400 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:12.580400 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:12.580400 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:12.580400 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:12.580400 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:12.581446 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:12.581446 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:12.581446 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:12.581446 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:12.581446 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:12.581446 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:12.581446 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:50:12.581446 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:50:12.581446 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:50:12.581446 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:50:12.581446 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:12.581446 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:12.581446 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:12.581446 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:12.581446 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:12.581446 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:12.582325 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:12.582325 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:12.582325 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:12.582325 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:12.582325 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:12.582325 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:12.582325 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:12.582325 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:12.582325 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:12.582325 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:12.582325 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:50:12.582325 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:50:12.582325 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:50:12.582325 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:12.582325 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 450/940] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Aug 2 08:50:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:50:12.588798 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941387ee-2045-4dd0-9678-3a0940083c14 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:12.675294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:12.721343 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941387ee-2045-4dd0-9678-3a0940083c14 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:12.759880 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0660b9f-007d-4894-bf85-7625ef599742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:12.760671 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0660b9f-007d-4894-bf85-7625ef599742 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:12.761014 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0660b9f-007d-4894-bf85-7625ef599742 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:12.761349 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0660b9f-007d-4894-bf85-7625ef599742 None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:12.762099 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0660b9f-007d-4894-bf85-7625ef599742 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:12.762472 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0660b9f-007d-4894-bf85-7625ef599742 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:12.764007 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0660b9f-007d-4894-bf85-7625ef599742 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:12.769555 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 491/941] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Aug 2 08:50:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:12.776041 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653122e-32c8-4b53-80a6-a090ea30ef4e None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:12.893920 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653122e-32c8-4b53-80a6-a090ea30ef4e None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:12.896081 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:12.936212 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac36131-a21d-4b3b-9f86-433cb37e0bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:12.936847 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac36131-a21d-4b3b-9f86-433cb37e0bff None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:12.937129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac36131-a21d-4b3b-9f86-433cb37e0bff None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:12.937405 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac36131-a21d-4b3b-9f86-433cb37e0bff None admin] PATH_INFO: `/v3/services` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:12.938146 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac36131-a21d-4b3b-9f86-433cb37e0bff None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:12.938450 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac36131-a21d-4b3b-9f86-433cb37e0bff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:12.939908 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac36131-a21d-4b3b-9f86-433cb37e0bff None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:12.946580 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 451/942] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Aug 2 08:50:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:12.952741 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0660b9f-007d-4894-bf85-7625ef599742 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:13.069088 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0660b9f-007d-4894-bf85-7625ef599742 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:13.111933 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957aec0a-a1a4-415f-81cc-677fcca210c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:13.112610 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957aec0a-a1a4-415f-81cc-677fcca210c3 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:13.112894 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957aec0a-a1a4-415f-81cc-677fcca210c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:13.113180 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957aec0a-a1a4-415f-81cc-677fcca210c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:13.113945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957aec0a-a1a4-415f-81cc-677fcca210c3 None admin] RBAC: Adding query filter params (interface=public, service_id=e67db444d43b4d33ae75fd3126c565dd, region_id=RegionOne) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:13.114259 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957aec0a-a1a4-415f-81cc-677fcca210c3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:13.116323 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957aec0a-a1a4-415f-81cc-677fcca210c3 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:13.117970 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:13.123399 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 492/943] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Aug 2 08:50:12 2022] GET /identity/v3/endpoints?service_id=e67db444d43b4d33ae75fd3126c565dd&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:13.134610 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac36131-a21d-4b3b-9f86-433cb37e0bff None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:13.183013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fe11c-3e99-452b-a150-5b753c0993a8 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:13.183200 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fe11c-3e99-452b-a150-5b753c0993a8 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:13.183487 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fe11c-3e99-452b-a150-5b753c0993a8 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:13.186459 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 493/944] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:50:13.190940 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a7b04-5b19-46f3-92aa-7dc7f1a47faf None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:13.191231 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a7b04-5b19-46f3-92aa-7dc7f1a47faf None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:13.191512 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a7b04-5b19-46f3-92aa-7dc7f1a47faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:13.211195 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-c26a7b04-5b19-46f3-92aa-7dc7f1a47faf None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:13.212419 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-c26a7b04-5b19-46f3-92aa-7dc7f1a47faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:13.256211 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac36131-a21d-4b3b-9f86-433cb37e0bff None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:13.296490 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 494/945] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:50:13.302635 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ebbc18-1a30-4e78-b81d-9cede0599eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:13.303698 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ebbc18-1a30-4e78-b81d-9cede0599eff None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:13.304150 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ebbc18-1a30-4e78-b81d-9cede0599eff None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:13.304595 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ebbc18-1a30-4e78-b81d-9cede0599eff None admin] PATH_INFO: `/v3/services` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:13.305397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ebbc18-1a30-4e78-b81d-9cede0599eff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:13.306925 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ebbc18-1a30-4e78-b81d-9cede0599eff None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:13.314472 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 452/946] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Aug 2 08:50:13 2022] GET /identity/v3/services => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:50:13.320400 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a7b04-5b19-46f3-92aa-7dc7f1a47faf None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:13.448107 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a7b04-5b19-46f3-92aa-7dc7f1a47faf None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:13.481642 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:13.492103 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93c57d-6092-43d9-b8e0-c7c6e3b917eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:13.492785 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93c57d-6092-43d9-b8e0-c7c6e3b917eb None admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:13.493073 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93c57d-6092-43d9-b8e0-c7c6e3b917eb None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:13.499755 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93c57d-6092-43d9-b8e0-c7c6e3b917eb None admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:13.499755 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93c57d-6092-43d9-b8e0-c7c6e3b917eb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:13.499755 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93c57d-6092-43d9-b8e0-c7c6e3b917eb None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:13.499755 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: WARNING keystone.server.flask.common [None req-ad93c57d-6092-43d9-b8e0-c7c6e3b917eb None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 02 08:50:13.546608 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.sql.core [None req-ad93c57d-6092-43d9-b8e0-c7c6e3b917eb None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 02 08:50:13.546608 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 02 08:50:13.546608 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [parameters: {'id': '748f975e2cbb442d97ce40b7b5553995', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 02 08:50:13.546608 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80406) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 02 08:50:13.556026 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-ad93c57d-6092-43d9-b8e0-c7c6e3b917eb None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 748f975e2cbb442d97ce40b7b5553995.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 748f975e2cbb442d97ce40b7b5553995. Aug 02 08:50:13.556026 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:13.556026 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 08:50:13.556026 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 08:50:13.556026 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 08:50:13.556026 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 08:50:13.556026 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 08:50:13.556026 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 08:50:13.556026 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 08:50:13.556026 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application conn.query(q) Aug 02 08:50:13.556026 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 08:50:13.556026 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 08:50:13.556026 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 08:50:13.557035 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application result.read() Aug 02 08:50:13.557035 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 08:50:13.557035 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 08:50:13.557035 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 08:50:13.557035 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 08:50:13.557035 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 08:50:13.557035 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 08:50:13.557035 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 08:50:13.557035 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 08:50:13.557035 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 02 08:50:13.557035 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:13.557035 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 02 08:50:13.557035 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:13.557035 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:13.557035 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 02 08:50:13.557035 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 02 08:50:13.557035 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 02 08:50:13.557035 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 02 08:50:13.558015 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 08:50:13.558015 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application next(self.gen) Aug 02 08:50:13.558015 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 02 08:50:13.558015 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application yield resource Aug 02 08:50:13.558015 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 08:50:13.558015 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application next(self.gen) Aug 02 08:50:13.558015 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 02 08:50:13.558015 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self.session.rollback() Aug 02 08:50:13.558015 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 08:50:13.558015 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self.force_reraise() Aug 02 08:50:13.558015 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 08:50:13.558015 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise self.value Aug 02 08:50:13.558015 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 02 08:50:13.558015 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 02 08:50:13.558015 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 02 08:50:13.558015 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application session.commit() Aug 02 08:50:13.558015 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 02 08:50:13.558956 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 02 08:50:13.558956 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 02 08:50:13.558956 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._prepare_impl() Aug 02 08:50:13.558956 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 02 08:50:13.558956 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self.session.flush() Aug 02 08:50:13.558956 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 02 08:50:13.558956 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._flush(objects) Aug 02 08:50:13.558956 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 02 08:50:13.558956 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 02 08:50:13.558956 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 02 08:50:13.558956 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application compat.raise_( Aug 02 08:50:13.558956 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 08:50:13.558956 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception Aug 02 08:50:13.558956 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 02 08:50:13.558956 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application flush_context.execute() Aug 02 08:50:13.558956 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 02 08:50:13.558956 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rec.execute(self) Aug 02 08:50:13.559857 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 02 08:50:13.559857 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 02 08:50:13.559857 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 02 08:50:13.559857 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 02 08:50:13.559857 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 02 08:50:13.559857 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 02 08:50:13.559857 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 02 08:50:13.559857 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 02 08:50:13.559857 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 02 08:50:13.559857 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 02 08:50:13.559857 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 02 08:50:13.559857 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 02 08:50:13.559857 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 02 08:50:13.559857 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 02 08:50:13.559857 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 02 08:50:13.566815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 02 08:50:13.566815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 08:50:13.566815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception Aug 02 08:50:13.566815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 08:50:13.566815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 08:50:13.566815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 08:50:13.566815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 08:50:13.566815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 08:50:13.566815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 08:50:13.566815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 08:50:13.566815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application conn.query(q) Aug 02 08:50:13.566815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 08:50:13.566815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 08:50:13.566815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 08:50:13.566815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application result.read() Aug 02 08:50:13.566815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 08:50:13.566815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 08:50:13.568481 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 08:50:13.568481 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 08:50:13.568481 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 08:50:13.568481 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 08:50:13.568481 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 08:50:13.568481 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 08:50:13.568481 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 02 08:50:13.568481 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 02 08:50:13.568481 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [parameters: {'id': '748f975e2cbb442d97ce40b7b5553995', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 02 08:50:13.568481 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 02 08:50:13.568481 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:13.568481 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:50:13.568481 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:13.568481 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:13.568481 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 02 08:50:13.569281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 02 08:50:13.569281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 02 08:50:13.569281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 02 08:50:13.569281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 02 08:50:13.569281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:13.569281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:50:13.569281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:13.569281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:13.569281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:13.569281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:13.569281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:13.569281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:13.569281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:13.569281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:13.569281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:13.569281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:13.569281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:13.570186 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:13.570186 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 02 08:50:13.570186 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 02 08:50:13.570186 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:13.570186 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:13.570186 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 02 08:50:13.570186 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 02 08:50:13.570186 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 748f975e2cbb442d97ce40b7b5553995. Aug 02 08:50:13.570186 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:13.570186 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 495/947] 10.222.0.20 () {60 vars in 1140 bytes} [Tue Aug 2 08:50:13 2022] POST /identity/v3/projects => generated 262 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:13.570727 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ebbc18-1a30-4e78-b81d-9cede0599eff None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:13.605741 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:13.696792 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ebbc18-1a30-4e78-b81d-9cede0599eff None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:13.740234 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f4d9e-2e5d-43a0-a5eb-e9d2b3a21bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:13.741376 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f4d9e-2e5d-43a0-a5eb-e9d2b3a21bdf None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:13.741865 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f4d9e-2e5d-43a0-a5eb-e9d2b3a21bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:13.742344 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f4d9e-2e5d-43a0-a5eb-e9d2b3a21bdf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:13.751482 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f4d9e-2e5d-43a0-a5eb-e9d2b3a21bdf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:13.753404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f4d9e-2e5d-43a0-a5eb-e9d2b3a21bdf None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:13.767677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-140f4d9e-2e5d-43a0-a5eb-e9d2b3a21bdf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:50:13.767677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:13.767677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:13.767677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:13.767677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:13.767677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:13.767677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:13.767677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:13.767677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:13.767677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:13.767677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:13.767677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:13.767677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:50:13.767677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:50:13.767677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:50:13.768662 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:50:13.768662 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:13.768662 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:13.768662 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:13.768662 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:13.768662 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:13.768662 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:13.768662 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:13.768662 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:13.768662 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:13.768662 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:13.768662 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:13.768662 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:13.768662 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:13.768662 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:13.768662 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:13.768662 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:13.769542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:50:13.769542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:50:13.769542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:50:13.769542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:50:13.769542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:50:13.769542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:50:13.769542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:50:13.769542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:13.776728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 453/948] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:50:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:13.781502 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93c57d-6092-43d9-b8e0-c7c6e3b917eb None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:13.899005 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93c57d-6092-43d9-b8e0-c7c6e3b917eb None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:13.942917 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48083371-59da-41c3-b38f-bf66191c9a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:13.943983 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48083371-59da-41c3-b38f-bf66191c9a7b None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:13.944506 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48083371-59da-41c3-b38f-bf66191c9a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:13.944993 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48083371-59da-41c3-b38f-bf66191c9a7b None admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:13.946300 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48083371-59da-41c3-b38f-bf66191c9a7b None admin] RBAC: Adding query filter params (name=service) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:13.946852 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48083371-59da-41c3-b38f-bf66191c9a7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:13.949347 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48083371-59da-41c3-b38f-bf66191c9a7b None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:13.990672 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 496/949] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Aug 2 08:50:13 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:14.547480 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2d9e0-725d-4f0e-a2fa-80295dcec035 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:14.547677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2d9e0-725d-4f0e-a2fa-80295dcec035 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:14.547967 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2d9e0-725d-4f0e-a2fa-80295dcec035 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:14.549573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 454/950] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:50:14.556963 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db92e4c-bb43-47af-b8e5-1cdcfe983040 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:14.557462 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db92e4c-bb43-47af-b8e5-1cdcfe983040 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:14.557789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db92e4c-bb43-47af-b8e5-1cdcfe983040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:14.582341 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-9db92e4c-bb43-47af-b8e5-1cdcfe983040 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:14.584291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-9db92e4c-bb43-47af-b8e5-1cdcfe983040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:14.632084 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:14.663404 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 497/951] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:50:14.685363 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2d9e0-725d-4f0e-a2fa-80295dcec035 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:14.794442 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:14.810056 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2d9e0-725d-4f0e-a2fa-80295dcec035 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:14.844693 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b52e8-2cbb-4078-a298-708d50f5c990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:14.845353 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b52e8-2cbb-4078-a298-708d50f5c990 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:14.845634 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b52e8-2cbb-4078-a298-708d50f5c990 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:14.845912 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b52e8-2cbb-4078-a298-708d50f5c990 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:14.846543 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b52e8-2cbb-4078-a298-708d50f5c990 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:14.847913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b52e8-2cbb-4078-a298-708d50f5c990 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:14.853365 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dda353-bbea-45e6-a4aa-c2b7bd8a2e5c None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:14.854321 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dda353-bbea-45e6-a4aa-c2b7bd8a2e5c None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:14.854828 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dda353-bbea-45e6-a4aa-c2b7bd8a2e5c None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:14.856707 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 498/952] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:50:14.860672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-d29b52e8-2cbb-4078-a298-708d50f5c990 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 08:50:14.860672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:14.860672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:50:14.860672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:50:14.860672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:50:14.860672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:50:14.860672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:50:14.860672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:50:14.860672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 08:50:14.860672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:14.860672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:50:14.860672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:14.860672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:14.860672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:14.860672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:14.860672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:14.860672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:14.861862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:14.861862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:14.861862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:14.861862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:14.861862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:14.861862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:14.861862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:50:14.861862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:50:14.861862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:50:14.861862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:50:14.861862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:14.861862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:14.861862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:14.861862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:14.861862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:14.861862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:14.862762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:14.862762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:14.862762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:14.862762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:14.862762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:14.862762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:14.862762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:14.862762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:14.862762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:14.862762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:14.862762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:50:14.862762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:50:14.862762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 08:50:14.862762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:14.862762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 455/953] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:50:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:14.866081 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b52e8-2cbb-4078-a298-708d50f5c990 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:14.866222 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a29f7-1256-4890-ab79-8a690e0320c1 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:14.866510 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a29f7-1256-4890-ab79-8a690e0320c1 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:14.866801 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a29f7-1256-4890-ab79-8a690e0320c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:14.886084 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-d96a29f7-1256-4890-ab79-8a690e0320c1 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:14.887415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-d96a29f7-1256-4890-ab79-8a690e0320c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:14.981381 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 499/954] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:50:14.994730 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b52e8-2cbb-4078-a298-708d50f5c990 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:15.007050 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a29f7-1256-4890-ab79-8a690e0320c1 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:15.041328 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c39bdd-7a57-4acd-a36c-4e9a1d0173fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:15.042508 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c39bdd-7a57-4acd-a36c-4e9a1d0173fe None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:15.042943 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c39bdd-7a57-4acd-a36c-4e9a1d0173fe None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:15.043396 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c39bdd-7a57-4acd-a36c-4e9a1d0173fe None admin] PATH_INFO: `/v3/services` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:15.046050 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c39bdd-7a57-4acd-a36c-4e9a1d0173fe None admin] RBAC: Adding query filter params (name=compute) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:15.046050 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c39bdd-7a57-4acd-a36c-4e9a1d0173fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:15.046984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c39bdd-7a57-4acd-a36c-4e9a1d0173fe None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:15.058891 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 456/955] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Aug 2 08:50:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:15.065131 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c39bdd-7a57-4acd-a36c-4e9a1d0173fe None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:15.087777 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:15.152824 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a29f7-1256-4890-ab79-8a690e0320c1 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:15.157026 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:15.197085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c39bdd-7a57-4acd-a36c-4e9a1d0173fe None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:15.207505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4f53f-4585-434b-9f4e-8479f9a3070a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:15.209470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4f53f-4585-434b-9f4e-8479f9a3070a None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:15.210574 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4f53f-4585-434b-9f4e-8479f9a3070a None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:15.211052 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4f53f-4585-434b-9f4e-8479f9a3070a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:15.227424 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4f53f-4585-434b-9f4e-8479f9a3070a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:50:15.235261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-22e4f53f-4585-434b-9f4e-8479f9a3070a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:50:15.235261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:15.235261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:15.235261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:15.235261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:15.235261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:15.235261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:15.235261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:15.235261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:15.235261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:15.235261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:15.235261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:15.235261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:50:15.235261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:50:15.235261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:50:15.235261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:50:15.236306 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:50:15.236306 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:50:15.236306 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:50:15.236306 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:50:15.236306 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:15.236306 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:15.236306 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:15.236306 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:15.236306 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:15.236306 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:15.236306 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:15.236306 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:15.236306 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:15.236306 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:15.236306 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:15.236306 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:15.237160 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:15.237160 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:15.237160 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:15.237160 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:15.237160 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:50:15.237160 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:50:15.237160 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:50:15.237160 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:50:15.237160 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:50:15.237160 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:50:15.237160 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:50:15.237160 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:15.240418 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932faa8-46f2-4732-83ec-0ab75e778769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:15.240968 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 500/956] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Aug 2 08:50:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:50:15.244846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932faa8-46f2-4732-83ec-0ab75e778769 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:15.245558 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932faa8-46f2-4732-83ec-0ab75e778769 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:15.246066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932faa8-46f2-4732-83ec-0ab75e778769 None admin] PATH_INFO: `/v3/services` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:15.247255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4f53f-4585-434b-9f4e-8479f9a3070a None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:15.248573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932faa8-46f2-4732-83ec-0ab75e778769 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:15.248883 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932faa8-46f2-4732-83ec-0ab75e778769 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:15.250688 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932faa8-46f2-4732-83ec-0ab75e778769 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:15.260250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 457/957] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Aug 2 08:50:15 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:15.388260 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4f53f-4585-434b-9f4e-8479f9a3070a None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:15.434189 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290de13-aa56-41f9-a8bf-37ec50bdc573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:15.435224 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290de13-aa56-41f9-a8bf-37ec50bdc573 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:15.435740 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290de13-aa56-41f9-a8bf-37ec50bdc573 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:15.436271 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290de13-aa56-41f9-a8bf-37ec50bdc573 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:15.437243 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290de13-aa56-41f9-a8bf-37ec50bdc573 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:15.437754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290de13-aa56-41f9-a8bf-37ec50bdc573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:15.439437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290de13-aa56-41f9-a8bf-37ec50bdc573 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:15.450141 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 501/958] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Aug 2 08:50:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:15.456355 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932faa8-46f2-4732-83ec-0ab75e778769 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:15.553738 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:15.565286 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb25d0-9af8-4089-9709-3ba01accb2fe None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:15.565626 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb25d0-9af8-4089-9709-3ba01accb2fe None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:15.565847 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb25d0-9af8-4089-9709-3ba01accb2fe None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:15.567986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 502/959] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:50:15.573504 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e84d8a-4307-48b6-aaec-4663b7501343 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:15.573823 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e84d8a-4307-48b6-aaec-4663b7501343 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:15.574067 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e84d8a-4307-48b6-aaec-4663b7501343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:15.577708 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932faa8-46f2-4732-83ec-0ab75e778769 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:15.594841 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-85e84d8a-4307-48b6-aaec-4663b7501343 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:15.596063 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-85e84d8a-4307-48b6-aaec-4663b7501343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:15.621364 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:15.635036 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcbe37-23f7-483a-9352-8495295217a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:15.635796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcbe37-23f7-483a-9352-8495295217a4 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:15.636203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcbe37-23f7-483a-9352-8495295217a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:15.636496 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcbe37-23f7-483a-9352-8495295217a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:15.650141 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcbe37-23f7-483a-9352-8495295217a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:15.651529 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcbe37-23f7-483a-9352-8495295217a4 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:15.668220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-8adcbe37-23f7-483a-9352-8495295217a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:50:15.668220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:15.668220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:15.668220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:15.668220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:15.668220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:15.668220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:15.668220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:15.668220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:15.668220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:15.668220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:15.668220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:15.668220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:50:15.668220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:50:15.668220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:50:15.669187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:50:15.669187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:15.669187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:15.669187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:15.669187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:15.669187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:15.669187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:15.669187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:15.669187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:15.669187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:15.669187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:15.669187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:15.669187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:15.669187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:15.669187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:15.669187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:15.669187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:15.670102 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:50:15.670102 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:50:15.670102 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:50:15.670102 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:15.670339 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 458/960] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:50:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:15.677622 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcbe37-23f7-483a-9352-8495295217a4 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:15.684308 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 503/961] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:50:15.700036 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e84d8a-4307-48b6-aaec-4663b7501343 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:15.791345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcbe37-23f7-483a-9352-8495295217a4 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:15.810501 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e84d8a-4307-48b6-aaec-4663b7501343 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:15.829877 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0935ad4-2ef6-41cb-9a1c-583f9f0fe209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:15.830574 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0935ad4-2ef6-41cb-9a1c-583f9f0fe209 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:15.830783 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0935ad4-2ef6-41cb-9a1c-583f9f0fe209 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:15.831061 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0935ad4-2ef6-41cb-9a1c-583f9f0fe209 None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:15.831760 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0935ad4-2ef6-41cb-9a1c-583f9f0fe209 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:15.832068 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0935ad4-2ef6-41cb-9a1c-583f9f0fe209 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:15.833672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0935ad4-2ef6-41cb-9a1c-583f9f0fe209 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:15.835188 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:15.847799 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ccd76-4675-479d-8a75-4533cce969a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:15.849361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ccd76-4675-479d-8a75-4533cce969a9 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:15.849361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ccd76-4675-479d-8a75-4533cce969a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:15.849361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ccd76-4675-479d-8a75-4533cce969a9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:15.850128 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ccd76-4675-479d-8a75-4533cce969a9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:15.851535 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ccd76-4675-479d-8a75-4533cce969a9 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:15.852356 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 459/962] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:15.854066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0935ad4-2ef6-41cb-9a1c-583f9f0fe209 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:15.862505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-a65ccd76-4675-479d-8a75-4533cce969a9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:50:15.862505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:15.862505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:50:15.862505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:50:15.862505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:50:15.862505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:50:15.862505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:50:15.862505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:50:15.862505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:50:15.862505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:15.862505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:50:15.862505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:15.862505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:15.862505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:15.862505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:15.862505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:15.862505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:15.864124 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:15.864124 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:15.864124 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:15.864124 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:15.864124 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:15.864124 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:15.864124 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:50:15.864124 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:50:15.864124 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:50:15.864124 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:50:15.864124 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:15.864124 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:15.864124 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:15.864124 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:15.864124 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:15.864124 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:15.866395 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:15.866395 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:15.866395 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:15.866395 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:15.866395 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:15.866395 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:15.866395 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:15.866395 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:15.866395 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:15.866395 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:15.866395 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:50:15.866395 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:50:15.866395 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:50:15.866395 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:15.871874 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 504/963] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Aug 2 08:50:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:50:15.871874 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ccd76-4675-479d-8a75-4533cce969a9 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:15.897858 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:15.967054 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0935ad4-2ef6-41cb-9a1c-583f9f0fe209 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:15.987159 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ccd76-4675-479d-8a75-4533cce969a9 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:16.005204 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ce4a5-920b-4845-a4bc-fd3670fc106d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:16.005908 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ce4a5-920b-4845-a4bc-fd3670fc106d None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:16.006263 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ce4a5-920b-4845-a4bc-fd3670fc106d None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:16.006778 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ce4a5-920b-4845-a4bc-fd3670fc106d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:16.014448 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ce4a5-920b-4845-a4bc-fd3670fc106d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:16.016015 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ce4a5-920b-4845-a4bc-fd3670fc106d None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:16.025696 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345af14-f439-458a-9c3b-1a9b4d0bdb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:16.026588 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345af14-f439-458a-9c3b-1a9b4d0bdb32 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:16.027045 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345af14-f439-458a-9c3b-1a9b4d0bdb32 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:16.027493 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345af14-f439-458a-9c3b-1a9b4d0bdb32 None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:16.028347 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345af14-f439-458a-9c3b-1a9b4d0bdb32 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:16.028867 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345af14-f439-458a-9c3b-1a9b4d0bdb32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:16.030400 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345af14-f439-458a-9c3b-1a9b4d0bdb32 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:16.030979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-2a3ce4a5-920b-4845-a4bc-fd3670fc106d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:50:16.030979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:16.030979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:16.030979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:16.030979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:16.030979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:16.030979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:16.030979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:16.030979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:16.030979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:16.030979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:16.030979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:16.030979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:50:16.030979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:50:16.030979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:50:16.030979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:50:16.032077 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:16.032077 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:16.032077 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:50:16.032077 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:50:16.032077 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:50:16.032077 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:50:16.032077 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:16.032077 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:16.032077 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:16.032077 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:16.032077 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:16.032077 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:16.032077 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:16.032077 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:16.032077 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:16.032077 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:16.032077 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:16.032077 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:16.033293 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:16.033293 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:16.033293 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:50:16.033293 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:50:16.033293 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:50:16.033293 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:50:16.033293 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:50:16.033293 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:50:16.033293 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:50:16.033293 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:16.038257 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 460/964] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Aug 2 08:50:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:50:16.039192 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ce4a5-920b-4845-a4bc-fd3670fc106d None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:16.045289 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 505/965] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Aug 2 08:50:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:16.046664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345af14-f439-458a-9c3b-1a9b4d0bdb32 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:16.102496 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:16.149846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:16.154840 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ce4a5-920b-4845-a4bc-fd3670fc106d None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:16.168607 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345af14-f439-458a-9c3b-1a9b4d0bdb32 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:16.195423 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fd237-1df2-4245-af4e-d7f5f74cd95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:16.196354 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fd237-1df2-4245-af4e-d7f5f74cd95d None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:16.196811 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fd237-1df2-4245-af4e-d7f5f74cd95d None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:16.197229 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fd237-1df2-4245-af4e-d7f5f74cd95d None admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:16.198187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8fd237-1df2-4245-af4e-d7f5f74cd95d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:16.198641 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8fd237-1df2-4245-af4e-d7f5f74cd95d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:16.200536 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8fd237-1df2-4245-af4e-d7f5f74cd95d None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:16.210194 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1dd8a9-ad97-4bef-94ac-540e68f36668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:16.210685 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1dd8a9-ad97-4bef-94ac-540e68f36668 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:16.211003 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1dd8a9-ad97-4bef-94ac-540e68f36668 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:16.211268 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1dd8a9-ad97-4bef-94ac-540e68f36668 None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:16.211949 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1dd8a9-ad97-4bef-94ac-540e68f36668 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:16.212290 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1dd8a9-ad97-4bef-94ac-540e68f36668 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:16.213680 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1dd8a9-ad97-4bef-94ac-540e68f36668 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:16.224718 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 506/966] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Aug 2 08:50:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:16.224718 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f7e96-f54f-459d-a971-be2fb31ce94e None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:16.224718 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f7e96-f54f-459d-a971-be2fb31ce94e None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:16.224718 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f7e96-f54f-459d-a971-be2fb31ce94e None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:16.224718 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 507/967] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:50:16.227584 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f7e96-f54f-459d-a971-be2fb31ce94e None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:16.228067 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 461/968] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Aug 2 08:50:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:16.229467 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb4a3c-d848-4350-9b1f-a600a26caf98 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:16.229848 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb4a3c-d848-4350-9b1f-a600a26caf98 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:16.230257 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb4a3c-d848-4350-9b1f-a600a26caf98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:16.251514 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-92fb4a3c-d848-4350-9b1f-a600a26caf98 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:16.252848 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-92fb4a3c-d848-4350-9b1f-a600a26caf98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:16.345857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 462/969] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:50:16.347214 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb4a3c-d848-4350-9b1f-a600a26caf98 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:16.353833 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f7e96-f54f-459d-a971-be2fb31ce94e None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:16.397317 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e560057-5335-42dd-a843-6c37586a6804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:16.398085 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e560057-5335-42dd-a843-6c37586a6804 None admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:16.398431 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e560057-5335-42dd-a843-6c37586a6804 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:16.398783 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e560057-5335-42dd-a843-6c37586a6804 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:16.399564 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e560057-5335-42dd-a843-6c37586a6804 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:16.401050 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e560057-5335-42dd-a843-6c37586a6804 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:16.412864 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:16.474883 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb4a3c-d848-4350-9b1f-a600a26caf98 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:16.501664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 508/970] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 08:50:16 2022] POST /identity/v3/endpoints => generated 349 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:50:16.502161 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e560057-5335-42dd-a843-6c37586a6804 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:16.508907 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:16.539265 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34163a4-046c-492a-8111-13ddf35be94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:16.539984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34163a4-046c-492a-8111-13ddf35be94c None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:16.540219 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34163a4-046c-492a-8111-13ddf35be94c None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:16.540504 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34163a4-046c-492a-8111-13ddf35be94c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:16.644804 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34163a4-046c-492a-8111-13ddf35be94c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:16.647648 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34163a4-046c-492a-8111-13ddf35be94c None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:16.680554 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e560057-5335-42dd-a843-6c37586a6804 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:16.707166 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:16.738202 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4c341-af1e-4c52-a560-40668df29efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:16.739189 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4c341-af1e-4c52-a560-40668df29efd None admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:16.739650 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4c341-af1e-4c52-a560-40668df29efd None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:16.740522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4c341-af1e-4c52-a560-40668df29efd None admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:16.741333 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4c341-af1e-4c52-a560-40668df29efd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:16.742816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4c341-af1e-4c52-a560-40668df29efd None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:16.786839 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 463/971] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:50:16 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:50:16.793183 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34163a4-046c-492a-8111-13ddf35be94c None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:16.802938 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.sql.core [None req-eae4c341-af1e-4c52-a560-40668df29efd None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 02 08:50:16.802938 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 02 08:50:16.802938 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [parameters: {'user_id': '35e7ca2bacbd4690892bd2c858be7345', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 02 08:50:16.802938 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80406) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 02 08:50:16.812344 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-eae4c341-af1e-4c52-a560-40668df29efd None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 02 08:50:16.812344 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:16.812344 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 08:50:16.812344 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 08:50:16.812344 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 08:50:16.812344 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 08:50:16.812344 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 08:50:16.812344 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 08:50:16.812344 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 08:50:16.812344 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application conn.query(q) Aug 02 08:50:16.812344 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 08:50:16.812344 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 08:50:16.812344 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 08:50:16.812344 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application result.read() Aug 02 08:50:16.812344 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 08:50:16.813304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 08:50:16.813304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 08:50:16.813304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 08:50:16.813304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 08:50:16.813304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 08:50:16.813304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 08:50:16.813304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 08:50:16.813304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 02 08:50:16.813304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:16.813304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 02 08:50:16.813304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:16.813304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:16.813304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 02 08:50:16.813304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 02 08:50:16.813304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 02 08:50:16.813304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 02 08:50:16.813304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 08:50:16.813304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application next(self.gen) Aug 02 08:50:16.814238 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 02 08:50:16.814238 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application yield resource Aug 02 08:50:16.814238 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 08:50:16.814238 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application next(self.gen) Aug 02 08:50:16.814238 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 02 08:50:16.814238 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self.session.rollback() Aug 02 08:50:16.814238 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 08:50:16.814238 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self.force_reraise() Aug 02 08:50:16.814238 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 08:50:16.814238 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise self.value Aug 02 08:50:16.814238 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 02 08:50:16.814238 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 02 08:50:16.814238 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 02 08:50:16.814238 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application session.commit() Aug 02 08:50:16.814238 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 02 08:50:16.814238 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 02 08:50:16.814238 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 02 08:50:16.815141 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._prepare_impl() Aug 02 08:50:16.815141 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 02 08:50:16.815141 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self.session.flush() Aug 02 08:50:16.815141 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 02 08:50:16.815141 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._flush(objects) Aug 02 08:50:16.815141 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 02 08:50:16.815141 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 02 08:50:16.815141 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 02 08:50:16.815141 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application compat.raise_( Aug 02 08:50:16.815141 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 08:50:16.815141 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception Aug 02 08:50:16.815141 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 02 08:50:16.815141 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application flush_context.execute() Aug 02 08:50:16.815141 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 02 08:50:16.815141 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rec.execute(self) Aug 02 08:50:16.815141 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 02 08:50:16.815141 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 02 08:50:16.816040 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 02 08:50:16.816040 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 02 08:50:16.816040 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 02 08:50:16.816040 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 02 08:50:16.816040 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 02 08:50:16.816040 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 02 08:50:16.816040 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 02 08:50:16.816040 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 02 08:50:16.816040 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 02 08:50:16.816040 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 02 08:50:16.816040 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 02 08:50:16.816040 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 02 08:50:16.816040 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 02 08:50:16.816040 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 02 08:50:16.816040 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 08:50:16.816040 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception Aug 02 08:50:16.817120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 08:50:16.817120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 08:50:16.817120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 08:50:16.817120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 08:50:16.817120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 08:50:16.817120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 08:50:16.817120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 08:50:16.817120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application conn.query(q) Aug 02 08:50:16.817120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 08:50:16.817120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 08:50:16.817120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 08:50:16.817120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application result.read() Aug 02 08:50:16.817120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 08:50:16.817120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 08:50:16.817120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 08:50:16.817120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 08:50:16.820284 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 08:50:16.820284 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 08:50:16.820284 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 08:50:16.820284 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 08:50:16.820284 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 02 08:50:16.820284 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 02 08:50:16.820284 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [parameters: {'user_id': '35e7ca2bacbd4690892bd2c858be7345', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 02 08:50:16.820284 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 02 08:50:16.820284 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:16.820284 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:50:16.820284 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:16.820284 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:16.820284 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:16.820284 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:16.820284 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:16.822221 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:16.822221 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:16.822221 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:16.822221 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:16.822221 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:16.822221 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:16.822221 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:16.822221 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 02 08:50:16.822221 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 02 08:50:16.822221 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:16.822221 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:16.822221 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:50:16.822221 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:50:16.822221 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:50:16.822221 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:50:16.822221 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 02 08:50:16.822221 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 02 08:50:16.824484 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 02 08:50:16.824484 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 02 08:50:16.824484 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 02 08:50:16.824484 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 02 08:50:16.824484 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 02 08:50:16.824484 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:16.827378 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 509/972] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Aug 2 08:50:16 2022] POST /identity/v3/users => generated 160 bytes in 325 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:16.835036 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4c341-af1e-4c52-a560-40668df29efd None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:16.932185 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:16.957269 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34163a4-046c-492a-8111-13ddf35be94c None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:16.976422 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4c341-af1e-4c52-a560-40668df29efd None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:17.025855 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e85bef-da51-40f0-8765-76818b58db9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:17.026512 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e85bef-da51-40f0-8765-76818b58db9d None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:17.026713 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e85bef-da51-40f0-8765-76818b58db9d None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:17.026991 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e85bef-da51-40f0-8765-76818b58db9d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:17.032505 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e6867-931a-4ace-8cae-6ba22ac38273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:17.033649 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e6867-931a-4ace-8cae-6ba22ac38273 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:17.034138 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e6867-931a-4ace-8cae-6ba22ac38273 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:17.034612 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e6867-931a-4ace-8cae-6ba22ac38273 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:17.038292 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e85bef-da51-40f0-8765-76818b58db9d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:17.039974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e85bef-da51-40f0-8765-76818b58db9d None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:17.045354 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:17.052806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e6867-931a-4ace-8cae-6ba22ac38273 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:17.053753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-d4e85bef-da51-40f0-8765-76818b58db9d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 08:50:17.053753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:17.053753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:17.053753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:17.053753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:17.053753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:17.053753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:17.053753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:17.053753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:17.053753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:17.053753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:17.053753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:17.053753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:50:17.053753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:50:17.053753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:50:17.053753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:50:17.054789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:17.054789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:17.054789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:50:17.054789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:50:17.054789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:50:17.054789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:50:17.054789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:17.054789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:17.054789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:17.054789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:17.054789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:17.054789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:17.054789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:17.054789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:17.054789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:17.054789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:17.054789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:17.054789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:17.055734 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:17.055734 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:17.055734 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:50:17.055734 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:50:17.055734 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:50:17.055734 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:50:17.055734 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:50:17.055734 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:50:17.055734 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 08:50:17.055734 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:17.058129 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 510/973] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:50:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:50:17.058224 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e6867-931a-4ace-8cae-6ba22ac38273 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:17.060795 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e85bef-da51-40f0-8765-76818b58db9d None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:17.079438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-fa5e6867-931a-4ace-8cae-6ba22ac38273 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:50:17.079438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:17.079438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:17.079438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:17.079438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:17.079438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:17.079438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:17.079438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:17.079438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:17.079438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:17.079438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:17.079438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:17.079438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:50:17.079438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:50:17.079438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:50:17.080597 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:50:17.080597 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:17.080597 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:17.080597 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:17.080597 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:17.080597 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:17.080597 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:17.080597 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:17.080597 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:17.080597 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:17.080597 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:17.080597 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:17.080597 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:17.080597 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:17.080597 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:17.080597 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:17.080597 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:17.081814 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:50:17.081814 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:50:17.081814 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:50:17.081814 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:17.081814 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 464/974] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:50:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:50:17.086336 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e6867-931a-4ace-8cae-6ba22ac38273 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:17.198890 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e85bef-da51-40f0-8765-76818b58db9d None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:17.230343 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:17.236880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e6867-931a-4ace-8cae-6ba22ac38273 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:17.241289 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18ce3d-2172-418d-8b0b-74b4fa37bd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:17.241289 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18ce3d-2172-418d-8b0b-74b4fa37bd61 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:17.241620 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18ce3d-2172-418d-8b0b-74b4fa37bd61 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:17.241854 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18ce3d-2172-418d-8b0b-74b4fa37bd61 None admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:17.242709 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c18ce3d-2172-418d-8b0b-74b4fa37bd61 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:17.243022 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c18ce3d-2172-418d-8b0b-74b4fa37bd61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:17.244542 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c18ce3d-2172-418d-8b0b-74b4fa37bd61 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:17.289048 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac049f-f596-464c-9765-178dd8fc8c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:17.289705 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac049f-f596-464c-9765-178dd8fc8c2d None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:17.289987 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac049f-f596-464c-9765-178dd8fc8c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:17.290267 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac049f-f596-464c-9765-178dd8fc8c2d None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:17.290999 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac049f-f596-464c-9765-178dd8fc8c2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:17.291318 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac049f-f596-464c-9765-178dd8fc8c2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:17.292809 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac049f-f596-464c-9765-178dd8fc8c2d None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:17.303521 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 511/975] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Aug 2 08:50:17 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:17.314996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 465/976] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:17.321889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18ce3d-2172-418d-8b0b-74b4fa37bd61 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:17.438004 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1ea97-5b98-4c29-874c-6f6e9d2131ef None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:17.438328 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1ea97-5b98-4c29-874c-6f6e9d2131ef None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:17.438595 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1ea97-5b98-4c29-874c-6f6e9d2131ef None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:17.444314 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 466/977] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:50:17.448387 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34afc5d-64c4-4899-87d5-d18659061652 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:17.448862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34afc5d-64c4-4899-87d5-d18659061652 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:17.449153 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34afc5d-64c4-4899-87d5-d18659061652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:17.458637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18ce3d-2172-418d-8b0b-74b4fa37bd61 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:17.484345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-d34afc5d-64c4-4899-87d5-d18659061652 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:17.486329 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-d34afc5d-64c4-4899-87d5-d18659061652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:17.510109 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5a15f-2cb1-41aa-bb60-d831e25355ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:17.510785 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5a15f-2cb1-41aa-bb60-d831e25355ac None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:17.511066 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5a15f-2cb1-41aa-bb60-d831e25355ac None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:17.511340 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5a15f-2cb1-41aa-bb60-d831e25355ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:17.519277 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5a15f-2cb1-41aa-bb60-d831e25355ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:17.520970 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5a15f-2cb1-41aa-bb60-d831e25355ac None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:17.533965 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-cdb5a15f-2cb1-41aa-bb60-d831e25355ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:50:17.533965 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:17.533965 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:17.533965 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:17.533965 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:17.533965 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:17.533965 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:17.533965 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:17.533965 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:17.533965 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:17.533965 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:17.533965 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:17.533965 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:50:17.533965 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:50:17.533965 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:50:17.534912 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:50:17.534912 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:17.534912 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:17.534912 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:17.534912 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:17.534912 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:17.534912 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:17.534912 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:17.534912 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:17.534912 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:17.534912 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:17.534912 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:17.534912 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:17.534912 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:17.534912 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:17.534912 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:17.534912 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:17.536797 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:50:17.536797 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:50:17.536797 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:50:17.536797 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:50:17.536797 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:50:17.536797 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:50:17.536797 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:50:17.536797 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:17.536797 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 512/978] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:50:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:50:17.541767 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5a15f-2cb1-41aa-bb60-d831e25355ac None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:17.552674 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:17.589248 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 467/979] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:50:17.610437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:17.613354 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34afc5d-64c4-4899-87d5-d18659061652 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:17.724824 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5a15f-2cb1-41aa-bb60-d831e25355ac None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:17.767757 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34afc5d-64c4-4899-87d5-d18659061652 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:17.772187 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec5a81-11af-4dba-aa27-a8197ac121c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:17.772606 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec5a81-11af-4dba-aa27-a8197ac121c1 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:17.772894 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec5a81-11af-4dba-aa27-a8197ac121c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:17.773183 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec5a81-11af-4dba-aa27-a8197ac121c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:17.773947 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec5a81-11af-4dba-aa27-a8197ac121c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:17.774258 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec5a81-11af-4dba-aa27-a8197ac121c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:17.776263 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec5a81-11af-4dba-aa27-a8197ac121c1 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:17.800010 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 513/980] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:50:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:17.801190 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec5a81-11af-4dba-aa27-a8197ac121c1 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:17.820515 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44caa193-e2e7-4517-b29a-08f7076e69b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:17.821535 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caa193-e2e7-4517-b29a-08f7076e69b2 None admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:17.821960 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caa193-e2e7-4517-b29a-08f7076e69b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:17.822242 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caa193-e2e7-4517-b29a-08f7076e69b2 None admin] PATH_INFO: `/v3/services` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:17.823070 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44caa193-e2e7-4517-b29a-08f7076e69b2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:17.825603 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44caa193-e2e7-4517-b29a-08f7076e69b2 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:17.909832 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 468/981] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Aug 2 08:50:17 2022] POST /identity/v3/services => generated 242 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:50:17.962301 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec5a81-11af-4dba-aa27-a8197ac121c1 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:17.966733 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:18.026915 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf0d07-0075-4dd0-8c6d-3882fdc9aa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:18.027566 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf0d07-0075-4dd0-8c6d-3882fdc9aa4b None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:18.027848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf0d07-0075-4dd0-8c6d-3882fdc9aa4b None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:18.028124 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf0d07-0075-4dd0-8c6d-3882fdc9aa4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:18.028985 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf0d07-0075-4dd0-8c6d-3882fdc9aa4b None admin] RBAC: Adding query filter params (role.id=bfacecd6591f4b43ab2b69bda06ea9b0, scope.project.id=6910e69702854607889bab124edd60c9, user.id=eb640d92cb9b49019f42351a60efe258) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:18.029296 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf0d07-0075-4dd0-8c6d-3882fdc9aa4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:18.031319 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf0d07-0075-4dd0-8c6d-3882fdc9aa4b None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:18.042735 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 514/982] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:50:17 2022] GET /identity/v3/role_assignments?user.id=eb640d92cb9b49019f42351a60efe258&scope.project.id=6910e69702854607889bab124edd60c9&role.id=bfacecd6591f4b43ab2b69bda06ea9b0 => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:18.796147 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c8b79-a27f-49d7-a71b-c3b91188f91e None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:18.796714 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c8b79-a27f-49d7-a71b-c3b91188f91e None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:18.796714 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c8b79-a27f-49d7-a71b-c3b91188f91e None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:18.798342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 469/983] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:50:18.804588 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9e69f-f911-451b-b0a0-99def463e7e8 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:18.804878 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9e69f-f911-451b-b0a0-99def463e7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:18.805157 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9e69f-f911-451b-b0a0-99def463e7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:18.824140 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-01a9e69f-f911-451b-b0a0-99def463e7e8 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:18.825681 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-01a9e69f-f911-451b-b0a0-99def463e7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:18.898776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 515/984] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:18 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:50:18.921657 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c8b79-a27f-49d7-a71b-c3b91188f91e None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:18.974674 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:19.048338 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c8b79-a27f-49d7-a71b-c3b91188f91e None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:19.088324 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6171f3-903e-497f-b4eb-3177421df298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:19.089263 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6171f3-903e-497f-b4eb-3177421df298 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:19.089691 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6171f3-903e-497f-b4eb-3177421df298 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:19.090110 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6171f3-903e-497f-b4eb-3177421df298 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:19.090882 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6171f3-903e-497f-b4eb-3177421df298 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:19.092426 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6171f3-903e-497f-b4eb-3177421df298 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:19.102292 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-3d6171f3-903e-497f-b4eb-3177421df298 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:50:19.102292 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:19.102292 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:50:19.102292 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:50:19.102292 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:50:19.102292 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:50:19.102292 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:50:19.102292 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:50:19.102292 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:50:19.102292 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:19.102292 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:50:19.102292 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:19.102292 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:19.102292 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:19.102292 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:19.102292 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:19.102292 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:19.103391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:19.103391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:19.103391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:19.103391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:19.103391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:19.103391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:19.103391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:50:19.103391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:50:19.103391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:50:19.103391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:50:19.103391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:19.103391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:19.103391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:19.103391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:19.103391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:19.103391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:19.104279 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:19.104279 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:19.104279 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:19.104279 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:19.104279 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:19.104279 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:19.104279 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:19.104279 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:19.104279 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:19.104279 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:19.104279 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:50:19.104279 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:50:19.104279 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:50:19.104279 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:19.105033 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 470/985] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Aug 2 08:50:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:50:19.111508 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9e69f-f911-451b-b0a0-99def463e7e8 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:19.216977 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:19.224728 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9e69f-f911-451b-b0a0-99def463e7e8 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:19.265234 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645ce6f-2c8f-4217-a911-aa74242adebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:19.265856 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645ce6f-2c8f-4217-a911-aa74242adebb None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:19.266139 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645ce6f-2c8f-4217-a911-aa74242adebb None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:19.266408 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645ce6f-2c8f-4217-a911-aa74242adebb None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:19.267087 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645ce6f-2c8f-4217-a911-aa74242adebb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:19.267385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645ce6f-2c8f-4217-a911-aa74242adebb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:19.268896 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645ce6f-2c8f-4217-a911-aa74242adebb None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:19.277559 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 516/986] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Aug 2 08:50:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:19.284316 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6171f3-903e-497f-b4eb-3177421df298 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:19.403484 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6171f3-903e-497f-b4eb-3177421df298 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:19.405880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:19.441247 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a89aba-364d-4401-bf88-5c394c128586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:19.441874 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a89aba-364d-4401-bf88-5c394c128586 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:19.442736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a89aba-364d-4401-bf88-5c394c128586 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:19.443130 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a89aba-364d-4401-bf88-5c394c128586 None admin] PATH_INFO: `/v3/services` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:19.444131 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a89aba-364d-4401-bf88-5c394c128586 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:19.444474 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a89aba-364d-4401-bf88-5c394c128586 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:19.445847 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a89aba-364d-4401-bf88-5c394c128586 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:19.451386 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 471/987] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Aug 2 08:50:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:19.457169 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645ce6f-2c8f-4217-a911-aa74242adebb None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:19.572851 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645ce6f-2c8f-4217-a911-aa74242adebb None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:19.619979 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6db21-c71d-450e-beb7-117d4ffd76b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:19.620636 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6db21-c71d-450e-beb7-117d4ffd76b4 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:19.620915 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6db21-c71d-450e-beb7-117d4ffd76b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:19.621186 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6db21-c71d-450e-beb7-117d4ffd76b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:19.621953 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6db21-c71d-450e-beb7-117d4ffd76b4 None admin] RBAC: Adding query filter params (interface=admin, service_id=e67db444d43b4d33ae75fd3126c565dd, region_id=RegionOne) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:19.622263 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6db21-c71d-450e-beb7-117d4ffd76b4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:19.623667 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6db21-c71d-450e-beb7-117d4ffd76b4 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:19.635189 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 517/988] 10.222.0.20 () {56 vars in 1249 bytes} [Tue Aug 2 08:50:19 2022] GET /identity/v3/endpoints?service_id=e67db444d43b4d33ae75fd3126c565dd&interface=admin®ion_id=RegionOne => generated 193 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:19.637040 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a89aba-364d-4401-bf88-5c394c128586 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:19.754672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a89aba-364d-4401-bf88-5c394c128586 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:19.797187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb07283-1a1f-4aa2-9d79-65ea0f228480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:19.797881 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb07283-1a1f-4aa2-9d79-65ea0f228480 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:19.798115 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb07283-1a1f-4aa2-9d79-65ea0f228480 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:19.798354 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb07283-1a1f-4aa2-9d79-65ea0f228480 None admin] PATH_INFO: `/v3/services` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:19.799276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb07283-1a1f-4aa2-9d79-65ea0f228480 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:19.800747 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb07283-1a1f-4aa2-9d79-65ea0f228480 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:19.808523 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 472/989] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Aug 2 08:50:19 2022] GET /identity/v3/services => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:50:20.162685 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99022023-3c43-4f1e-812e-cf30b3412904 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:20.163221 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99022023-3c43-4f1e-812e-cf30b3412904 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:20.163538 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99022023-3c43-4f1e-812e-cf30b3412904 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:20.165871 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 518/990] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:50:20.174330 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72dd887-3204-413c-865b-8915ca145b76 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:20.174764 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72dd887-3204-413c-865b-8915ca145b76 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:20.175184 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72dd887-3204-413c-865b-8915ca145b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:20.204115 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-a72dd887-3204-413c-865b-8915ca145b76 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:20.206010 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-a72dd887-3204-413c-865b-8915ca145b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:20.255277 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:20.265450 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fa14f-ba2f-4b63-b4b6-09289d5de9bf None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:20.265894 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fa14f-ba2f-4b63-b4b6-09289d5de9bf None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:20.266598 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fa14f-ba2f-4b63-b4b6-09289d5de9bf None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:20.272260 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 519/991] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:50:20.279586 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd284cd4-97f7-4dbd-870d-16e3bff4eec8 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:20.280265 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd284cd4-97f7-4dbd-870d-16e3bff4eec8 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:20.280265 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd284cd4-97f7-4dbd-870d-16e3bff4eec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:20.300958 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-dd284cd4-97f7-4dbd-870d-16e3bff4eec8 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:20.303119 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-dd284cd4-97f7-4dbd-870d-16e3bff4eec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:20.318508 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 473/992] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:20 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:50:20.326442 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:20.350531 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72dd887-3204-413c-865b-8915ca145b76 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:20.394228 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 520/993] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:20 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:50:20.416080 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd284cd4-97f7-4dbd-870d-16e3bff4eec8 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:20.485594 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72dd887-3204-413c-865b-8915ca145b76 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:20.525356 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e8ba1-5cc8-4f65-84d7-87c7e96410bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:20.525768 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd284cd4-97f7-4dbd-870d-16e3bff4eec8 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:20.526596 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e8ba1-5cc8-4f65-84d7-87c7e96410bd None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:20.527196 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e8ba1-5cc8-4f65-84d7-87c7e96410bd None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:20.527664 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e8ba1-5cc8-4f65-84d7-87c7e96410bd None admin] PATH_INFO: `/v3/services/compute` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:20.528405 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e8ba1-5cc8-4f65-84d7-87c7e96410bd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:20.529815 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e8ba1-5cc8-4f65-84d7-87c7e96410bd None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:20.539963 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-ad7e8ba1-5cc8-4f65-84d7-87c7e96410bd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 08:50:20.539963 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:20.539963 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:50:20.539963 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:50:20.539963 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:50:20.539963 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:50:20.539963 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:50:20.539963 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:50:20.539963 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 08:50:20.539963 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:20.539963 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:50:20.539963 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:20.539963 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:20.539963 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:20.539963 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:20.539963 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:20.539963 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:20.541239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:20.541239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:20.541239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:20.541239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:20.541239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:20.541239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:20.541239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:50:20.541239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:50:20.541239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:50:20.541239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:50:20.541239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:20.541239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:20.541239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:20.541239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:20.541239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:20.541239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:20.542069 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:20.542069 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:20.542069 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:20.542069 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:20.542069 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:20.542069 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:20.542069 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:20.542069 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:20.542069 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:20.542069 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:20.542069 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:50:20.542069 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:50:20.542069 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 08:50:20.542069 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:20.542069 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 474/994] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:50:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:50:20.547700 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e8ba1-5cc8-4f65-84d7-87c7e96410bd None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:20.565946 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01876ee-4e10-4ab4-b706-d1cafe401d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:20.566612 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01876ee-4e10-4ab4-b706-d1cafe401d9e None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:20.566894 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01876ee-4e10-4ab4-b706-d1cafe401d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:20.567224 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01876ee-4e10-4ab4-b706-d1cafe401d9e None admin] PATH_INFO: `/v3/services/image` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:20.568409 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01876ee-4e10-4ab4-b706-d1cafe401d9e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:20.569819 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01876ee-4e10-4ab4-b706-d1cafe401d9e None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:20.579297 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-d01876ee-4e10-4ab4-b706-d1cafe401d9e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 08:50:20.579297 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:20.579297 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:50:20.579297 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:50:20.579297 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:50:20.579297 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:50:20.579297 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:50:20.579297 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:50:20.579297 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 08:50:20.579297 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:20.579297 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:50:20.579297 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:20.579297 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:20.579297 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:20.579297 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:20.579297 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:20.579297 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:20.580564 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:20.580564 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:20.580564 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:20.580564 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:20.580564 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:20.580564 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:20.580564 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:50:20.580564 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:50:20.580564 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:50:20.580564 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:50:20.580564 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:20.580564 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:20.580564 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:20.580564 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:20.580564 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:20.580564 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:20.581565 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:20.581565 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:20.581565 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:20.581565 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:20.581565 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:20.581565 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:20.581565 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:20.581565 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:20.581565 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:20.581565 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:20.581565 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:50:20.581565 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:50:20.581565 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 08:50:20.581565 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:20.581565 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 521/995] 10.222.0.20 () {56 vars in 1105 bytes} [Tue Aug 2 08:50:20 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:50:20.587187 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01876ee-4e10-4ab4-b706-d1cafe401d9e None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:20.593958 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:20.606149 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:20.687046 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e8ba1-5cc8-4f65-84d7-87c7e96410bd None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:20.707511 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01876ee-4e10-4ab4-b706-d1cafe401d9e None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:20.730094 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c2903-09f5-4a02-9710-cfb3fd13e87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:20.731290 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c2903-09f5-4a02-9710-cfb3fd13e87b None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:20.731897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c2903-09f5-4a02-9710-cfb3fd13e87b None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:20.732387 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c2903-09f5-4a02-9710-cfb3fd13e87b None admin] PATH_INFO: `/v3/services` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:20.733756 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c2903-09f5-4a02-9710-cfb3fd13e87b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:20.734223 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c2903-09f5-4a02-9710-cfb3fd13e87b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:20.736507 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c2903-09f5-4a02-9710-cfb3fd13e87b None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:20.742735 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 475/996] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Aug 2 08:50:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:20.748265 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f054818-b24d-415e-8763-6c65b134a2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:20.748459 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c2903-09f5-4a02-9710-cfb3fd13e87b None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:20.748993 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f054818-b24d-415e-8763-6c65b134a2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:20.749395 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f054818-b24d-415e-8763-6c65b134a2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:20.749933 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f054818-b24d-415e-8763-6c65b134a2e9 None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:20.750714 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f054818-b24d-415e-8763-6c65b134a2e9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:20.751016 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f054818-b24d-415e-8763-6c65b134a2e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:20.752429 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f054818-b24d-415e-8763-6c65b134a2e9 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:20.758671 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 522/997] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:50:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:20.764223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f054818-b24d-415e-8763-6c65b134a2e9 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:20.856140 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:20.860270 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:20.872590 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c2903-09f5-4a02-9710-cfb3fd13e87b None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:20.879142 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f054818-b24d-415e-8763-6c65b134a2e9 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:20.909602 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e644c5d-78a0-4203-8a18-0837357bc705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:20.910235 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e644c5d-78a0-4203-8a18-0837357bc705 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:20.910511 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e644c5d-78a0-4203-8a18-0837357bc705 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:20.911508 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e644c5d-78a0-4203-8a18-0837357bc705 None admin] PATH_INFO: `/v3/services` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:20.912870 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e644c5d-78a0-4203-8a18-0837357bc705 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:20.913208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e644c5d-78a0-4203-8a18-0837357bc705 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:20.914624 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e644c5d-78a0-4203-8a18-0837357bc705 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:20.921491 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 476/998] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Aug 2 08:50:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:20.925262 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a096c-a6c4-466a-b92a-ac7a3b37051b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:20.925896 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a096c-a6c4-466a-b92a-ac7a3b37051b None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:20.926174 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a096c-a6c4-466a-b92a-ac7a3b37051b None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:20.927850 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a096c-a6c4-466a-b92a-ac7a3b37051b None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:20.928510 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e644c5d-78a0-4203-8a18-0837357bc705 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:20.928729 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a096c-a6c4-466a-b92a-ac7a3b37051b None admin] RBAC: Adding query filter params (type=image) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:20.929037 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a096c-a6c4-466a-b92a-ac7a3b37051b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:20.930482 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a096c-a6c4-466a-b92a-ac7a3b37051b None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:20.936049 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 523/999] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:50:20 2022] GET /identity/v3/services?type=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:21.051134 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e644c5d-78a0-4203-8a18-0837357bc705 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:21.090502 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91c51f-43f3-4f15-8733-d36aacbdbc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:21.091124 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91c51f-43f3-4f15-8733-d36aacbdbc60 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:21.092080 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91c51f-43f3-4f15-8733-d36aacbdbc60 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:21.092381 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91c51f-43f3-4f15-8733-d36aacbdbc60 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:21.093150 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91c51f-43f3-4f15-8733-d36aacbdbc60 None admin] RBAC: Adding query filter params (interface=public, service_id=260489695dbb411dbc7376ebffed4a83, region_id=RegionOne) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:21.093461 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91c51f-43f3-4f15-8733-d36aacbdbc60 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:21.094834 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91c51f-43f3-4f15-8733-d36aacbdbc60 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:21.101819 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 477/1000] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Aug 2 08:50:20 2022] GET /identity/v3/endpoints?service_id=260489695dbb411dbc7376ebffed4a83&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:21.107453 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a096c-a6c4-466a-b92a-ac7a3b37051b None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:21.217088 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a096c-a6c4-466a-b92a-ac7a3b37051b None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:21.254396 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3130d3d-701b-4631-bb5c-9b44cb51f880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:21.255740 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3130d3d-701b-4631-bb5c-9b44cb51f880 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:21.256052 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3130d3d-701b-4631-bb5c-9b44cb51f880 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:21.256353 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3130d3d-701b-4631-bb5c-9b44cb51f880 None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:21.257039 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3130d3d-701b-4631-bb5c-9b44cb51f880 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:21.258485 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3130d3d-701b-4631-bb5c-9b44cb51f880 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:21.267027 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 524/1001] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Aug 2 08:50:21 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:50:21.941841 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251be12-25b1-4452-bd84-149fbb560727 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:21.943013 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251be12-25b1-4452-bd84-149fbb560727 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:21.943269 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251be12-25b1-4452-bd84-149fbb560727 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:21.944920 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 478/1002] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:50:21.950350 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06a30a-bd38-454b-91b0-866b10846194 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:21.950852 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06a30a-bd38-454b-91b0-866b10846194 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:21.951296 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06a30a-bd38-454b-91b0-866b10846194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:21.970953 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-4a06a30a-bd38-454b-91b0-866b10846194 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:21.972177 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-4a06a30a-bd38-454b-91b0-866b10846194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:21.974701 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:22.048201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 525/1003] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:21 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:50:22.078701 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251be12-25b1-4452-bd84-149fbb560727 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:22.100755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:22.193451 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251be12-25b1-4452-bd84-149fbb560727 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:22.229295 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a147a-005d-4864-bab1-b34dc081dc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:22.229945 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a147a-005d-4864-bab1-b34dc081dc65 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:22.230225 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a147a-005d-4864-bab1-b34dc081dc65 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:22.230499 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a147a-005d-4864-bab1-b34dc081dc65 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:22.231125 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a147a-005d-4864-bab1-b34dc081dc65 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:22.232570 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a147a-005d-4864-bab1-b34dc081dc65 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:22.243131 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-346a147a-005d-4864-bab1-b34dc081dc65 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:50:22.243131 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:22.243131 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:50:22.243131 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:50:22.243131 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:50:22.243131 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:50:22.243131 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:50:22.243131 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:50:22.243131 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:50:22.243131 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:22.243131 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:50:22.243131 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:22.243131 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:22.243131 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:22.243131 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:22.243131 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:22.243131 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:22.244208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:22.244208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:22.244208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:22.244208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:22.244208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:22.244208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:22.244208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:50:22.244208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:50:22.244208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:50:22.244208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:50:22.244208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:22.244208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:22.244208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:22.244208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:22.244208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:22.244208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:22.245126 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:22.245126 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:22.245126 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:22.245126 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:22.245126 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:22.245126 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:22.245126 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:22.245126 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:22.245126 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:22.245126 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:22.245126 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:50:22.245126 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:50:22.245126 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:50:22.245126 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:22.248502 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 479/1004] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Aug 2 08:50:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:22.250947 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06a30a-bd38-454b-91b0-866b10846194 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:22.372382 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06a30a-bd38-454b-91b0-866b10846194 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:22.416051 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a3a0a-45ea-43e3-ad1c-56f2d7311b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:22.416837 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a3a0a-45ea-43e3-ad1c-56f2d7311b72 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:22.417120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a3a0a-45ea-43e3-ad1c-56f2d7311b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:22.417394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a3a0a-45ea-43e3-ad1c-56f2d7311b72 None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:22.418086 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a3a0a-45ea-43e3-ad1c-56f2d7311b72 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:22.418384 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a3a0a-45ea-43e3-ad1c-56f2d7311b72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:22.419783 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a3a0a-45ea-43e3-ad1c-56f2d7311b72 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:22.425583 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 526/1005] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Aug 2 08:50:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:22.431915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a147a-005d-4864-bab1-b34dc081dc65 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:22.530605 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:22.552136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a147a-005d-4864-bab1-b34dc081dc65 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:22.593525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdccfb4f-7d08-4ae0-8dd7-9ecc0ef6c05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:22.594151 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdccfb4f-7d08-4ae0-8dd7-9ecc0ef6c05f None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:22.594429 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdccfb4f-7d08-4ae0-8dd7-9ecc0ef6c05f None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:22.594706 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdccfb4f-7d08-4ae0-8dd7-9ecc0ef6c05f None admin] PATH_INFO: `/v3/services` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:22.595386 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdccfb4f-7d08-4ae0-8dd7-9ecc0ef6c05f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:22.595727 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdccfb4f-7d08-4ae0-8dd7-9ecc0ef6c05f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:22.597130 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdccfb4f-7d08-4ae0-8dd7-9ecc0ef6c05f None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:22.603543 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 480/1006] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Aug 2 08:50:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:22.608983 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a3a0a-45ea-43e3-ad1c-56f2d7311b72 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:22.612253 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:22.725413 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a3a0a-45ea-43e3-ad1c-56f2d7311b72 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:22.763844 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fa7ed-be4f-4877-9bc1-ea3176fd2568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:22.764866 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fa7ed-be4f-4877-9bc1-ea3176fd2568 None admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:22.764866 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fa7ed-be4f-4877-9bc1-ea3176fd2568 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:22.765348 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fa7ed-be4f-4877-9bc1-ea3176fd2568 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:22.766179 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fa7ed-be4f-4877-9bc1-ea3176fd2568 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:22.768506 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fa7ed-be4f-4877-9bc1-ea3176fd2568 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:22.873741 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 527/1007] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 08:50:22 2022] POST /identity/v3/endpoints => generated 325 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:50:23.068220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d4050-b497-484c-81d4-5f1a22642533 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:23.069371 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d4050-b497-484c-81d4-5f1a22642533 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:23.069650 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d4050-b497-484c-81d4-5f1a22642533 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:23.071031 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 481/1008] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:50:23.076820 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d449423-5e4c-4af8-9c10-52e5b256c954 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:23.077098 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d449423-5e4c-4af8-9c10-52e5b256c954 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:23.077381 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d449423-5e4c-4af8-9c10-52e5b256c954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:23.100353 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-9d449423-5e4c-4af8-9c10-52e5b256c954 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:23.101570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-9d449423-5e4c-4af8-9c10-52e5b256c954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:23.177833 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:23.196736 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 528/1009] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:23 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:50:23.219046 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d4050-b497-484c-81d4-5f1a22642533 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:23.353393 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d4050-b497-484c-81d4-5f1a22642533 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:23.382858 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f76336-53db-4454-ac90-936929f4c24b None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:23.383652 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f76336-53db-4454-ac90-936929f4c24b None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:23.383652 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f76336-53db-4454-ac90-936929f4c24b None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:23.385092 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 529/1010] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:50:23.390859 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a8fb1-e216-423e-a89c-4723a002d814 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:23.391146 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a8fb1-e216-423e-a89c-4723a002d814 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:23.391424 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a8fb1-e216-423e-a89c-4723a002d814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:23.401918 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2109e-0582-48f9-8438-922952420efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:23.402564 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2109e-0582-48f9-8438-922952420efe None admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:23.402848 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2109e-0582-48f9-8438-922952420efe None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:23.403124 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2109e-0582-48f9-8438-922952420efe None admin] PATH_INFO: `/v3/services` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:23.403851 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2109e-0582-48f9-8438-922952420efe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:23.405332 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2109e-0582-48f9-8438-922952420efe None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:23.415245 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-499a8fb1-e216-423e-a89c-4723a002d814 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:23.416323 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-499a8fb1-e216-423e-a89c-4723a002d814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:23.472823 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 482/1011] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Aug 2 08:50:23 2022] POST /identity/v3/services => generated 242 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:50:23.505063 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 530/1012] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:23 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:50:23.529451 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2109e-0582-48f9-8438-922952420efe None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:23.542092 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:23.662477 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2109e-0582-48f9-8438-922952420efe None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:23.703727 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e04362-7c3d-432e-b680-099eb4eea6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:23.704448 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e04362-7c3d-432e-b680-099eb4eea6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:23.704734 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e04362-7c3d-432e-b680-099eb4eea6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:23.705006 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e04362-7c3d-432e-b680-099eb4eea6e8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:23.705638 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e04362-7c3d-432e-b680-099eb4eea6e8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:23.707022 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e04362-7c3d-432e-b680-099eb4eea6e8 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:23.720443 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-32e04362-7c3d-432e-b680-099eb4eea6e8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 08:50:23.720443 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:23.720443 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:50:23.720443 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:50:23.720443 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:50:23.720443 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:50:23.720443 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:50:23.720443 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:50:23.720443 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 08:50:23.720443 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:23.720443 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:50:23.720443 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:23.720443 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:23.720443 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:23.720443 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:23.720443 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:23.720443 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:23.721589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:23.721589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:23.721589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:23.721589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:23.721589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:23.721589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:23.721589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:50:23.721589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:50:23.721589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:50:23.721589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:50:23.721589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:23.721589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:23.721589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:23.721589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:23.721589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:23.721589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:23.722687 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:23.722687 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:23.722687 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:23.722687 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:23.722687 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:23.722687 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:23.722687 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:23.722687 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:23.722687 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:23.722687 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:23.722687 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:50:23.722687 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:50:23.722687 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 08:50:23.722687 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:23.722687 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 483/1013] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:50:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:23.732793 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a8fb1-e216-423e-a89c-4723a002d814 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:23.851668 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a8fb1-e216-423e-a89c-4723a002d814 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:23.869509 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:23.892469 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892603c-b9ed-4a76-9ec5-4314e6d914ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:23.893265 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892603c-b9ed-4a76-9ec5-4314e6d914ec None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:23.893468 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892603c-b9ed-4a76-9ec5-4314e6d914ec None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:23.893678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892603c-b9ed-4a76-9ec5-4314e6d914ec None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:23.894378 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892603c-b9ed-4a76-9ec5-4314e6d914ec None admin] RBAC: Adding query filter params (name=compute) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:23.894681 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892603c-b9ed-4a76-9ec5-4314e6d914ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:23.896272 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892603c-b9ed-4a76-9ec5-4314e6d914ec None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:23.902684 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 531/1014] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Aug 2 08:50:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:23.908652 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e04362-7c3d-432e-b680-099eb4eea6e8 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:23.985403 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:24.026613 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e04362-7c3d-432e-b680-099eb4eea6e8 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:24.066214 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18bcf24-54bd-4af1-bd97-e66608816eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:24.066844 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bcf24-54bd-4af1-bd97-e66608816eca None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:24.067889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bcf24-54bd-4af1-bd97-e66608816eca None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:24.068182 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bcf24-54bd-4af1-bd97-e66608816eca None admin] PATH_INFO: `/v3/services` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:24.068880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18bcf24-54bd-4af1-bd97-e66608816eca None admin] RBAC: Adding query filter params (type=compute) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:24.069429 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18bcf24-54bd-4af1-bd97-e66608816eca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:24.070541 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18bcf24-54bd-4af1-bd97-e66608816eca None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:24.075969 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 484/1015] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Aug 2 08:50:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:24.082017 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892603c-b9ed-4a76-9ec5-4314e6d914ec None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:24.189801 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892603c-b9ed-4a76-9ec5-4314e6d914ec None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:24.226957 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076acae1-1516-4b8e-869b-aacd7e22c848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:24.227681 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076acae1-1516-4b8e-869b-aacd7e22c848 None admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:24.227968 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076acae1-1516-4b8e-869b-aacd7e22c848 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:24.228276 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076acae1-1516-4b8e-869b-aacd7e22c848 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:24.228993 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076acae1-1516-4b8e-869b-aacd7e22c848 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:24.230435 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076acae1-1516-4b8e-869b-aacd7e22c848 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:24.314796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 532/1016] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 08:50:24 2022] POST /identity/v3/endpoints => generated 334 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:50:24.975341 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5f28b-a69f-45c1-8158-2c52a0dcb9d5 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:24.975718 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5f28b-a69f-45c1-8158-2c52a0dcb9d5 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:24.975904 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5f28b-a69f-45c1-8158-2c52a0dcb9d5 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:24.977533 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 485/1017] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:50:24.982680 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f65285-46fe-484c-a38c-0329e0e8c0c9 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:24.983134 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f65285-46fe-484c-a38c-0329e0e8c0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:24.983228 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f65285-46fe-484c-a38c-0329e0e8c0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:25.002266 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-e2f65285-46fe-484c-a38c-0329e0e8c0c9 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:25.003454 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-e2f65285-46fe-484c-a38c-0329e0e8c0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:25.031984 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:25.084566 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 533/1018] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:24 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:50:25.107196 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5f28b-a69f-45c1-8158-2c52a0dcb9d5 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:25.217264 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5f28b-a69f-45c1-8158-2c52a0dcb9d5 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:25.257709 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8d2f0-0bb4-43a7-962f-d5019a3187ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:25.258449 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8d2f0-0bb4-43a7-962f-d5019a3187ad None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:25.258738 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8d2f0-0bb4-43a7-962f-d5019a3187ad None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:25.259015 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8d2f0-0bb4-43a7-962f-d5019a3187ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:25.260231 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8d2f0-0bb4-43a7-962f-d5019a3187ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:25.261670 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8d2f0-0bb4-43a7-962f-d5019a3187ad None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:25.268306 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 486/1019] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:50:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:25.269437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f65285-46fe-484c-a38c-0329e0e8c0c9 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:25.380273 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f65285-46fe-484c-a38c-0329e0e8c0c9 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:25.423557 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602aa280-99fd-4dcf-8656-7169dcf029a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:25.424218 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602aa280-99fd-4dcf-8656-7169dcf029a6 None admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:25.424504 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602aa280-99fd-4dcf-8656-7169dcf029a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:25.424779 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602aa280-99fd-4dcf-8656-7169dcf029a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:25.425486 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602aa280-99fd-4dcf-8656-7169dcf029a6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:25.427567 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602aa280-99fd-4dcf-8656-7169dcf029a6 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:25.575996 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 534/1020] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Aug 2 08:50:25 2022] POST /identity/v3/projects => generated 311 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:50:25.606043 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00493e76-95b5-4222-86c1-8a93d152c297 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:25.606330 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00493e76-95b5-4222-86c1-8a93d152c297 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:25.606617 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00493e76-95b5-4222-86c1-8a93d152c297 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:25.608061 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 487/1021] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:50:25.614834 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a7b75-cfa2-48da-ab8b-c3e1e8cd5fcc None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:25.615121 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a7b75-cfa2-48da-ab8b-c3e1e8cd5fcc None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:25.615407 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a7b75-cfa2-48da-ab8b-c3e1e8cd5fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:25.636810 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-536a7b75-cfa2-48da-ab8b-c3e1e8cd5fcc None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:25.638059 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-536a7b75-cfa2-48da-ab8b-c3e1e8cd5fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:25.646807 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:25.717870 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 535/1022] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:50:25.748426 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00493e76-95b5-4222-86c1-8a93d152c297 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:25.752094 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:25.868651 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00493e76-95b5-4222-86c1-8a93d152c297 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:25.912463 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ae0ed-d94d-4da6-bbbb-51cc653ee3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:25.913582 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ae0ed-d94d-4da6-bbbb-51cc653ee3cc None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:25.914074 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ae0ed-d94d-4da6-bbbb-51cc653ee3cc None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:25.914549 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ae0ed-d94d-4da6-bbbb-51cc653ee3cc None admin] PATH_INFO: `/v3/services/image` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:25.915716 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ae0ed-d94d-4da6-bbbb-51cc653ee3cc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:25.918386 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ae0ed-d94d-4da6-bbbb-51cc653ee3cc None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:25.936413 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-1c9ae0ed-d94d-4da6-bbbb-51cc653ee3cc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 08:50:25.936413 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:25.936413 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:50:25.936413 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:50:25.936413 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:50:25.936413 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:50:25.936413 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:50:25.936413 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:50:25.936413 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 08:50:25.936413 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:25.936413 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:50:25.936413 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:25.936413 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:25.936413 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:25.936413 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:25.936413 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:25.936413 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:25.937500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:25.937500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:25.937500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:25.937500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:25.937500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:25.937500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:25.937500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:50:25.937500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:50:25.937500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:50:25.937500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:50:25.937500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:25.937500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:25.937500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:25.937500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:25.937500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:25.937500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:25.938390 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:25.938390 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:25.938390 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:25.938390 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:25.938390 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:25.938390 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:25.938390 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:25.938390 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:25.938390 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:25.938390 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:25.938390 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:50:25.938390 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:50:25.938390 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 08:50:25.938390 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:25.939726 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 488/1023] 10.222.0.20 () {56 vars in 1105 bytes} [Tue Aug 2 08:50:25 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:25.948827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a7b75-cfa2-48da-ab8b-c3e1e8cd5fcc None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:26.092035 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a7b75-cfa2-48da-ab8b-c3e1e8cd5fcc None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:26.141868 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e605d-da2d-4eab-a21e-7c03a2f22303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:26.142922 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e605d-da2d-4eab-a21e-7c03a2f22303 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:26.143434 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e605d-da2d-4eab-a21e-7c03a2f22303 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:26.143914 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e605d-da2d-4eab-a21e-7c03a2f22303 None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:26.145231 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e605d-da2d-4eab-a21e-7c03a2f22303 None admin] RBAC: Adding query filter params (name=image) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:26.145758 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e605d-da2d-4eab-a21e-7c03a2f22303 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:26.147372 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e605d-da2d-4eab-a21e-7c03a2f22303 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:26.154001 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 536/1024] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:50:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:26.159685 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ae0ed-d94d-4da6-bbbb-51cc653ee3cc None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:26.236957 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:26.292205 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ae0ed-d94d-4da6-bbbb-51cc653ee3cc None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:26.347094 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5234e9-f9c1-4b55-bc00-5755bf05d88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:26.347726 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5234e9-f9c1-4b55-bc00-5755bf05d88d None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:26.348076 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5234e9-f9c1-4b55-bc00-5755bf05d88d None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:26.348375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5234e9-f9c1-4b55-bc00-5755bf05d88d None admin] PATH_INFO: `/v3/services` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:26.349229 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5234e9-f9c1-4b55-bc00-5755bf05d88d None admin] RBAC: Adding query filter params (type=image) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:26.349532 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5234e9-f9c1-4b55-bc00-5755bf05d88d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:26.350912 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5234e9-f9c1-4b55-bc00-5755bf05d88d None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:26.356776 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 489/1025] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:50:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:26.364204 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e605d-da2d-4eab-a21e-7c03a2f22303 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:26.375169 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:26.485751 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f4bad-39e0-4b03-b123-f04d9fd5afc9 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:26.486089 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f4bad-39e0-4b03-b123-f04d9fd5afc9 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:26.486317 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f4bad-39e0-4b03-b123-f04d9fd5afc9 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:26.487219 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e605d-da2d-4eab-a21e-7c03a2f22303 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:26.487980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 490/1026] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:50:26.495028 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f9404-dd3e-4f63-87f5-6ff9c0ed31aa None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:26.495304 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f9404-dd3e-4f63-87f5-6ff9c0ed31aa None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:26.495577 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f9404-dd3e-4f63-87f5-6ff9c0ed31aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:26.518440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-960f9404-dd3e-4f63-87f5-6ff9c0ed31aa None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:26.519662 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-960f9404-dd3e-4f63-87f5-6ff9c0ed31aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:26.535028 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39b443-cb39-4ec1-b899-23ff6c0d7982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:26.535855 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39b443-cb39-4ec1-b899-23ff6c0d7982 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:26.536394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39b443-cb39-4ec1-b899-23ff6c0d7982 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:26.536676 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39b443-cb39-4ec1-b899-23ff6c0d7982 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:26.537937 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39b443-cb39-4ec1-b899-23ff6c0d7982 None admin] RBAC: Adding query filter params (interface=public, service_id=41c219f4411b460ebded2fb6902ee305, region_id=RegionOne) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:26.538512 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39b443-cb39-4ec1-b899-23ff6c0d7982 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:26.540209 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39b443-cb39-4ec1-b899-23ff6c0d7982 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:26.546110 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 537/1027] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Aug 2 08:50:26 2022] GET /identity/v3/endpoints?service_id=41c219f4411b460ebded2fb6902ee305&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:26.552606 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39b443-cb39-4ec1-b899-23ff6c0d7982 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:26.604092 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 491/1028] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:26 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:50:26.628726 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f9404-dd3e-4f63-87f5-6ff9c0ed31aa None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:26.635784 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:26.672775 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39b443-cb39-4ec1-b899-23ff6c0d7982 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:26.710128 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:26.716817 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb0663-0f85-40d4-90ba-cf2410bf2d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:26.717468 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb0663-0f85-40d4-90ba-cf2410bf2d3e None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:26.717754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb0663-0f85-40d4-90ba-cf2410bf2d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:26.718022 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb0663-0f85-40d4-90ba-cf2410bf2d3e None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:26.718684 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb0663-0f85-40d4-90ba-cf2410bf2d3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:26.720189 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb0663-0f85-40d4-90ba-cf2410bf2d3e None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:26.736297 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 538/1029] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Aug 2 08:50:26 2022] GET /identity/v3/services => generated 1957 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:50:26.778915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f9404-dd3e-4f63-87f5-6ff9c0ed31aa None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:26.825151 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066bafe1-6881-481d-adbb-26170560fbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:26.825868 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066bafe1-6881-481d-adbb-26170560fbec None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:26.826152 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066bafe1-6881-481d-adbb-26170560fbec None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:26.826437 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066bafe1-6881-481d-adbb-26170560fbec None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:26.840534 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066bafe1-6881-481d-adbb-26170560fbec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:50:26.845738 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-066bafe1-6881-481d-adbb-26170560fbec None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:50:26.845738 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:26.845738 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:26.845738 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:26.845738 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:26.845738 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:26.845738 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:26.845738 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:26.845738 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:26.845738 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:26.845738 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:26.845738 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:26.845738 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:50:26.845738 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:50:26.845738 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:50:26.845738 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:50:26.846781 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:50:26.846781 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:50:26.846781 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:50:26.846781 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:50:26.846781 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:26.846781 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:26.846781 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:26.846781 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:26.846781 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:26.846781 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:26.846781 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:26.846781 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:26.846781 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:26.846781 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:26.846781 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:26.846781 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:26.848440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:26.848440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:26.848440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:26.848440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:26.848440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:50:26.848440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:50:26.848440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:50:26.848440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:50:26.848440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:50:26.848440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:50:26.848440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:50:26.848440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:26.848440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 492/1030] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Aug 2 08:50:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:26.854135 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb0663-0f85-40d4-90ba-cf2410bf2d3e None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:26.970522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb0663-0f85-40d4-90ba-cf2410bf2d3e None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:27.010943 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b26ec-b017-4983-b021-3bfd115d3d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:27.011501 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b26ec-b017-4983-b021-3bfd115d3d94 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:27.011818 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b26ec-b017-4983-b021-3bfd115d3d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:27.012095 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b26ec-b017-4983-b021-3bfd115d3d94 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:27.012859 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b26ec-b017-4983-b021-3bfd115d3d94 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:27.013166 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b26ec-b017-4983-b021-3bfd115d3d94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:27.014562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b26ec-b017-4983-b021-3bfd115d3d94 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:27.016425 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:27.026959 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 539/1031] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Aug 2 08:50:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:27.033126 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066bafe1-6881-481d-adbb-26170560fbec None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:27.171802 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066bafe1-6881-481d-adbb-26170560fbec None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:27.200297 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:27.215538 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bb0cd-8afe-4cff-afed-3f424fe674f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:27.216214 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bb0cd-8afe-4cff-afed-3f424fe674f9 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:27.216495 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bb0cd-8afe-4cff-afed-3f424fe674f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:27.216766 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bb0cd-8afe-4cff-afed-3f424fe674f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:27.227912 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390bb0cd-8afe-4cff-afed-3f424fe674f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:27.229428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390bb0cd-8afe-4cff-afed-3f424fe674f9 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:27.246498 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-390bb0cd-8afe-4cff-afed-3f424fe674f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:50:27.246498 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:27.246498 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:27.246498 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:27.246498 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:27.246498 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:27.246498 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:27.246498 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:27.246498 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:27.246498 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:27.246498 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:27.246498 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:27.246498 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:50:27.246498 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:50:27.246498 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:50:27.247513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:50:27.247513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:27.247513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:27.247513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:27.247513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:27.247513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:27.247513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:27.247513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:27.247513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:27.247513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:27.247513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:27.247513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:27.247513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:27.247513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:27.247513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:27.247513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:27.247513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:27.248653 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:50:27.248653 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:50:27.248653 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:50:27.248653 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:27.248653 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 493/1032] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:50:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:50:27.253857 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b26ec-b017-4983-b021-3bfd115d3d94 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:27.369622 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b26ec-b017-4983-b021-3bfd115d3d94 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:27.408607 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454852a7-66b8-4c22-8e3f-2b6de1f1f4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:27.409237 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454852a7-66b8-4c22-8e3f-2b6de1f1f4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:27.409512 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454852a7-66b8-4c22-8e3f-2b6de1f1f4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:27.409780 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454852a7-66b8-4c22-8e3f-2b6de1f1f4d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:27.411043 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454852a7-66b8-4c22-8e3f-2b6de1f1f4d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:27.411348 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454852a7-66b8-4c22-8e3f-2b6de1f1f4d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:27.412766 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454852a7-66b8-4c22-8e3f-2b6de1f1f4d7 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:27.432283 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 540/1033] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:27.434116 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bb0cd-8afe-4cff-afed-3f424fe674f9 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:27.599629 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bb0cd-8afe-4cff-afed-3f424fe674f9 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:27.656484 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e8b63-d9e8-4755-bbcd-38abc9066854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:27.657552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e8b63-d9e8-4755-bbcd-38abc9066854 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:27.658027 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e8b63-d9e8-4755-bbcd-38abc9066854 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:27.658500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e8b63-d9e8-4755-bbcd-38abc9066854 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:27.671203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e8b63-d9e8-4755-bbcd-38abc9066854 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:27.673503 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e8b63-d9e8-4755-bbcd-38abc9066854 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:27.694702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-e92e8b63-d9e8-4755-bbcd-38abc9066854 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:50:27.694702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:27.694702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:27.694702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:27.694702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:27.694702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:27.694702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:27.694702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:27.694702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:27.694702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:27.694702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:27.694702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:27.694702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:50:27.694702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:50:27.694702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:50:27.694702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:50:27.695702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:27.695702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:27.695702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:50:27.695702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:50:27.695702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:50:27.695702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:50:27.695702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:27.695702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:27.695702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:27.695702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:27.695702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:27.695702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:27.695702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:27.695702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:27.695702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:27.695702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:27.695702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:27.695702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:27.702222 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:27.702222 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:27.702222 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:50:27.702222 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:50:27.702222 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:50:27.702222 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:50:27.702222 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:50:27.702222 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:50:27.702222 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:50:27.702222 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:27.702222 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 494/1034] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Aug 2 08:50:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:27.704478 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454852a7-66b8-4c22-8e3f-2b6de1f1f4d7 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:27.766522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:27.813118 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454852a7-66b8-4c22-8e3f-2b6de1f1f4d7 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:27.817515 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e895b27-618b-42e4-8140-d478021a6646 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:27.817834 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e895b27-618b-42e4-8140-d478021a6646 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:27.818057 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e895b27-618b-42e4-8140-d478021a6646 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:27.819609 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 495/1035] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:50:27.824729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7bf85-a2f5-46ce-9191-a216bdacbc66 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:27.825048 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7bf85-a2f5-46ce-9191-a216bdacbc66 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:27.825286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7bf85-a2f5-46ce-9191-a216bdacbc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:27.843500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-f7c7bf85-a2f5-46ce-9191-a216bdacbc66 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:27.844729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-f7c7bf85-a2f5-46ce-9191-a216bdacbc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:27.851505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f66a3-9d39-4c62-a77b-422f0f0c8aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:27.852071 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f66a3-9d39-4c62-a77b-422f0f0c8aaf None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:27.852381 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f66a3-9d39-4c62-a77b-422f0f0c8aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:27.852660 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f66a3-9d39-4c62-a77b-422f0f0c8aaf None admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:27.853467 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f66a3-9d39-4c62-a77b-422f0f0c8aaf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:27.853778 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f66a3-9d39-4c62-a77b-422f0f0c8aaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:27.855253 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f66a3-9d39-4c62-a77b-422f0f0c8aaf None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:27.873743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:27.879983 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 541/1036] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Aug 2 08:50:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:27.882225 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f66a3-9d39-4c62-a77b-422f0f0c8aaf None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:27.927141 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 496/1037] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:50:27.951614 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7bf85-a2f5-46ce-9191-a216bdacbc66 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:28.000440 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f66a3-9d39-4c62-a77b-422f0f0c8aaf None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:28.016210 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:28.039643 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fa054-8f04-48f3-be9a-6b7f92be8c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:28.040300 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fa054-8f04-48f3-be9a-6b7f92be8c97 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:28.040587 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fa054-8f04-48f3-be9a-6b7f92be8c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:28.040855 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fa054-8f04-48f3-be9a-6b7f92be8c97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:28.064820 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7bf85-a2f5-46ce-9191-a216bdacbc66 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:28.101760 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80237709-b73f-454e-a696-50842b9bb015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:28.102331 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80237709-b73f-454e-a696-50842b9bb015 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:28.102620 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80237709-b73f-454e-a696-50842b9bb015 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:28.102893 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80237709-b73f-454e-a696-50842b9bb015 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:28.104075 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80237709-b73f-454e-a696-50842b9bb015 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:28.105550 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80237709-b73f-454e-a696-50842b9bb015 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:28.107483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 497/1038] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:50:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:28.112921 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80237709-b73f-454e-a696-50842b9bb015 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:28.118996 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396fa054-8f04-48f3-be9a-6b7f92be8c97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:28.120488 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396fa054-8f04-48f3-be9a-6b7f92be8c97 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:28.145533 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:28.224428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80237709-b73f-454e-a696-50842b9bb015 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:28.237647 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 542/1039] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:50:27 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 08:50:28.243219 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fa054-8f04-48f3-be9a-6b7f92be8c97 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:28.261806 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:28.272290 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd3c8f-94f0-41f0-a5f1-39ffe6813fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:28.275493 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd3c8f-94f0-41f0-a5f1-39ffe6813fe9 None admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:28.275493 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd3c8f-94f0-41f0-a5f1-39ffe6813fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:28.275493 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd3c8f-94f0-41f0-a5f1-39ffe6813fe9 None admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:28.275493 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd3c8f-94f0-41f0-a5f1-39ffe6813fe9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:28.276978 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd3c8f-94f0-41f0-a5f1-39ffe6813fe9 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:28.387662 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fa054-8f04-48f3-be9a-6b7f92be8c97 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:28.414646 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 498/1040] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Aug 2 08:50:28 2022] POST /identity/v3/users => generated 285 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:50:28.444143 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6ae7b-64e6-42ce-be68-26bc6e08d0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:28.444843 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6ae7b-64e6-42ce-be68-26bc6e08d0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:28.445124 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6ae7b-64e6-42ce-be68-26bc6e08d0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:28.445395 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6ae7b-64e6-42ce-be68-26bc6e08d0c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:28.458205 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6ae7b-64e6-42ce-be68-26bc6e08d0c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:28.460076 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6ae7b-64e6-42ce-be68-26bc6e08d0c2 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:28.477777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-54a6ae7b-64e6-42ce-be68-26bc6e08d0c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:50:28.477777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:28.477777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:28.477777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:28.477777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:28.477777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:28.477777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:28.477777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:28.477777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:28.477777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:28.477777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:28.477777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:28.477777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:50:28.477777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:50:28.477777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:50:28.478771 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:50:28.478771 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:28.478771 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:28.478771 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:28.478771 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:28.478771 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:28.478771 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:28.478771 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:28.478771 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:28.478771 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:28.478771 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:28.478771 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:28.478771 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:28.478771 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:28.478771 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:28.478771 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:28.478771 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:28.485125 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:50:28.485125 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:50:28.485125 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:50:28.485125 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:28.485125 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 543/1041] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:50:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:50:28.485452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd3c8f-94f0-41f0-a5f1-39ffe6813fe9 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:28.587443 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:28.603305 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd3c8f-94f0-41f0-a5f1-39ffe6813fe9 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:28.641184 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea97cfe-3dd1-42b6-9a8a-6c5ff1e710d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:28.641741 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea97cfe-3dd1-42b6-9a8a-6c5ff1e710d7 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:28.642028 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea97cfe-3dd1-42b6-9a8a-6c5ff1e710d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:28.642310 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea97cfe-3dd1-42b6-9a8a-6c5ff1e710d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:28.643009 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea97cfe-3dd1-42b6-9a8a-6c5ff1e710d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:28.643319 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea97cfe-3dd1-42b6-9a8a-6c5ff1e710d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:28.645370 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea97cfe-3dd1-42b6-9a8a-6c5ff1e710d7 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:28.659220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 499/1042] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:28.665861 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6ae7b-64e6-42ce-be68-26bc6e08d0c2 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:28.784923 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:28.823061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6ae7b-64e6-42ce-be68-26bc6e08d0c2 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:28.859444 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0765394-8630-4371-abc9-dc3f0e072aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:28.860101 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0765394-8630-4371-abc9-dc3f0e072aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:28.860445 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0765394-8630-4371-abc9-dc3f0e072aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:28.860725 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0765394-8630-4371-abc9-dc3f0e072aa2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:28.868757 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0765394-8630-4371-abc9-dc3f0e072aa2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:28.870221 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0765394-8630-4371-abc9-dc3f0e072aa2 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:28.883090 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-f0765394-8630-4371-abc9-dc3f0e072aa2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:50:28.883090 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:28.883090 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:28.883090 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:28.883090 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:28.883090 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:28.883090 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:28.883090 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:28.883090 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:28.883090 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:28.883090 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:28.883090 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:28.883090 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:50:28.883090 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:50:28.883090 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:50:28.884398 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:50:28.884398 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:28.884398 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:28.884398 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:28.884398 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:28.884398 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:28.884398 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:28.884398 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:28.884398 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:28.884398 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:28.884398 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:28.884398 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:28.884398 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:28.884398 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:28.884398 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:28.884398 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:28.884398 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:28.886199 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:50:28.886199 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:50:28.886199 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:50:28.886199 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:50:28.886199 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:50:28.886199 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:50:28.886199 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:50:28.886199 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:28.888266 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 544/1043] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:50:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:28.890506 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea97cfe-3dd1-42b6-9a8a-6c5ff1e710d7 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:29.007074 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea97cfe-3dd1-42b6-9a8a-6c5ff1e710d7 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:29.043944 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2aa315-da57-4ab7-8719-c6aeb50951c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:29.044604 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2aa315-da57-4ab7-8719-c6aeb50951c8 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:29.044886 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2aa315-da57-4ab7-8719-c6aeb50951c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:29.045165 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2aa315-da57-4ab7-8719-c6aeb50951c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:29.045931 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2aa315-da57-4ab7-8719-c6aeb50951c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:29.046241 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2aa315-da57-4ab7-8719-c6aeb50951c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:29.047677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2aa315-da57-4ab7-8719-c6aeb50951c8 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:29.066725 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 500/1044] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:50:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:29.068197 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0765394-8630-4371-abc9-dc3f0e072aa2 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:29.085427 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71f77a-b5ac-4e17-8287-5a8c67271549 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:29.085427 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71f77a-b5ac-4e17-8287-5a8c67271549 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:29.085935 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71f77a-b5ac-4e17-8287-5a8c67271549 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:29.087471 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 501/1045] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:50:29.092528 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58e5af-fcf0-4ceb-a20c-6dd29a553195 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:29.092817 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58e5af-fcf0-4ceb-a20c-6dd29a553195 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:29.093097 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58e5af-fcf0-4ceb-a20c-6dd29a553195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:29.108023 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:29.115873 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-6f58e5af-fcf0-4ceb-a20c-6dd29a553195 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:29.117137 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-6f58e5af-fcf0-4ceb-a20c-6dd29a553195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:29.184087 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0765394-8630-4371-abc9-dc3f0e072aa2 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:29.190987 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 502/1046] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:50:29.212257 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:29.213709 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58e5af-fcf0-4ceb-a20c-6dd29a553195 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:29.222232 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73019b-d707-4ff3-8156-975d8235ada8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:29.226982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73019b-d707-4ff3-8156-975d8235ada8 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:29.226982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73019b-d707-4ff3-8156-975d8235ada8 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:29.226982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73019b-d707-4ff3-8156-975d8235ada8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:29.226982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73019b-d707-4ff3-8156-975d8235ada8 None admin] RBAC: Adding query filter params (role.id=bfacecd6591f4b43ab2b69bda06ea9b0, scope.project.id=6910e69702854607889bab124edd60c9, user.id=7bfcddefa71546d28078a38325c723a9) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:29.226982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73019b-d707-4ff3-8156-975d8235ada8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:29.227436 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73019b-d707-4ff3-8156-975d8235ada8 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:29.241738 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 545/1047] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:50:29 2022] GET /identity/v3/role_assignments?user.id=7bfcddefa71546d28078a38325c723a9&scope.project.id=6910e69702854607889bab124edd60c9&role.id=bfacecd6591f4b43ab2b69bda06ea9b0 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:29.348472 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58e5af-fcf0-4ceb-a20c-6dd29a553195 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:29.395382 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54932f-d20c-443c-b6ae-81571d1971e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:29.396337 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54932f-d20c-443c-b6ae-81571d1971e8 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:29.396625 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54932f-d20c-443c-b6ae-81571d1971e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:29.397038 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54932f-d20c-443c-b6ae-81571d1971e8 None admin] PATH_INFO: `/v3/services/image` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:29.397593 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54932f-d20c-443c-b6ae-81571d1971e8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:29.398908 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54932f-d20c-443c-b6ae-81571d1971e8 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:29.402343 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:29.422274 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-3e54932f-d20c-443c-b6ae-81571d1971e8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 08:50:29.422274 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:29.422274 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:50:29.422274 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:50:29.422274 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:50:29.422274 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:50:29.422274 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:50:29.422274 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:50:29.422274 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 08:50:29.422274 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:29.422274 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:50:29.422274 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:29.422274 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:29.422274 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:29.422274 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:29.422274 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:29.422274 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:29.424483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:29.424483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:29.424483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:29.424483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:29.424483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:29.424483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:29.424483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:50:29.424483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:50:29.424483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:50:29.424483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:50:29.424483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:29.424483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:29.424483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:29.424483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:29.424483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:29.424483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:29.425375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:29.425375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:29.425375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:29.425375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:29.425375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:29.425375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:29.425375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:29.425375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:29.425375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:29.425375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:29.425375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:50:29.425375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:50:29.425375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 08:50:29.425375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:29.428259 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 503/1048] 10.222.0.20 () {56 vars in 1105 bytes} [Tue Aug 2 08:50:29 2022] GET /identity/v3/services/image => generated 86 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:29.430977 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73019b-d707-4ff3-8156-975d8235ada8 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:29.547334 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73019b-d707-4ff3-8156-975d8235ada8 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:29.585841 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07fb09-1663-4bd5-8167-773188a9de79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:29.586485 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07fb09-1663-4bd5-8167-773188a9de79 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:29.586766 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07fb09-1663-4bd5-8167-773188a9de79 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:29.587042 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07fb09-1663-4bd5-8167-773188a9de79 None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:29.587739 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07fb09-1663-4bd5-8167-773188a9de79 None admin] RBAC: Adding query filter params (name=image) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:29.588043 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07fb09-1663-4bd5-8167-773188a9de79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:29.589468 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07fb09-1663-4bd5-8167-773188a9de79 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:29.600211 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 546/1049] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:50:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:29.601878 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54932f-d20c-443c-b6ae-81571d1971e8 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:29.752112 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54932f-d20c-443c-b6ae-81571d1971e8 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:29.790297 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136c718-e1e4-4848-b214-8cac990ddcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:29.790918 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136c718-e1e4-4848-b214-8cac990ddcf2 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:29.791194 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136c718-e1e4-4848-b214-8cac990ddcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:29.791466 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136c718-e1e4-4848-b214-8cac990ddcf2 None admin] PATH_INFO: `/v3/services` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:29.792144 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136c718-e1e4-4848-b214-8cac990ddcf2 None admin] RBAC: Adding query filter params (type=image) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:29.792468 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136c718-e1e4-4848-b214-8cac990ddcf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:29.793844 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136c718-e1e4-4848-b214-8cac990ddcf2 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:29.799892 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 504/1050] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:50:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:29.806332 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07fb09-1663-4bd5-8167-773188a9de79 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:29.872272 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:29.938093 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07fb09-1663-4bd5-8167-773188a9de79 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:29.975460 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598b7b8-ba34-41d2-b70c-f9fac0803a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:29.976104 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598b7b8-ba34-41d2-b70c-f9fac0803a4e None admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:29.976413 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598b7b8-ba34-41d2-b70c-f9fac0803a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:29.976693 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598b7b8-ba34-41d2-b70c-f9fac0803a4e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:29.977432 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598b7b8-ba34-41d2-b70c-f9fac0803a4e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:29.978876 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598b7b8-ba34-41d2-b70c-f9fac0803a4e None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:30.068083 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 547/1051] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 08:50:29 2022] POST /identity/v3/endpoints => generated 327 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:50:30.569018 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dfa3d-285c-4fe5-88ce-39291e2986a7 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:30.569549 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dfa3d-285c-4fe5-88ce-39291e2986a7 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:30.569780 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dfa3d-285c-4fe5-88ce-39291e2986a7 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:30.571073 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 505/1052] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:50:30.576965 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a12dc-ad77-4dff-b7f8-0bf4926c4193 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:30.577570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a12dc-ad77-4dff-b7f8-0bf4926c4193 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:30.577570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a12dc-ad77-4dff-b7f8-0bf4926c4193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:30.596933 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-bb3a12dc-ad77-4dff-b7f8-0bf4926c4193 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:30.598187 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-bb3a12dc-ad77-4dff-b7f8-0bf4926c4193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:30.688242 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 548/1053] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:50:30.712064 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7dfa3d-285c-4fe5-88ce-39291e2986a7 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:30.793549 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:30.842902 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7dfa3d-285c-4fe5-88ce-39291e2986a7 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:30.886138 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d7839-bb08-4207-8549-c3d9e2b72b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:30.886811 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d7839-bb08-4207-8549-c3d9e2b72b3a None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:30.887095 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d7839-bb08-4207-8549-c3d9e2b72b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:30.887377 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d7839-bb08-4207-8549-c3d9e2b72b3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:30.901022 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d7839-bb08-4207-8549-c3d9e2b72b3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:50:30.906522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-f35d7839-bb08-4207-8549-c3d9e2b72b3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:50:30.906522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:30.906522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:30.906522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:30.906522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:30.906522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:30.906522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:30.906522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:30.906522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:30.906522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:30.906522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:30.906522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:30.906522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:50:30.906522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:50:30.906522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:50:30.906522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:50:30.907552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:50:30.907552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:50:30.907552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:50:30.907552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:50:30.907552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:30.907552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:30.907552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:30.907552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:30.907552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:30.907552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:30.907552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:30.907552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:30.907552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:30.907552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:30.907552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:30.907552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:30.909239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:30.909239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:30.909239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:30.909239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:30.909239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:50:30.909239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:50:30.909239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:50:30.909239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:50:30.909239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:50:30.909239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:50:30.909239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:50:30.909239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:30.912598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 506/1054] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:50:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:30.914534 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a12dc-ad77-4dff-b7f8-0bf4926c4193 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:30.958895 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:31.031834 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a12dc-ad77-4dff-b7f8-0bf4926c4193 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:31.070143 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e850af-23be-4c5f-aeee-ab40bd2d9313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:31.070783 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e850af-23be-4c5f-aeee-ab40bd2d9313 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:31.071070 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e850af-23be-4c5f-aeee-ab40bd2d9313 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:31.071351 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e850af-23be-4c5f-aeee-ab40bd2d9313 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:31.072083 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e850af-23be-4c5f-aeee-ab40bd2d9313 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:31.072424 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e850af-23be-4c5f-aeee-ab40bd2d9313 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:31.073844 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e850af-23be-4c5f-aeee-ab40bd2d9313 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:31.087306 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 549/1055] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:50:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:31.088603 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d7839-bb08-4207-8549-c3d9e2b72b3a None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:31.199875 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d7839-bb08-4207-8549-c3d9e2b72b3a None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:31.224408 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:31.236005 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b15c27-a7f2-4046-b7cb-61c8f8197e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:31.237907 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b15c27-a7f2-4046-b7cb-61c8f8197e5d None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:31.237907 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b15c27-a7f2-4046-b7cb-61c8f8197e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:31.237907 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b15c27-a7f2-4046-b7cb-61c8f8197e5d None admin] PATH_INFO: `/v3/users/6d664267e4024ba5a28c46dca0304176` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:31.255028 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b15c27-a7f2-4046-b7cb-61c8f8197e5d None admin] RBAC: Authorizing `identity:get_user(user_id=6d664267e4024ba5a28c46dca0304176)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:31.256554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b15c27-a7f2-4046-b7cb-61c8f8197e5d None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:31.260758 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 507/1056] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:50:31 2022] GET /identity/v3/users/6d664267e4024ba5a28c46dca0304176 => generated 285 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:31.264121 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e850af-23be-4c5f-aeee-ab40bd2d9313 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:31.332676 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ac801-5698-4db8-8271-afc3e15e53ef None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:31.333192 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ac801-5698-4db8-8271-afc3e15e53ef None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:31.333300 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ac801-5698-4db8-8271-afc3e15e53ef None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:31.334628 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 508/1057] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:50:31.340640 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa77727-ee49-40a5-b740-1aa8199af06e None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:31.340640 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa77727-ee49-40a5-b740-1aa8199af06e None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:31.340888 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa77727-ee49-40a5-b740-1aa8199af06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:31.360059 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-1aa77727-ee49-40a5-b740-1aa8199af06e None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:31.361745 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-1aa77727-ee49-40a5-b740-1aa8199af06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:31.374035 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:31.379438 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e850af-23be-4c5f-aeee-ab40bd2d9313 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:31.427850 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254798bb-d84f-4e6d-b75f-42c14c143fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:31.428656 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254798bb-d84f-4e6d-b75f-42c14c143fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:31.428837 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254798bb-d84f-4e6d-b75f-42c14c143fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:31.429112 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254798bb-d84f-4e6d-b75f-42c14c143fa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:31.453141 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 509/1058] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:50:31.465897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa77727-ee49-40a5-b740-1aa8199af06e None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:31.506992 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254798bb-d84f-4e6d-b75f-42c14c143fa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:31.508481 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254798bb-d84f-4e6d-b75f-42c14c143fa6 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:31.576354 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa77727-ee49-40a5-b740-1aa8199af06e None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:31.591346 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:31.614585 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb293b61-4320-40d1-81d7-117e00db69d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:31.615201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:31.615640 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb293b61-4320-40d1-81d7-117e00db69d6 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:31.615640 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb293b61-4320-40d1-81d7-117e00db69d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:31.615811 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb293b61-4320-40d1-81d7-117e00db69d6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:31.620310 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 550/1059] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:50:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:50:31.626342 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254798bb-d84f-4e6d-b75f-42c14c143fa6 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:31.634523 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb293b61-4320-40d1-81d7-117e00db69d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:50:31.641473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-fb293b61-4320-40d1-81d7-117e00db69d6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:50:31.641473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:31.641473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:31.641473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:31.641473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:31.641473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:31.641473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:31.641473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:31.641473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:31.641473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:31.641473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:31.641473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:31.641473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:50:31.641473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:50:31.641473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:50:31.641473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:50:31.642474 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:50:31.642474 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:50:31.642474 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:50:31.642474 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:50:31.642474 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:31.642474 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:31.642474 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:31.642474 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:31.642474 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:31.642474 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:31.642474 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:31.642474 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:31.642474 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:31.642474 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:31.642474 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:31.642474 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:31.643331 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:31.643331 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:31.643331 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:31.643331 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:31.643331 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:50:31.643331 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:50:31.643331 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:50:31.643331 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:50:31.643331 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:50:31.643331 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:50:31.643331 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:50:31.643331 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:31.648529 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 510/1060] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Aug 2 08:50:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:50:31.650311 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb293b61-4320-40d1-81d7-117e00db69d6 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:31.749584 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254798bb-d84f-4e6d-b75f-42c14c143fa6 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:31.763084 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb293b61-4320-40d1-81d7-117e00db69d6 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:31.790301 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01db328-d885-4661-ada8-888bb5ab3953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:31.791235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01db328-d885-4661-ada8-888bb5ab3953 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:31.791513 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01db328-d885-4661-ada8-888bb5ab3953 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:31.791790 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01db328-d885-4661-ada8-888bb5ab3953 None admin] PATH_INFO: `/v3/projects/4cc5ee663d024ca7a96f845a8980eb5b` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:31.793453 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01db328-d885-4661-ada8-888bb5ab3953 None admin] RBAC: Authorizing `identity:get_project(project_id=4cc5ee663d024ca7a96f845a8980eb5b)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:31.795058 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01db328-d885-4661-ada8-888bb5ab3953 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:31.796956 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 551/1061] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:50:31 2022] GET /identity/v3/projects/4cc5ee663d024ca7a96f845a8980eb5b => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:31.803340 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01db328-d885-4661-ada8-888bb5ab3953 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:31.807795 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e49e4-3bd8-4156-a119-ef43ca677eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:31.808450 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e49e4-3bd8-4156-a119-ef43ca677eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:31.808728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e49e4-3bd8-4156-a119-ef43ca677eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:31.808999 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e49e4-3bd8-4156-a119-ef43ca677eb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:31.809721 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e49e4-3bd8-4156-a119-ef43ca677eb5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:31.810016 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e49e4-3bd8-4156-a119-ef43ca677eb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:31.811379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e49e4-3bd8-4156-a119-ef43ca677eb5 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:31.825125 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 511/1062] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Aug 2 08:50:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:31.826187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e49e4-3bd8-4156-a119-ef43ca677eb5 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:31.868834 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:31.885288 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:31.924947 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01db328-d885-4661-ada8-888bb5ab3953 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:31.954229 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e49e4-3bd8-4156-a119-ef43ca677eb5 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:31.968593 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de085bed-fefd-439e-a9cc-29a622943a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:31.969223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de085bed-fefd-439e-a9cc-29a622943a88 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:31.969592 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de085bed-fefd-439e-a9cc-29a622943a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:31.969768 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de085bed-fefd-439e-a9cc-29a622943a88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:31.970559 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de085bed-fefd-439e-a9cc-29a622943a88 None admin] RBAC: Adding query filter params (role.id=b5477d3c4e5a4514b64211ec2452d1d8, scope.project.id=4cc5ee663d024ca7a96f845a8980eb5b, user.id=6d664267e4024ba5a28c46dca0304176) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:31.971178 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de085bed-fefd-439e-a9cc-29a622943a88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:31.972306 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de085bed-fefd-439e-a9cc-29a622943a88 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:31.979209 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 552/1063] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:50:31 2022] GET /identity/v3/role_assignments?user.id=6d664267e4024ba5a28c46dca0304176&scope.project.id=4cc5ee663d024ca7a96f845a8980eb5b&role.id=b5477d3c4e5a4514b64211ec2452d1d8 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:31.996714 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc0857-459e-483f-bcab-d4a48724a948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:31.997393 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc0857-459e-483f-bcab-d4a48724a948 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:31.997669 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc0857-459e-483f-bcab-d4a48724a948 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:31.997940 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc0857-459e-483f-bcab-d4a48724a948 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:32.010869 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc0857-459e-483f-bcab-d4a48724a948 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:32.012309 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc0857-459e-483f-bcab-d4a48724a948 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:32.029417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-0cbc0857-459e-483f-bcab-d4a48724a948 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:50:32.029417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:32.029417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:32.029417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:32.029417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:32.029417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:32.029417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:32.029417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:32.029417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:32.029417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:32.029417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:32.029417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:32.029417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:50:32.029417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:50:32.029417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:50:32.036589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:50:32.036589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:32.036589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:32.036589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:32.036589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:32.036589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:32.036589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:32.036589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:32.036589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:32.036589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:32.036589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:32.036589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:32.036589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:32.036589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:32.036589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:32.036589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:32.036589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:32.037531 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:50:32.037531 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:50:32.037531 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:50:32.037531 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:32.037531 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 512/1064] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:50:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:32.039617 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de085bed-fefd-439e-a9cc-29a622943a88 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:32.158947 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de085bed-fefd-439e-a9cc-29a622943a88 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:32.192522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:32.198494 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bae234-f5e4-4aec-a83e-0a7225a65caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:32.199076 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bae234-f5e4-4aec-a83e-0a7225a65caa None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:32.199349 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bae234-f5e4-4aec-a83e-0a7225a65caa None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:32.207198 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bae234-f5e4-4aec-a83e-0a7225a65caa None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:32.207198 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bae234-f5e4-4aec-a83e-0a7225a65caa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:32.207198 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bae234-f5e4-4aec-a83e-0a7225a65caa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:32.207198 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bae234-f5e4-4aec-a83e-0a7225a65caa None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:32.219444 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 553/1065] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:32.221222 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc0857-459e-483f-bcab-d4a48724a948 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:32.329994 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:32.348279 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc0857-459e-483f-bcab-d4a48724a948 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:32.388032 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf5f31-7816-4529-b4ae-82596c9f6a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:32.388731 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf5f31-7816-4529-b4ae-82596c9f6a50 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:32.389014 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf5f31-7816-4529-b4ae-82596c9f6a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:32.389289 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf5f31-7816-4529-b4ae-82596c9f6a50 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:32.397725 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf5f31-7816-4529-b4ae-82596c9f6a50 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:32.399206 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf5f31-7816-4529-b4ae-82596c9f6a50 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:32.412326 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-bcbf5f31-7816-4529-b4ae-82596c9f6a50 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:50:32.412326 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:32.412326 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:32.412326 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:32.412326 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:32.412326 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:32.412326 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:32.412326 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:32.412326 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:32.412326 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:32.412326 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:32.412326 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:32.412326 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:50:32.412326 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:50:32.412326 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:50:32.412326 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:50:32.413341 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:32.413341 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:32.413341 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:50:32.413341 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:50:32.413341 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:50:32.413341 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:50:32.413341 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:32.413341 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:32.413341 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:32.413341 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:32.413341 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:32.413341 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:32.413341 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:32.413341 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:32.413341 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:32.413341 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:32.413341 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:32.413341 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:32.418968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:32.418968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:32.418968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:50:32.418968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:50:32.418968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:50:32.418968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:50:32.418968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:50:32.418968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:50:32.418968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:50:32.418968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:32.418968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 513/1066] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Aug 2 08:50:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:32.421791 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bae234-f5e4-4aec-a83e-0a7225a65caa None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:32.462423 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5be58-0d8c-4037-8f7a-c161e6b5bf95 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:32.462929 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5be58-0d8c-4037-8f7a-c161e6b5bf95 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:32.463428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5be58-0d8c-4037-8f7a-c161e6b5bf95 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:32.466089 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 514/1067] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:50:32.471869 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d33be-952a-49a5-ad1e-50feb41a6f3a None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:32.472279 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d33be-952a-49a5-ad1e-50feb41a6f3a None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:32.472564 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d33be-952a-49a5-ad1e-50feb41a6f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:32.492893 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-bc3d33be-952a-49a5-ad1e-50feb41a6f3a None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:32.494017 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-bc3d33be-952a-49a5-ad1e-50feb41a6f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:32.543065 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bae234-f5e4-4aec-a83e-0a7225a65caa None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:32.580233 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 515/1068] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:50:32.581530 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be9f62-362d-4ca9-ba61-d1d8478e2f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:32.582351 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be9f62-362d-4ca9-ba61-d1d8478e2f6f None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:32.582701 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be9f62-362d-4ca9-ba61-d1d8478e2f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:32.583046 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be9f62-362d-4ca9-ba61-d1d8478e2f6f None admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:32.583933 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be9f62-362d-4ca9-ba61-d1d8478e2f6f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:32.584447 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be9f62-362d-4ca9-ba61-d1d8478e2f6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:32.585810 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be9f62-362d-4ca9-ba61-d1d8478e2f6f None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:32.603373 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d33be-952a-49a5-ad1e-50feb41a6f3a None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:32.606165 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 554/1069] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Aug 2 08:50:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:32.611808 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be9f62-362d-4ca9-ba61-d1d8478e2f6f None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:32.675266 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:32.712672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:32.736246 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be9f62-362d-4ca9-ba61-d1d8478e2f6f None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:32.744179 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d33be-952a-49a5-ad1e-50feb41a6f3a None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:32.782975 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36377731-a2f0-49ad-b7c8-f84a37d3427d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:32.783747 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36377731-a2f0-49ad-b7c8-f84a37d3427d None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:32.784077 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36377731-a2f0-49ad-b7c8-f84a37d3427d None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:32.784418 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36377731-a2f0-49ad-b7c8-f84a37d3427d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:32.792227 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119f9cf-dbf4-40cd-9cbe-3d782b03ad22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:32.792628 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119f9cf-dbf4-40cd-9cbe-3d782b03ad22 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:32.792830 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119f9cf-dbf4-40cd-9cbe-3d782b03ad22 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:32.793662 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119f9cf-dbf4-40cd-9cbe-3d782b03ad22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:32.802925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36377731-a2f0-49ad-b7c8-f84a37d3427d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:32.805891 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36377731-a2f0-49ad-b7c8-f84a37d3427d None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:32.827846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-36377731-a2f0-49ad-b7c8-f84a37d3427d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:50:32.827846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:32.827846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:32.827846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:32.827846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:32.827846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:32.827846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:32.827846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:32.827846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:32.827846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:32.827846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:32.827846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:32.827846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:50:32.827846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:50:32.827846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:50:32.829711 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:50:32.829711 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:32.829711 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:32.829711 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:32.829711 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:32.829711 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:32.829711 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:32.829711 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:32.829711 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:32.829711 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:32.829711 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:32.829711 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:32.829711 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:32.829711 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:32.829711 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:32.829711 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:32.829711 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:32.831258 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:50:32.831258 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:50:32.831258 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:50:32.831258 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:32.831258 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 555/1070] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:50:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:50:32.838511 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36377731-a2f0-49ad-b7c8-f84a37d3427d None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:32.890481 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3119f9cf-dbf4-40cd-9cbe-3d782b03ad22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:32.892142 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3119f9cf-dbf4-40cd-9cbe-3d782b03ad22 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:32.985261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:32.990129 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36377731-a2f0-49ad-b7c8-f84a37d3427d None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:32.998539 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:33.045240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 516/1071] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:50:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 08:50:33.046576 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119f9cf-dbf4-40cd-9cbe-3d782b03ad22 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:33.052930 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4393e4-eee7-4d84-868f-f4ca27ae2c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:33.053982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4393e4-eee7-4d84-868f-f4ca27ae2c1c None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:33.054139 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4393e4-eee7-4d84-868f-f4ca27ae2c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:33.054488 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4393e4-eee7-4d84-868f-f4ca27ae2c1c None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:33.055339 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4393e4-eee7-4d84-868f-f4ca27ae2c1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:33.055650 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4393e4-eee7-4d84-868f-f4ca27ae2c1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:33.057708 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4393e4-eee7-4d84-868f-f4ca27ae2c1c None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:33.073076 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 556/1072] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:33.078829 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4393e4-eee7-4d84-868f-f4ca27ae2c1c None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:33.187563 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119f9cf-dbf4-40cd-9cbe-3d782b03ad22 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:33.228072 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f768c0-327b-4e49-9fe0-1ddc2274e04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:33.228788 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f768c0-327b-4e49-9fe0-1ddc2274e04d None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:33.229063 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f768c0-327b-4e49-9fe0-1ddc2274e04d None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:33.229337 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f768c0-327b-4e49-9fe0-1ddc2274e04d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:33.241542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f768c0-327b-4e49-9fe0-1ddc2274e04d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:33.243072 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f768c0-327b-4e49-9fe0-1ddc2274e04d None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:33.251271 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4393e4-eee7-4d84-868f-f4ca27ae2c1c None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:33.265587 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-87f768c0-327b-4e49-9fe0-1ddc2274e04d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:50:33.265587 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:33.265587 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:33.265587 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:33.265587 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:33.265587 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:33.265587 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:33.265587 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:33.265587 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:33.265587 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:33.265587 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:33.265587 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:33.265587 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:50:33.265587 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:50:33.265587 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:50:33.267178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:50:33.267178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:33.267178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:33.267178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:33.267178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:33.267178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:33.267178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:33.267178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:33.267178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:33.267178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:33.267178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:33.267178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:33.267178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:33.267178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:33.267178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:33.267178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:33.267178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:33.269431 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:50:33.269431 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:50:33.269431 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:50:33.269431 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:33.274745 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 517/1073] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:50:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:50:33.277474 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f768c0-327b-4e49-9fe0-1ddc2274e04d None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:33.304272 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36e0b8-2b4d-410d-ab97-afed1865c2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:33.305083 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36e0b8-2b4d-410d-ab97-afed1865c2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:33.305452 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36e0b8-2b4d-410d-ab97-afed1865c2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:33.305733 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36e0b8-2b4d-410d-ab97-afed1865c2c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:33.314140 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36e0b8-2b4d-410d-ab97-afed1865c2c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:33.315894 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36e0b8-2b4d-410d-ab97-afed1865c2c8 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:33.320746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:33.331571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-2b36e0b8-2b4d-410d-ab97-afed1865c2c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:50:33.331571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:33.331571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:33.331571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:33.331571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:33.331571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:33.331571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:33.331571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:33.331571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:33.331571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:33.331571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:33.331571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:33.331571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:50:33.331571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:50:33.331571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:50:33.338872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:50:33.338872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:33.338872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:33.338872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:33.338872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:33.338872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:33.338872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:33.338872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:33.338872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:33.338872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:33.338872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:33.338872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:33.338872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:33.338872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:33.338872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:33.338872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:33.338872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:33.339975 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:50:33.339975 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:50:33.339975 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:50:33.339975 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:50:33.339975 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:50:33.339975 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:50:33.339975 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:50:33.339975 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:33.339975 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 557/1074] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:50:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:50:33.342745 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36e0b8-2b4d-410d-ab97-afed1865c2c8 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:33.373790 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:33.430060 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f768c0-327b-4e49-9fe0-1ddc2274e04d None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:33.469762 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36e0b8-2b4d-410d-ab97-afed1865c2c8 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:33.473486 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c6d29-32de-4b73-927d-0e38f565180d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:33.474317 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c6d29-32de-4b73-927d-0e38f565180d None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:33.474638 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c6d29-32de-4b73-927d-0e38f565180d None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:33.475042 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c6d29-32de-4b73-927d-0e38f565180d None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:33.475771 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c6d29-32de-4b73-927d-0e38f565180d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:33.476136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c6d29-32de-4b73-927d-0e38f565180d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:33.477652 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c6d29-32de-4b73-927d-0e38f565180d None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:33.498307 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 518/1075] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:33.528058 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ec4c5-d794-425d-8c2c-fd54410d8cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:33.529050 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ec4c5-d794-425d-8c2c-fd54410d8cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:33.529330 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ec4c5-d794-425d-8c2c-fd54410d8cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:33.529607 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ec4c5-d794-425d-8c2c-fd54410d8cc7 None admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:33.530422 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ec4c5-d794-425d-8c2c-fd54410d8cc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:33.530729 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ec4c5-d794-425d-8c2c-fd54410d8cc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:33.532344 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ec4c5-d794-425d-8c2c-fd54410d8cc7 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:33.554013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 558/1076] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:50:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:33.556409 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c6d29-32de-4b73-927d-0e38f565180d None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:33.680910 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:33.699107 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c6d29-32de-4b73-927d-0e38f565180d None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:33.739316 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fecc9d-c6ed-43f2-b08e-c90b99a92d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:33.740015 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fecc9d-c6ed-43f2-b08e-c90b99a92d74 None admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:33.740331 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fecc9d-c6ed-43f2-b08e-c90b99a92d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:33.740611 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fecc9d-c6ed-43f2-b08e-c90b99a92d74 None admin] PATH_INFO: `/v3/projects/6910e69702854607889bab124edd60c9/users/7bfcddefa71546d28078a38325c723a9/roles/bfacecd6591f4b43ab2b69bda06ea9b0` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:33.743871 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fecc9d-c6ed-43f2-b08e-c90b99a92d74 None admin] RBAC: Authorizing `identity:create_grant(project_id=6910e69702854607889bab124edd60c9, user_id=7bfcddefa71546d28078a38325c723a9, role_id=bfacecd6591f4b43ab2b69bda06ea9b0)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:33.746553 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fecc9d-c6ed-43f2-b08e-c90b99a92d74 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:33.822025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 519/1077] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Aug 2 08:50:33 2022] PUT /identity/v3/projects/6910e69702854607889bab124edd60c9/users/7bfcddefa71546d28078a38325c723a9/roles/bfacecd6591f4b43ab2b69bda06ea9b0 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:50:34.190857 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac32b8c-6686-4322-9933-6aa3780e78c9 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:34.191956 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac32b8c-6686-4322-9933-6aa3780e78c9 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:34.192072 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac32b8c-6686-4322-9933-6aa3780e78c9 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:34.193726 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 559/1078] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:50:34.199249 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3426e-6522-48af-acc5-905e81aa2956 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:34.199535 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3426e-6522-48af-acc5-905e81aa2956 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:34.199813 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3426e-6522-48af-acc5-905e81aa2956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:34.218406 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-9ed3426e-6522-48af-acc5-905e81aa2956 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:34.219602 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-9ed3426e-6522-48af-acc5-905e81aa2956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:34.289994 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 520/1079] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:50:34.312413 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac32b8c-6686-4322-9933-6aa3780e78c9 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:34.398707 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:34.419416 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac32b8c-6686-4322-9933-6aa3780e78c9 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:34.460072 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b22dd-4bbe-4f8b-b337-c50b2f5de1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:34.461126 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b22dd-4bbe-4f8b-b337-c50b2f5de1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:34.461599 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b22dd-4bbe-4f8b-b337-c50b2f5de1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:34.462060 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b22dd-4bbe-4f8b-b337-c50b2f5de1a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:34.474895 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b22dd-4bbe-4f8b-b337-c50b2f5de1a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:50:34.479810 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-bb7b22dd-4bbe-4f8b-b337-c50b2f5de1a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:50:34.479810 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:34.479810 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:34.479810 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:34.479810 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:34.479810 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:34.479810 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:34.479810 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:34.479810 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:34.479810 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:34.479810 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:34.479810 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:34.479810 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:50:34.479810 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:50:34.479810 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:50:34.479810 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:50:34.481702 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:50:34.481702 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:50:34.481702 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:50:34.481702 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:50:34.481702 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:34.481702 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:34.481702 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:34.481702 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:34.481702 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:34.481702 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:34.481702 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:34.481702 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:34.481702 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:34.481702 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:34.481702 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:34.481702 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:34.482793 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:34.482793 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:34.482793 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:34.482793 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:34.482793 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:50:34.482793 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:50:34.482793 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:50:34.482793 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:50:34.482793 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:50:34.482793 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:50:34.482793 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:50:34.482793 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:34.482793 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 560/1080] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:50:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:34.487277 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3426e-6522-48af-acc5-905e81aa2956 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:34.571156 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:34.594254 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3426e-6522-48af-acc5-905e81aa2956 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:34.631810 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c237ebb-ede9-419e-b508-9faf8e344371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:34.632465 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c237ebb-ede9-419e-b508-9faf8e344371 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:34.632751 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c237ebb-ede9-419e-b508-9faf8e344371 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:34.633026 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c237ebb-ede9-419e-b508-9faf8e344371 None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:34.633747 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c237ebb-ede9-419e-b508-9faf8e344371 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:34.634061 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c237ebb-ede9-419e-b508-9faf8e344371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:34.635491 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c237ebb-ede9-419e-b508-9faf8e344371 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:34.645100 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 521/1081] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:50:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:34.651137 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b22dd-4bbe-4f8b-b337-c50b2f5de1a8 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:34.755052 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b22dd-4bbe-4f8b-b337-c50b2f5de1a8 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:34.793621 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601bb65-89a2-4e2b-a9fa-8de6541cc7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:34.794275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601bb65-89a2-4e2b-a9fa-8de6541cc7bb None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:34.794560 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601bb65-89a2-4e2b-a9fa-8de6541cc7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:34.794870 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601bb65-89a2-4e2b-a9fa-8de6541cc7bb None admin] PATH_INFO: `/v3/users/6d664267e4024ba5a28c46dca0304176` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:34.796451 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601bb65-89a2-4e2b-a9fa-8de6541cc7bb None admin] RBAC: Authorizing `identity:get_user(user_id=6d664267e4024ba5a28c46dca0304176)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:34.798319 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601bb65-89a2-4e2b-a9fa-8de6541cc7bb None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:34.800102 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 561/1082] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:50:34 2022] GET /identity/v3/users/6d664267e4024ba5a28c46dca0304176 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:34.805677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c237ebb-ede9-419e-b508-9faf8e344371 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:34.917736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c237ebb-ede9-419e-b508-9faf8e344371 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:34.953125 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d4638-0b1c-4311-bb32-9d4e2a04337a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:34.953795 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d4638-0b1c-4311-bb32-9d4e2a04337a None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:34.954072 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d4638-0b1c-4311-bb32-9d4e2a04337a None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:34.954343 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d4638-0b1c-4311-bb32-9d4e2a04337a None admin] PATH_INFO: `/v3/projects/4cc5ee663d024ca7a96f845a8980eb5b` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:34.955954 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d4638-0b1c-4311-bb32-9d4e2a04337a None admin] RBAC: Authorizing `identity:get_project(project_id=4cc5ee663d024ca7a96f845a8980eb5b)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:34.958552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d4638-0b1c-4311-bb32-9d4e2a04337a None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:34.960398 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 522/1083] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:50:34 2022] GET /identity/v3/projects/4cc5ee663d024ca7a96f845a8980eb5b => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:34.966666 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601bb65-89a2-4e2b-a9fa-8de6541cc7bb None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:34.979028 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:35.072898 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601bb65-89a2-4e2b-a9fa-8de6541cc7bb None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:35.110590 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4be95-e9b3-4f27-a470-6126c91f21e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:35.111720 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4be95-e9b3-4f27-a470-6126c91f21e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:35.111720 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4be95-e9b3-4f27-a470-6126c91f21e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:35.111953 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4be95-e9b3-4f27-a470-6126c91f21e8 None admin] PATH_INFO: `/v3/projects/4cc5ee663d024ca7a96f845a8980eb5b/users/6d664267e4024ba5a28c46dca0304176/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:35.114394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4be95-e9b3-4f27-a470-6126c91f21e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=4cc5ee663d024ca7a96f845a8980eb5b, user_id=6d664267e4024ba5a28c46dca0304176, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:35.115813 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4be95-e9b3-4f27-a470-6126c91f21e8 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:35.191125 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 562/1084] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Aug 2 08:50:34 2022] PUT /identity/v3/projects/4cc5ee663d024ca7a96f845a8980eb5b/users/6d664267e4024ba5a28c46dca0304176/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:50:35.882462 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c107ba9-a980-4183-9ca7-6d4b270492c6 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:35.883038 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c107ba9-a980-4183-9ca7-6d4b270492c6 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:35.883038 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c107ba9-a980-4183-9ca7-6d4b270492c6 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:35.884629 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 523/1085] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:50:35.890258 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82495e84-1595-4af9-83dc-1873c321f527 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:35.890547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82495e84-1595-4af9-83dc-1873c321f527 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:35.890827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82495e84-1595-4af9-83dc-1873c321f527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:35.911315 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-82495e84-1595-4af9-83dc-1873c321f527 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:35.912896 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-82495e84-1595-4af9-83dc-1873c321f527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:35.977337 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:35.983419 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 563/1086] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:50:36.007722 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c107ba9-a980-4183-9ca7-6d4b270492c6 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:36.020435 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:36.119044 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c107ba9-a980-4183-9ca7-6d4b270492c6 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:36.169506 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302e4b3-b00f-405b-a26e-02ea154b148c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:36.170138 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302e4b3-b00f-405b-a26e-02ea154b148c None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:36.170411 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302e4b3-b00f-405b-a26e-02ea154b148c None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:36.170682 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302e4b3-b00f-405b-a26e-02ea154b148c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:36.184067 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302e4b3-b00f-405b-a26e-02ea154b148c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:50:36.188996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-2302e4b3-b00f-405b-a26e-02ea154b148c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:50:36.188996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:36.188996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:36.188996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:36.188996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:36.188996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:36.188996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:36.188996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:36.188996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:36.188996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:36.188996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:36.188996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:36.188996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:50:36.188996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:50:36.188996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:50:36.188996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:50:36.189977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:50:36.189977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:50:36.189977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:50:36.189977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:50:36.189977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:36.189977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:36.189977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:36.189977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:36.189977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:36.189977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:36.189977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:36.189977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:36.189977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:36.189977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:36.189977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:36.189977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:36.191119 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:36.191119 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:36.191119 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:36.191119 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:36.191119 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:50:36.191119 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:50:36.191119 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:50:36.191119 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:50:36.191119 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:50:36.191119 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:50:36.191119 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:50:36.191119 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:36.191119 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 524/1087] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Aug 2 08:50:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:36.196880 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82495e84-1595-4af9-83dc-1873c321f527 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:36.308502 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82495e84-1595-4af9-83dc-1873c321f527 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:36.345376 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d231e-8291-40e9-bc6d-5b03de15f2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:36.345999 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d231e-8291-40e9-bc6d-5b03de15f2e2 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:36.346277 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d231e-8291-40e9-bc6d-5b03de15f2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:36.346546 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d231e-8291-40e9-bc6d-5b03de15f2e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:36.347257 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d231e-8291-40e9-bc6d-5b03de15f2e2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:36.347583 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d231e-8291-40e9-bc6d-5b03de15f2e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:36.348988 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d231e-8291-40e9-bc6d-5b03de15f2e2 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:36.357097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 564/1088] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Aug 2 08:50:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:36.363654 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302e4b3-b00f-405b-a26e-02ea154b148c None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:36.440605 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:36.479545 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302e4b3-b00f-405b-a26e-02ea154b148c None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:36.516876 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf1f2e-e444-48a4-947c-f28ad3e0f49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:36.517535 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf1f2e-e444-48a4-947c-f28ad3e0f49e None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:36.517809 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf1f2e-e444-48a4-947c-f28ad3e0f49e None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:36.518079 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf1f2e-e444-48a4-947c-f28ad3e0f49e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:36.530140 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf1f2e-e444-48a4-947c-f28ad3e0f49e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:36.531606 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf1f2e-e444-48a4-947c-f28ad3e0f49e None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:36.547447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-6fbf1f2e-e444-48a4-947c-f28ad3e0f49e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:50:36.547447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:36.547447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:36.547447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:36.547447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:36.547447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:36.547447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:36.547447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:36.547447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:36.547447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:36.547447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:36.547447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:36.547447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:50:36.547447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:50:36.547447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:50:36.548668 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:50:36.548668 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:36.548668 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:36.548668 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:36.548668 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:36.548668 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:36.548668 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:36.548668 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:36.548668 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:36.548668 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:36.548668 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:36.548668 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:36.548668 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:36.548668 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:36.548668 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:36.548668 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:36.548668 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:36.549594 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:50:36.549594 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:50:36.549594 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:50:36.549594 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:36.549594 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 525/1089] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:50:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:50:36.555211 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d231e-8291-40e9-bc6d-5b03de15f2e2 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:36.621036 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:36.663080 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d231e-8291-40e9-bc6d-5b03de15f2e2 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:36.697523 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c93a8-4343-4d1d-b1f1-1f49d5780882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:36.698088 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c93a8-4343-4d1d-b1f1-1f49d5780882 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:36.698370 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c93a8-4343-4d1d-b1f1-1f49d5780882 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:36.698646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c93a8-4343-4d1d-b1f1-1f49d5780882 None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:36.699345 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c93a8-4343-4d1d-b1f1-1f49d5780882 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:36.699649 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c93a8-4343-4d1d-b1f1-1f49d5780882 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:36.701064 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c93a8-4343-4d1d-b1f1-1f49d5780882 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:36.714003 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 565/1090] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:36.719722 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf1f2e-e444-48a4-947c-f28ad3e0f49e None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:36.825997 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf1f2e-e444-48a4-947c-f28ad3e0f49e None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:36.846386 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:36.865265 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95912368-a6c0-4531-ae95-e7eaecbbc530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:36.865918 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95912368-a6c0-4531-ae95-e7eaecbbc530 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:36.866202 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95912368-a6c0-4531-ae95-e7eaecbbc530 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:36.866482 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95912368-a6c0-4531-ae95-e7eaecbbc530 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:36.874858 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95912368-a6c0-4531-ae95-e7eaecbbc530 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:36.876712 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95912368-a6c0-4531-ae95-e7eaecbbc530 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:36.889762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-95912368-a6c0-4531-ae95-e7eaecbbc530 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:50:36.889762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:36.889762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:36.889762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:36.889762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:36.889762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:36.889762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:36.889762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:36.889762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:36.889762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:36.889762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:36.889762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:36.889762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:50:36.889762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:50:36.889762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:50:36.889762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:50:36.891729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:36.891729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:36.891729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:50:36.891729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:50:36.891729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:50:36.891729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:50:36.891729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:36.891729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:36.891729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:36.891729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:36.891729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:36.891729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:36.891729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:36.891729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:36.891729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:36.891729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:36.891729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:36.891729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:36.893123 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:36.893123 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:36.893123 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:50:36.893123 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:50:36.893123 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:50:36.893123 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:50:36.893123 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:50:36.893123 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:50:36.893123 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:50:36.893123 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:36.893123 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 526/1091] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Aug 2 08:50:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:50:36.900083 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c93a8-4343-4d1d-b1f1-1f49d5780882 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:37.005053 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c93a8-4343-4d1d-b1f1-1f49d5780882 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:37.026517 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:37.042179 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576a8cb-0869-43b4-a558-465faa9a27db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:37.042816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576a8cb-0869-43b4-a558-465faa9a27db None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:37.043133 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576a8cb-0869-43b4-a558-465faa9a27db None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:37.043434 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576a8cb-0869-43b4-a558-465faa9a27db None admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:37.044271 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576a8cb-0869-43b4-a558-465faa9a27db None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:37.044585 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576a8cb-0869-43b4-a558-465faa9a27db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:37.046013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576a8cb-0869-43b4-a558-465faa9a27db None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:37.064102 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 566/1092] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Aug 2 08:50:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:37.070391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95912368-a6c0-4531-ae95-e7eaecbbc530 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:37.178229 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95912368-a6c0-4531-ae95-e7eaecbbc530 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:37.220558 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23a91d-074b-46be-9dad-dee0ad75983e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:37.221191 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23a91d-074b-46be-9dad-dee0ad75983e None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:37.221474 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23a91d-074b-46be-9dad-dee0ad75983e None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:37.221751 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23a91d-074b-46be-9dad-dee0ad75983e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:37.253038 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc5460-87a2-46c8-af9c-f327e9305f11 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:37.253637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc5460-87a2-46c8-af9c-f327e9305f11 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:37.253637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc5460-87a2-46c8-af9c-f327e9305f11 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:37.255484 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 567/1093] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:50:37.260377 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a34a5-53a7-4d27-ad5b-d915e1e4e142 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:37.260663 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a34a5-53a7-4d27-ad5b-d915e1e4e142 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:37.260942 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a34a5-53a7-4d27-ad5b-d915e1e4e142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:37.276250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:37.280134 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-d29a34a5-53a7-4d27-ad5b-d915e1e4e142 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:37.281376 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-d29a34a5-53a7-4d27-ad5b-d915e1e4e142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:37.297535 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca23a91d-074b-46be-9dad-dee0ad75983e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:37.299698 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca23a91d-074b-46be-9dad-dee0ad75983e None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:37.351056 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 568/1094] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:50:37.375313 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a34a5-53a7-4d27-ad5b-d915e1e4e142 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:37.400078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 527/1095] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:50:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:50:37.406010 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23a91d-074b-46be-9dad-dee0ad75983e None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:37.482844 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a34a5-53a7-4d27-ad5b-d915e1e4e142 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:37.489245 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:37.494009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:37.513239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23a91d-074b-46be-9dad-dee0ad75983e None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:37.521767 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999065f-588a-4b29-90bd-6ce05409a2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:37.522447 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999065f-588a-4b29-90bd-6ce05409a2db None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:37.522733 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999065f-588a-4b29-90bd-6ce05409a2db None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:37.523013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999065f-588a-4b29-90bd-6ce05409a2db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:37.536514 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999065f-588a-4b29-90bd-6ce05409a2db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:50:37.541480 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-3999065f-588a-4b29-90bd-6ce05409a2db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:50:37.541480 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:37.541480 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:37.541480 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:37.541480 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:37.541480 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:37.541480 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:37.541480 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:37.541480 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:37.541480 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:37.541480 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:37.541480 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:37.541480 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:50:37.541480 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:50:37.541480 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:50:37.541480 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:50:37.542415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:50:37.542415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:50:37.542415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:50:37.542415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:50:37.542415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:37.542415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:37.542415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:37.542415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:37.542415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:37.542415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:37.542415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:37.542415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:37.542415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:37.542415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:37.542415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:37.542415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:37.543266 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:37.543266 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:37.543266 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:37.543266 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:37.543266 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:50:37.543266 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:50:37.543266 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:50:37.543266 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:50:37.543266 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:50:37.543266 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:50:37.543266 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:50:37.543266 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:37.543266 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 569/1096] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:50:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:37.549931 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999065f-588a-4b29-90bd-6ce05409a2db None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:37.556881 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5b2fe-a8a6-4d93-b18f-03c0186a052b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:37.557543 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5b2fe-a8a6-4d93-b18f-03c0186a052b None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:37.557825 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5b2fe-a8a6-4d93-b18f-03c0186a052b None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:37.558104 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5b2fe-a8a6-4d93-b18f-03c0186a052b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:37.570306 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5b2fe-a8a6-4d93-b18f-03c0186a052b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:37.571811 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5b2fe-a8a6-4d93-b18f-03c0186a052b None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:37.587739 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-2ae5b2fe-a8a6-4d93-b18f-03c0186a052b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:50:37.587739 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:37.587739 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:37.587739 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:37.587739 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:37.587739 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:37.587739 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:37.587739 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:37.587739 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:37.587739 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:37.587739 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:37.587739 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:37.587739 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:50:37.587739 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:50:37.587739 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:50:37.588816 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:50:37.588816 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:37.588816 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:37.588816 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:37.588816 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:37.588816 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:37.588816 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:37.588816 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:37.588816 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:37.588816 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:37.588816 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:37.588816 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:37.588816 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:37.588816 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:37.588816 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:37.588816 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:37.588816 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:37.589774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:50:37.589774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:50:37.589774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:50:37.589774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:37.589774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 528/1097] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:50:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:50:37.594297 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5b2fe-a8a6-4d93-b18f-03c0186a052b None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:37.662816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999065f-588a-4b29-90bd-6ce05409a2db None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:37.697218 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e302c-fcd9-40ed-b54f-1ba1b7c85720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:37.697846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e302c-fcd9-40ed-b54f-1ba1b7c85720 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:37.698132 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e302c-fcd9-40ed-b54f-1ba1b7c85720 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:37.698391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5b2fe-a8a6-4d93-b18f-03c0186a052b None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:37.698505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e302c-fcd9-40ed-b54f-1ba1b7c85720 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:37.699135 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e302c-fcd9-40ed-b54f-1ba1b7c85720 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:37.699434 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e302c-fcd9-40ed-b54f-1ba1b7c85720 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:37.700848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e302c-fcd9-40ed-b54f-1ba1b7c85720 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:37.710724 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 570/1098] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:50:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:37.716626 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e302c-fcd9-40ed-b54f-1ba1b7c85720 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:37.730360 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:37.735220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fb8f0-081e-4055-a2be-67049b071dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:37.735852 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fb8f0-081e-4055-a2be-67049b071dbd None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:37.736132 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fb8f0-081e-4055-a2be-67049b071dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:37.736436 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fb8f0-081e-4055-a2be-67049b071dbd None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:37.737124 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fb8f0-081e-4055-a2be-67049b071dbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:37.737426 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fb8f0-081e-4055-a2be-67049b071dbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:37.739020 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fb8f0-081e-4055-a2be-67049b071dbd None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:37.747290 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:37.751233 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 529/1099] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:37.757330 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fb8f0-081e-4055-a2be-67049b071dbd None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:37.819939 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e302c-fcd9-40ed-b54f-1ba1b7c85720 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:37.860129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fb8f0-081e-4055-a2be-67049b071dbd None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:37.860528 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0f9c4-6d2c-4c04-95c6-4864f8f32947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:37.861181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0f9c4-6d2c-4c04-95c6-4864f8f32947 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:37.861457 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0f9c4-6d2c-4c04-95c6-4864f8f32947 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:37.861738 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0f9c4-6d2c-4c04-95c6-4864f8f32947 None admin] PATH_INFO: `/v3/users/6d664267e4024ba5a28c46dca0304176` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:37.862990 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0f9c4-6d2c-4c04-95c6-4864f8f32947 None admin] RBAC: Authorizing `identity:get_user(user_id=6d664267e4024ba5a28c46dca0304176)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:37.864998 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0f9c4-6d2c-4c04-95c6-4864f8f32947 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:37.866639 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 571/1100] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:50:37 2022] GET /identity/v3/users/6d664267e4024ba5a28c46dca0304176 => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:37.872409 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0f9c4-6d2c-4c04-95c6-4864f8f32947 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:37.900145 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8231839-5253-4b5c-aebe-253c97dc4e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:37.900829 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8231839-5253-4b5c-aebe-253c97dc4e0f None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:37.901116 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8231839-5253-4b5c-aebe-253c97dc4e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:37.901487 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8231839-5253-4b5c-aebe-253c97dc4e0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:37.911492 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8231839-5253-4b5c-aebe-253c97dc4e0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:37.911492 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8231839-5253-4b5c-aebe-253c97dc4e0f None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:37.923288 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-e8231839-5253-4b5c-aebe-253c97dc4e0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:50:37.923288 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:37.923288 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:37.923288 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:37.923288 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:37.923288 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:37.923288 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:37.923288 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:37.923288 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:37.923288 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:37.923288 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:37.923288 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:37.923288 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:50:37.923288 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:50:37.923288 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:50:37.924554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:50:37.924554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:37.924554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:37.924554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:37.924554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:37.924554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:37.924554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:37.924554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:37.924554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:37.924554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:37.924554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:37.924554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:37.924554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:37.924554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:37.924554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:37.924554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:37.924554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:37.926211 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:50:37.926211 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:50:37.926211 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:50:37.926211 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:50:37.926211 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:50:37.926211 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:50:37.926211 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:50:37.926211 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:50:37.926211 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 530/1101] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:50:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:50:37.930963 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8231839-5253-4b5c-aebe-253c97dc4e0f None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:37.974371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:37.978166 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0f9c4-6d2c-4c04-95c6-4864f8f32947 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:37.985513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:38.014765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fe2d8-a446-4df8-8666-f5a63b201e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:38.015391 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fe2d8-a446-4df8-8666-f5a63b201e37 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:38.015677 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fe2d8-a446-4df8-8666-f5a63b201e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:38.015954 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fe2d8-a446-4df8-8666-f5a63b201e37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:38.034264 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8231839-5253-4b5c-aebe-253c97dc4e0f None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:38.071713 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c042f00-99e9-43c1-b3dc-ad51ab0fa324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:38.072298 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c042f00-99e9-43c1-b3dc-ad51ab0fa324 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:38.072583 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c042f00-99e9-43c1-b3dc-ad51ab0fa324 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:38.072859 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c042f00-99e9-43c1-b3dc-ad51ab0fa324 None admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:38.073612 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c042f00-99e9-43c1-b3dc-ad51ab0fa324 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:38.073921 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c042f00-99e9-43c1-b3dc-ad51ab0fa324 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:38.075376 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c042f00-99e9-43c1-b3dc-ad51ab0fa324 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:38.088551 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4fe2d8-a446-4df8-8666-f5a63b201e37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:38.089090 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 531/1102] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:50:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:38.090026 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4fe2d8-a446-4df8-8666-f5a63b201e37 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:38.094930 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c042f00-99e9-43c1-b3dc-ad51ab0fa324 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:38.188459 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:38.192780 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 572/1103] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:50:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 08:50:38.198721 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fe2d8-a446-4df8-8666-f5a63b201e37 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:38.201041 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c042f00-99e9-43c1-b3dc-ad51ab0fa324 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:38.216320 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:38.239330 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945b6f9-68e3-46d5-b34b-b84c17632481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:38.240064 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945b6f9-68e3-46d5-b34b-b84c17632481 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:38.240440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945b6f9-68e3-46d5-b34b-b84c17632481 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:38.240769 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945b6f9-68e3-46d5-b34b-b84c17632481 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:38.241568 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945b6f9-68e3-46d5-b34b-b84c17632481 None admin] RBAC: Adding query filter params (role.id=bfacecd6591f4b43ab2b69bda06ea9b0, scope.project.id=6910e69702854607889bab124edd60c9, user.id=7bfcddefa71546d28078a38325c723a9) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:38.241876 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945b6f9-68e3-46d5-b34b-b84c17632481 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:38.243318 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945b6f9-68e3-46d5-b34b-b84c17632481 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:38.250137 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 532/1104] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:50:38 2022] GET /identity/v3/role_assignments?user.id=7bfcddefa71546d28078a38325c723a9&scope.project.id=6910e69702854607889bab124edd60c9&role.id=bfacecd6591f4b43ab2b69bda06ea9b0 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:38.314203 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fe2d8-a446-4df8-8666-f5a63b201e37 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:38.353376 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a10d1-ebee-460f-88f1-667655b1f167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:38.353961 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a10d1-ebee-460f-88f1-667655b1f167 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:38.354244 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a10d1-ebee-460f-88f1-667655b1f167 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:38.354555 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a10d1-ebee-460f-88f1-667655b1f167 None admin] PATH_INFO: `/v3/projects/4cc5ee663d024ca7a96f845a8980eb5b` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:38.355963 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a10d1-ebee-460f-88f1-667655b1f167 None admin] RBAC: Authorizing `identity:get_project(project_id=4cc5ee663d024ca7a96f845a8980eb5b)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:38.357482 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a10d1-ebee-460f-88f1-667655b1f167 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:38.359244 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 573/1105] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:50:38 2022] GET /identity/v3/projects/4cc5ee663d024ca7a96f845a8980eb5b => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:38.366583 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945b6f9-68e3-46d5-b34b-b84c17632481 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:38.485128 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945b6f9-68e3-46d5-b34b-b84c17632481 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:38.525968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa16fc5-f6c8-43fe-96bb-fc9f7aecf5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:38.526727 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa16fc5-f6c8-43fe-96bb-fc9f7aecf5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:38.527014 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa16fc5-f6c8-43fe-96bb-fc9f7aecf5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:38.527282 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa16fc5-f6c8-43fe-96bb-fc9f7aecf5b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:38.528083 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa16fc5-f6c8-43fe-96bb-fc9f7aecf5b3 None admin] RBAC: Adding query filter params (role.id=b5477d3c4e5a4514b64211ec2452d1d8, scope.project.id=4cc5ee663d024ca7a96f845a8980eb5b, user.id=6d664267e4024ba5a28c46dca0304176) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:38.528418 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa16fc5-f6c8-43fe-96bb-fc9f7aecf5b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:38.529869 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa16fc5-f6c8-43fe-96bb-fc9f7aecf5b3 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:38.536778 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 533/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:50:38 2022] GET /identity/v3/role_assignments?user.id=6d664267e4024ba5a28c46dca0304176&scope.project.id=4cc5ee663d024ca7a96f845a8980eb5b&role.id=b5477d3c4e5a4514b64211ec2452d1d8 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:40.633278 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c59e1-f8fb-4c3e-ad57-c219ba2cf5aa None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:40.633820 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c59e1-f8fb-4c3e-ad57-c219ba2cf5aa None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:40.633916 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c59e1-f8fb-4c3e-ad57-c219ba2cf5aa None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:40.635214 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 574/1107] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:50:40.640616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e101f-a41e-4124-b547-6f9b8aaab69c None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:40.641049 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e101f-a41e-4124-b547-6f9b8aaab69c None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:40.641144 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e101f-a41e-4124-b547-6f9b8aaab69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:40.661134 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-493e101f-a41e-4124-b547-6f9b8aaab69c None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:40.662345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-493e101f-a41e-4124-b547-6f9b8aaab69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:40.697174 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:40.731869 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 534/1108] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:50:40.758005 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c59e1-f8fb-4c3e-ad57-c219ba2cf5aa None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:40.827602 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:40.863973 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c59e1-f8fb-4c3e-ad57-c219ba2cf5aa None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:40.901491 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df2d3d-d063-4ef7-9bfc-88ad9386ab0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:40.902059 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df2d3d-d063-4ef7-9bfc-88ad9386ab0c None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:40.902339 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df2d3d-d063-4ef7-9bfc-88ad9386ab0c None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:40.902613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df2d3d-d063-4ef7-9bfc-88ad9386ab0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:40.903764 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df2d3d-d063-4ef7-9bfc-88ad9386ab0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:40.905251 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df2d3d-d063-4ef7-9bfc-88ad9386ab0c None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:40.906933 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 575/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:50:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:40.913471 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e101f-a41e-4124-b547-6f9b8aaab69c None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:41.018992 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e101f-a41e-4124-b547-6f9b8aaab69c None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:41.053144 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fc0df-55ef-43c2-9668-84d5387bf764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:41.053765 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fc0df-55ef-43c2-9668-84d5387bf764 None admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:41.054041 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fc0df-55ef-43c2-9668-84d5387bf764 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:41.054311 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fc0df-55ef-43c2-9668-84d5387bf764 None admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:41.055001 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9fc0df-55ef-43c2-9668-84d5387bf764 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:41.056463 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9fc0df-55ef-43c2-9668-84d5387bf764 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:41.145066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 535/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Aug 2 08:50:40 2022] POST /identity/v3/users => generated 286 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:50:43.295968 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca741d5-196e-406f-ad9f-1ae30b3c4762 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:43.296516 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca741d5-196e-406f-ad9f-1ae30b3c4762 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:43.296638 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca741d5-196e-406f-ad9f-1ae30b3c4762 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:43.297927 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 576/1111] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:50:43.303797 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba6e08-a4aa-42f5-b48d-81b8ff4858e0 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:43.304268 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba6e08-a4aa-42f5-b48d-81b8ff4858e0 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:43.304387 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba6e08-a4aa-42f5-b48d-81b8ff4858e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:43.323519 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-02ba6e08-a4aa-42f5-b48d-81b8ff4858e0 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:43.324732 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-02ba6e08-a4aa-42f5-b48d-81b8ff4858e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:43.346063 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:43.393653 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 536/1112] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:50:43.419649 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca741d5-196e-406f-ad9f-1ae30b3c4762 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:43.524771 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca741d5-196e-406f-ad9f-1ae30b3c4762 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:43.563381 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd74814-e74c-4822-a38b-2b3b0340ba12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:43.563381 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd74814-e74c-4822-a38b-2b3b0340ba12 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:43.563381 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd74814-e74c-4822-a38b-2b3b0340ba12 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:43.563381 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd74814-e74c-4822-a38b-2b3b0340ba12 None admin] PATH_INFO: `/v3/roles/923eb688fccc4e79b6c3df28d754b6c4` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:43.563845 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd74814-e74c-4822-a38b-2b3b0340ba12 None admin] RBAC: Authorizing `identity:get_role(role_id=923eb688fccc4e79b6c3df28d754b6c4)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:43.563845 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd74814-e74c-4822-a38b-2b3b0340ba12 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:43.564765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 577/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:50:43 2022] GET /identity/v3/roles/923eb688fccc4e79b6c3df28d754b6c4 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:43.571573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba6e08-a4aa-42f5-b48d-81b8ff4858e0 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:43.673739 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba6e08-a4aa-42f5-b48d-81b8ff4858e0 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:43.708185 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c1d71-60b7-4113-91b7-03809d94e7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:43.708847 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c1d71-60b7-4113-91b7-03809d94e7df None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:43.709128 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c1d71-60b7-4113-91b7-03809d94e7df None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:43.709405 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c1d71-60b7-4113-91b7-03809d94e7df None admin] PATH_INFO: `/v3/users/7c5c75336bf14ea98b8d17eab516ce6f` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:43.724719 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c1d71-60b7-4113-91b7-03809d94e7df None admin] RBAC: Authorizing `identity:get_user(user_id=7c5c75336bf14ea98b8d17eab516ce6f)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:43.726201 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c1d71-60b7-4113-91b7-03809d94e7df None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:43.727908 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 537/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:50:43 2022] GET /identity/v3/users/7c5c75336bf14ea98b8d17eab516ce6f => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:43.734003 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd74814-e74c-4822-a38b-2b3b0340ba12 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:43.737131 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:43.836094 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd74814-e74c-4822-a38b-2b3b0340ba12 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:43.869863 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39194f43-f7b0-4104-a978-1c019265d6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:43.870485 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39194f43-f7b0-4104-a978-1c019265d6ce None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:43.870764 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39194f43-f7b0-4104-a978-1c019265d6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:43.871036 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39194f43-f7b0-4104-a978-1c019265d6ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:43.947656 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39194f43-f7b0-4104-a978-1c019265d6ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:43.949141 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39194f43-f7b0-4104-a978-1c019265d6ce None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:43.951326 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:44.051633 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 578/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:50:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:50:44.057738 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c1d71-60b7-4113-91b7-03809d94e7df None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:44.074178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:44.162417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c1d71-60b7-4113-91b7-03809d94e7df None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:44.197746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d9feb-d48f-4da0-ac51-cc0aa81c4b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:44.198387 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d9feb-d48f-4da0-ac51-cc0aa81c4b44 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:44.198733 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d9feb-d48f-4da0-ac51-cc0aa81c4b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:44.198938 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d9feb-d48f-4da0-ac51-cc0aa81c4b44 None admin] PATH_INFO: `/v3/projects/4cc5ee663d024ca7a96f845a8980eb5b` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:44.200093 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d9feb-d48f-4da0-ac51-cc0aa81c4b44 None admin] RBAC: Authorizing `identity:get_project(project_id=4cc5ee663d024ca7a96f845a8980eb5b)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:44.201576 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d9feb-d48f-4da0-ac51-cc0aa81c4b44 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:44.203224 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 538/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:50:44 2022] GET /identity/v3/projects/4cc5ee663d024ca7a96f845a8980eb5b => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:44.209570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39194f43-f7b0-4104-a978-1c019265d6ce None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:44.313622 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39194f43-f7b0-4104-a978-1c019265d6ce None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:44.315393 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:44.357459 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85159c-37d8-46cf-8d3c-79fb1afc4df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:44.358082 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85159c-37d8-46cf-8d3c-79fb1afc4df9 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:44.358366 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85159c-37d8-46cf-8d3c-79fb1afc4df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:44.358641 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85159c-37d8-46cf-8d3c-79fb1afc4df9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:44.359441 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85159c-37d8-46cf-8d3c-79fb1afc4df9 None admin] RBAC: Adding query filter params (role.id=923eb688fccc4e79b6c3df28d754b6c4, scope.project.id=4cc5ee663d024ca7a96f845a8980eb5b, user.id=7c5c75336bf14ea98b8d17eab516ce6f) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:44.359754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85159c-37d8-46cf-8d3c-79fb1afc4df9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:44.361224 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85159c-37d8-46cf-8d3c-79fb1afc4df9 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:44.367559 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 579/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:50:44 2022] GET /identity/v3/role_assignments?user.id=7c5c75336bf14ea98b8d17eab516ce6f&scope.project.id=4cc5ee663d024ca7a96f845a8980eb5b&role.id=923eb688fccc4e79b6c3df28d754b6c4 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:46.400604 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2569e-2224-4f30-adbc-770143c37c96 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:46.401160 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2569e-2224-4f30-adbc-770143c37c96 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:46.401160 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2569e-2224-4f30-adbc-770143c37c96 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:46.402504 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 539/1118] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:50:46.408245 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b350ae-c34c-4954-bce9-da2c37d2ea12 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:46.408819 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b350ae-c34c-4954-bce9-da2c37d2ea12 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:46.408819 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b350ae-c34c-4954-bce9-da2c37d2ea12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:46.427782 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-d9b350ae-c34c-4954-bce9-da2c37d2ea12 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:46.429028 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-d9b350ae-c34c-4954-bce9-da2c37d2ea12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:46.494967 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 580/1119] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:50:46.518267 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2569e-2224-4f30-adbc-770143c37c96 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:46.602552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:46.625766 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2569e-2224-4f30-adbc-770143c37c96 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:46.661683 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65804e53-a06d-402f-9c2c-06f16a27dc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:46.662322 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65804e53-a06d-402f-9c2c-06f16a27dc05 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:46.662604 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65804e53-a06d-402f-9c2c-06f16a27dc05 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:46.662882 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65804e53-a06d-402f-9c2c-06f16a27dc05 None admin] PATH_INFO: `/v3/roles/923eb688fccc4e79b6c3df28d754b6c4` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:46.664364 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65804e53-a06d-402f-9c2c-06f16a27dc05 None admin] RBAC: Authorizing `identity:get_role(role_id=923eb688fccc4e79b6c3df28d754b6c4)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:46.665738 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65804e53-a06d-402f-9c2c-06f16a27dc05 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:46.667106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 540/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:50:46 2022] GET /identity/v3/roles/923eb688fccc4e79b6c3df28d754b6c4 => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:46.673199 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b350ae-c34c-4954-bce9-da2c37d2ea12 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:46.769082 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:46.774940 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b350ae-c34c-4954-bce9-da2c37d2ea12 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:46.809481 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475de47-2792-4462-98d0-baf098cf9b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:46.810137 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475de47-2792-4462-98d0-baf098cf9b67 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:46.810419 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475de47-2792-4462-98d0-baf098cf9b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:46.810696 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475de47-2792-4462-98d0-baf098cf9b67 None admin] PATH_INFO: `/v3/users/7c5c75336bf14ea98b8d17eab516ce6f` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:46.811870 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475de47-2792-4462-98d0-baf098cf9b67 None admin] RBAC: Authorizing `identity:get_user(user_id=7c5c75336bf14ea98b8d17eab516ce6f)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:46.813340 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475de47-2792-4462-98d0-baf098cf9b67 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:46.814964 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 581/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:50:46 2022] GET /identity/v3/users/7c5c75336bf14ea98b8d17eab516ce6f => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:46.821003 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65804e53-a06d-402f-9c2c-06f16a27dc05 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:46.929206 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65804e53-a06d-402f-9c2c-06f16a27dc05 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:46.962670 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217fbaa-d615-43aa-8ed2-dfccc55d2a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:46.963310 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217fbaa-d615-43aa-8ed2-dfccc55d2a96 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:46.963590 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217fbaa-d615-43aa-8ed2-dfccc55d2a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:46.963866 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217fbaa-d615-43aa-8ed2-dfccc55d2a96 None admin] PATH_INFO: `/v3/projects/4cc5ee663d024ca7a96f845a8980eb5b` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:46.965055 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217fbaa-d615-43aa-8ed2-dfccc55d2a96 None admin] RBAC: Authorizing `identity:get_project(project_id=4cc5ee663d024ca7a96f845a8980eb5b)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:46.966501 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217fbaa-d615-43aa-8ed2-dfccc55d2a96 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:46.968213 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 541/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:50:46 2022] GET /identity/v3/projects/4cc5ee663d024ca7a96f845a8980eb5b => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:46.975059 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475de47-2792-4462-98d0-baf098cf9b67 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:47.086317 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475de47-2792-4462-98d0-baf098cf9b67 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:47.120045 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ab1ef-f403-4ca6-a70d-84e64ebf4716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:47.120747 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ab1ef-f403-4ca6-a70d-84e64ebf4716 None admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:47.121032 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ab1ef-f403-4ca6-a70d-84e64ebf4716 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:47.121311 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ab1ef-f403-4ca6-a70d-84e64ebf4716 None admin] PATH_INFO: `/v3/projects/4cc5ee663d024ca7a96f845a8980eb5b/users/7c5c75336bf14ea98b8d17eab516ce6f/roles/923eb688fccc4e79b6c3df28d754b6c4` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:47.123770 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ab1ef-f403-4ca6-a70d-84e64ebf4716 None admin] RBAC: Authorizing `identity:create_grant(project_id=4cc5ee663d024ca7a96f845a8980eb5b, user_id=7c5c75336bf14ea98b8d17eab516ce6f, role_id=923eb688fccc4e79b6c3df28d754b6c4)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:47.125252 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ab1ef-f403-4ca6-a70d-84e64ebf4716 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:47.179192 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 582/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Aug 2 08:50:46 2022] PUT /identity/v3/projects/4cc5ee663d024ca7a96f845a8980eb5b/users/7c5c75336bf14ea98b8d17eab516ce6f/roles/923eb688fccc4e79b6c3df28d754b6c4 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:50:49.209223 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9fb2c-5b60-421d-b7b3-df9ee4e65168 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:49.209787 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9fb2c-5b60-421d-b7b3-df9ee4e65168 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:49.209787 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9fb2c-5b60-421d-b7b3-df9ee4e65168 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:49.211087 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 542/1124] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:50:49.216320 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c653d-acb9-496f-b6d8-2bf7e4a7d548 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:49.216727 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c653d-acb9-496f-b6d8-2bf7e4a7d548 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:49.216871 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c653d-acb9-496f-b6d8-2bf7e4a7d548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:49.236025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-6f2c653d-acb9-496f-b6d8-2bf7e4a7d548 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:49.237888 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-6f2c653d-acb9-496f-b6d8-2bf7e4a7d548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:49.259271 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:49.312983 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 583/1125] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:50:49.336926 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9fb2c-5b60-421d-b7b3-df9ee4e65168 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:49.357034 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:49.444028 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9fb2c-5b60-421d-b7b3-df9ee4e65168 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:49.477450 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55433f4b-72d2-4a8f-8a91-349c4ba30210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:49.478013 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55433f4b-72d2-4a8f-8a91-349c4ba30210 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:49.478297 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55433f4b-72d2-4a8f-8a91-349c4ba30210 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:49.478573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55433f4b-72d2-4a8f-8a91-349c4ba30210 None admin] PATH_INFO: `/v3/roles/923eb688fccc4e79b6c3df28d754b6c4` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:49.479996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55433f4b-72d2-4a8f-8a91-349c4ba30210 None admin] RBAC: Authorizing `identity:get_role(role_id=923eb688fccc4e79b6c3df28d754b6c4)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:49.481401 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55433f4b-72d2-4a8f-8a91-349c4ba30210 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:49.482752 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 543/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:50:49 2022] GET /identity/v3/roles/923eb688fccc4e79b6c3df28d754b6c4 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:49.489263 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c653d-acb9-496f-b6d8-2bf7e4a7d548 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:49.586377 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c653d-acb9-496f-b6d8-2bf7e4a7d548 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:49.619928 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a0b7d-4b64-4562-827a-702b3f51a030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:49.620591 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a0b7d-4b64-4562-827a-702b3f51a030 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:49.620869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a0b7d-4b64-4562-827a-702b3f51a030 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:49.621143 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a0b7d-4b64-4562-827a-702b3f51a030 None admin] PATH_INFO: `/v3/users/7c5c75336bf14ea98b8d17eab516ce6f` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:49.622297 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a0b7d-4b64-4562-827a-702b3f51a030 None admin] RBAC: Authorizing `identity:get_user(user_id=7c5c75336bf14ea98b8d17eab516ce6f)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:49.624015 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a0b7d-4b64-4562-827a-702b3f51a030 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:49.625653 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 584/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:50:49 2022] GET /identity/v3/users/7c5c75336bf14ea98b8d17eab516ce6f => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:49.631667 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55433f4b-72d2-4a8f-8a91-349c4ba30210 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:49.725467 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:49.740352 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55433f4b-72d2-4a8f-8a91-349c4ba30210 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:49.775510 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b77fc6-3e64-44b1-ac0c-9ddbb67e7fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:49.776283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b77fc6-3e64-44b1-ac0c-9ddbb67e7fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:49.776576 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b77fc6-3e64-44b1-ac0c-9ddbb67e7fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:49.776855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b77fc6-3e64-44b1-ac0c-9ddbb67e7fc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:49.843631 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b77fc6-3e64-44b1-ac0c-9ddbb67e7fc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:49.845122 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b77fc6-3e64-44b1-ac0c-9ddbb67e7fc0 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:49.931197 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:49.947305 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 544/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:50:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:50:49.953258 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a0b7d-4b64-4562-827a-702b3f51a030 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:49.980944 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:50.075573 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a0b7d-4b64-4562-827a-702b3f51a030 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:50.109710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e5316-9d90-4d74-bbc1-2e3b01fdbbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:50.110351 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e5316-9d90-4d74-bbc1-2e3b01fdbbc2 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:50.110631 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e5316-9d90-4d74-bbc1-2e3b01fdbbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:50.110930 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e5316-9d90-4d74-bbc1-2e3b01fdbbc2 None admin] PATH_INFO: `/v3/projects/4cc5ee663d024ca7a96f845a8980eb5b` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:50.112054 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e5316-9d90-4d74-bbc1-2e3b01fdbbc2 None admin] RBAC: Authorizing `identity:get_project(project_id=4cc5ee663d024ca7a96f845a8980eb5b)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:50.114108 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e5316-9d90-4d74-bbc1-2e3b01fdbbc2 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:50.115772 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 585/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:50:49 2022] GET /identity/v3/projects/4cc5ee663d024ca7a96f845a8980eb5b => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:50.122017 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b77fc6-3e64-44b1-ac0c-9ddbb67e7fc0 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:50.227118 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b77fc6-3e64-44b1-ac0c-9ddbb67e7fc0 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:50.262615 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832d7f4-a9fc-4461-b6d8-d98748745bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:50.263238 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832d7f4-a9fc-4461-b6d8-d98748745bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:50.263521 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832d7f4-a9fc-4461-b6d8-d98748745bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:50.263793 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832d7f4-a9fc-4461-b6d8-d98748745bd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:50.264613 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832d7f4-a9fc-4461-b6d8-d98748745bd5 None admin] RBAC: Adding query filter params (role.id=923eb688fccc4e79b6c3df28d754b6c4, scope.project.id=4cc5ee663d024ca7a96f845a8980eb5b, user.id=7c5c75336bf14ea98b8d17eab516ce6f) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:50.264919 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832d7f4-a9fc-4461-b6d8-d98748745bd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:50.266356 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832d7f4-a9fc-4461-b6d8-d98748745bd5 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:50.273728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 545/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:50:50 2022] GET /identity/v3/role_assignments?user.id=7c5c75336bf14ea98b8d17eab516ce6f&scope.project.id=4cc5ee663d024ca7a96f845a8980eb5b&role.id=923eb688fccc4e79b6c3df28d754b6c4 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:52.368315 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1fa03-819c-4671-84d0-61b2d46d99d8 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:52.368846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1fa03-819c-4671-84d0-61b2d46d99d8 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:52.368846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1fa03-819c-4671-84d0-61b2d46d99d8 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:52.370222 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 586/1131] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:50:52.375977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b9524-4f4b-4a0a-9e3c-4aa02d92e938 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:52.376472 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b9524-4f4b-4a0a-9e3c-4aa02d92e938 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:52.376613 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b9524-4f4b-4a0a-9e3c-4aa02d92e938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:52.395341 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-2c5b9524-4f4b-4a0a-9e3c-4aa02d92e938 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:52.396588 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-2c5b9524-4f4b-4a0a-9e3c-4aa02d92e938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:52.446088 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:52.468407 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 546/1132] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:50:52.492574 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1fa03-819c-4671-84d0-61b2d46d99d8 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:52.587912 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:52.598621 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1fa03-819c-4671-84d0-61b2d46d99d8 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:52.635591 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4771ad0-8121-4fba-aef2-d5fac6929b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:52.636277 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4771ad0-8121-4fba-aef2-d5fac6929b9b None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:52.636562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4771ad0-8121-4fba-aef2-d5fac6929b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:52.636847 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4771ad0-8121-4fba-aef2-d5fac6929b9b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:52.637991 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4771ad0-8121-4fba-aef2-d5fac6929b9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:52.639441 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4771ad0-8121-4fba-aef2-d5fac6929b9b None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:52.641074 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 587/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:50:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:52.648539 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b9524-4f4b-4a0a-9e3c-4aa02d92e938 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:52.760746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b9524-4f4b-4a0a-9e3c-4aa02d92e938 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:52.801913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336ac53-10f0-4d0a-8e83-83188aa0c063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:52.802543 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336ac53-10f0-4d0a-8e83-83188aa0c063 None admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:52.802824 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336ac53-10f0-4d0a-8e83-83188aa0c063 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:52.803098 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336ac53-10f0-4d0a-8e83-83188aa0c063 None admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:52.803786 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336ac53-10f0-4d0a-8e83-83188aa0c063 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:52.805264 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336ac53-10f0-4d0a-8e83-83188aa0c063 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:52.888139 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 547/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Aug 2 08:50:52 2022] POST /identity/v3/projects => generated 311 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:50:55.170499 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab272f-fa56-4740-a967-c85c9fd50e38 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:55.171041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab272f-fa56-4740-a967-c85c9fd50e38 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:55.171041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab272f-fa56-4740-a967-c85c9fd50e38 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:55.172475 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 588/1135] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:50:55.179024 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48443b-581d-4ea8-a55a-4295595f562f None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:55.179522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48443b-581d-4ea8-a55a-4295595f562f None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:55.179681 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48443b-581d-4ea8-a55a-4295595f562f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:55.197880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-5a48443b-581d-4ea8-a55a-4295595f562f None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:55.199100 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-5a48443b-581d-4ea8-a55a-4295595f562f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:55.226225 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:55.269207 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 548/1136] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:50:55.294933 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab272f-fa56-4740-a967-c85c9fd50e38 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:55.415099 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab272f-fa56-4740-a967-c85c9fd50e38 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:55.459586 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ace1e-d0c2-4624-8f81-ea6c62feba0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:55.460185 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ace1e-d0c2-4624-8f81-ea6c62feba0e None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:55.460468 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ace1e-d0c2-4624-8f81-ea6c62feba0e None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:55.460739 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ace1e-d0c2-4624-8f81-ea6c62feba0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:55.462056 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ace1e-d0c2-4624-8f81-ea6c62feba0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:55.463636 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ace1e-d0c2-4624-8f81-ea6c62feba0e None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:55.465334 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 589/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:50:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:55.471678 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48443b-581d-4ea8-a55a-4295595f562f None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:55.585725 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48443b-581d-4ea8-a55a-4295595f562f None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:55.623140 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9859e-1233-4d73-ba4d-3052243c4ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:55.623774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9859e-1233-4d73-ba4d-3052243c4ca8 None admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:55.624057 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9859e-1233-4d73-ba4d-3052243c4ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:55.624359 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9859e-1233-4d73-ba4d-3052243c4ca8 None admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:55.625068 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9859e-1233-4d73-ba4d-3052243c4ca8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:55.626549 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9859e-1233-4d73-ba4d-3052243c4ca8 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:55.734225 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 549/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Aug 2 08:50:55 2022] POST /identity/v3/users => generated 286 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:50:57.895186 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0e029-25e3-40e4-9d2f-0326effa5e63 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:57.895726 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0e029-25e3-40e4-9d2f-0326effa5e63 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:57.895726 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0e029-25e3-40e4-9d2f-0326effa5e63 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:57.897128 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 590/1139] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:50:57.902858 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94b191-cd95-42f4-ac56-8ec653ef211e None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:57.903381 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94b191-cd95-42f4-ac56-8ec653ef211e None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:57.903472 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94b191-cd95-42f4-ac56-8ec653ef211e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:57.922557 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-dd94b191-cd95-42f4-ac56-8ec653ef211e None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:50:57.931725 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-dd94b191-cd95-42f4-ac56-8ec653ef211e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:50:57.938790 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:57.999055 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 550/1140] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:50:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:50:58.025486 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0e029-25e3-40e4-9d2f-0326effa5e63 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:58.054111 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:58.135765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0e029-25e3-40e4-9d2f-0326effa5e63 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:58.174030 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa261a-16c8-4b37-be49-4113f1b0c962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:58.174786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa261a-16c8-4b37-be49-4113f1b0c962 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:58.175096 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa261a-16c8-4b37-be49-4113f1b0c962 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:58.175377 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa261a-16c8-4b37-be49-4113f1b0c962 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:58.186064 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa261a-16c8-4b37-be49-4113f1b0c962 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:50:58.191562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-cbaa261a-16c8-4b37-be49-4113f1b0c962 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:50:58.191562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:50:58.191562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:50:58.191562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:50:58.191562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:50:58.191562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:50:58.191562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:50:58.191562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:50:58.191562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:50:58.191562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:50:58.191562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:50:58.191562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:50:58.191562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:50:58.191562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:50:58.191562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:50:58.191562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:50:58.192690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:50:58.192690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:50:58.192690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:50:58.192690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:50:58.192690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:50:58.192690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:50:58.192690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:50:58.192690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:50:58.192690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:50:58.192690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:50:58.192690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:50:58.192690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:50:58.192690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:50:58.192690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:50:58.192690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:50:58.192690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:50:58.194013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:50:58.194013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:50:58.194013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:50:58.194013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:50:58.194013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:50:58.194013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:50:58.194013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:50:58.194013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:50:58.194013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:50:58.194013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:50:58.194013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:50:58.194013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:50:58.194013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 591/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:50:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:50:58.198967 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd94b191-cd95-42f4-ac56-8ec653ef211e None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:58.304803 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd94b191-cd95-42f4-ac56-8ec653ef211e None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:58.340037 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e983b-1cfd-4de2-a5b9-ecdd2d1de0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:58.340818 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e983b-1cfd-4de2-a5b9-ecdd2d1de0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:58.341201 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e983b-1cfd-4de2-a5b9-ecdd2d1de0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:58.341566 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e983b-1cfd-4de2-a5b9-ecdd2d1de0c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:58.342388 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e983b-1cfd-4de2-a5b9-ecdd2d1de0c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:58.342782 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e983b-1cfd-4de2-a5b9-ecdd2d1de0c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:58.344279 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e983b-1cfd-4de2-a5b9-ecdd2d1de0c6 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:58.353740 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 551/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:50:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:50:58.359771 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa261a-16c8-4b37-be49-4113f1b0c962 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:58.458868 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:58.474303 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa261a-16c8-4b37-be49-4113f1b0c962 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:58.510223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f725ab3-26e8-4f21-ac89-0fd21ea77b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:58.510865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f725ab3-26e8-4f21-ac89-0fd21ea77b76 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:58.511145 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f725ab3-26e8-4f21-ac89-0fd21ea77b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:58.511437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f725ab3-26e8-4f21-ac89-0fd21ea77b76 None admin] PATH_INFO: `/v3/users/2d6ec2eb3aeb4a60adf2774710994c0e` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:58.526194 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f725ab3-26e8-4f21-ac89-0fd21ea77b76 None admin] RBAC: Authorizing `identity:get_user(user_id=2d6ec2eb3aeb4a60adf2774710994c0e)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:58.527629 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f725ab3-26e8-4f21-ac89-0fd21ea77b76 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:58.529494 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 592/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:50:58 2022] GET /identity/v3/users/2d6ec2eb3aeb4a60adf2774710994c0e => generated 286 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:58.535615 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e983b-1cfd-4de2-a5b9-ecdd2d1de0c6 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:58.548552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:58.642135 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e983b-1cfd-4de2-a5b9-ecdd2d1de0c6 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:58.681436 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21ee4d-d83a-49fe-b328-6ddc8d56180a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:58.682081 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21ee4d-d83a-49fe-b328-6ddc8d56180a None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:58.682369 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21ee4d-d83a-49fe-b328-6ddc8d56180a None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:58.682648 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21ee4d-d83a-49fe-b328-6ddc8d56180a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:58.769962 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21ee4d-d83a-49fe-b328-6ddc8d56180a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:58.771565 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21ee4d-d83a-49fe-b328-6ddc8d56180a None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:58.784460 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:58.880368 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 552/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:50:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:50:58.886556 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f725ab3-26e8-4f21-ac89-0fd21ea77b76 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:59.002020 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f725ab3-26e8-4f21-ac89-0fd21ea77b76 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:59.038193 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ac66c-7ad3-4df8-b0d6-81de4cd8b4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:59.038818 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ac66c-7ad3-4df8-b0d6-81de4cd8b4af None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:59.039921 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ac66c-7ad3-4df8-b0d6-81de4cd8b4af None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:59.039921 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ac66c-7ad3-4df8-b0d6-81de4cd8b4af None admin] PATH_INFO: `/v3/projects/0cae96a5733742c1b139a1446093e2ac` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:59.040541 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ac66c-7ad3-4df8-b0d6-81de4cd8b4af None admin] RBAC: Authorizing `identity:get_project(project_id=0cae96a5733742c1b139a1446093e2ac)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:59.041985 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ac66c-7ad3-4df8-b0d6-81de4cd8b4af None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:59.043687 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 593/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:50:58 2022] GET /identity/v3/projects/0cae96a5733742c1b139a1446093e2ac => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:50:59.050351 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21ee4d-d83a-49fe-b328-6ddc8d56180a None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:50:59.163745 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21ee4d-d83a-49fe-b328-6ddc8d56180a None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:50:59.174931 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:50:59.198478 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9024b-c747-4777-9160-cb252ce5630f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:50:59.199094 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9024b-c747-4777-9160-cb252ce5630f None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:50:59.199374 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9024b-c747-4777-9160-cb252ce5630f None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:50:59.199635 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9024b-c747-4777-9160-cb252ce5630f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:50:59.200456 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9024b-c747-4777-9160-cb252ce5630f None admin] RBAC: Adding query filter params (role.id=b5477d3c4e5a4514b64211ec2452d1d8, scope.project.id=0cae96a5733742c1b139a1446093e2ac, user.id=2d6ec2eb3aeb4a60adf2774710994c0e) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:50:59.200755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9024b-c747-4777-9160-cb252ce5630f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:50:59.202172 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9024b-c747-4777-9160-cb252ce5630f None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:50:59.207965 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 553/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:50:59 2022] GET /identity/v3/role_assignments?user.id=2d6ec2eb3aeb4a60adf2774710994c0e&scope.project.id=0cae96a5733742c1b139a1446093e2ac&role.id=b5477d3c4e5a4514b64211ec2452d1d8 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:51:01.261313 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab60da-8c5a-4c1b-8034-60294b520ac1 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:01.261867 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab60da-8c5a-4c1b-8034-60294b520ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:01.261867 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab60da-8c5a-4c1b-8034-60294b520ac1 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:01.263271 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 594/1147] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:51:01.268965 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8737cac-a289-419f-a330-3a314689624e None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:01.269437 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8737cac-a289-419f-a330-3a314689624e None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:01.269531 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8737cac-a289-419f-a330-3a314689624e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:01.289346 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-b8737cac-a289-419f-a330-3a314689624e None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:51:01.290621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-b8737cac-a289-419f-a330-3a314689624e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:51:01.361334 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 554/1148] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:51:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:51:01.384612 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fab60da-8c5a-4c1b-8034-60294b520ac1 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:01.399723 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:01.496292 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fab60da-8c5a-4c1b-8034-60294b520ac1 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:01.535877 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bee314-2d60-4984-9015-6b479cf11a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:01.536564 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bee314-2d60-4984-9015-6b479cf11a65 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:01.536754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bee314-2d60-4984-9015-6b479cf11a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:01.537027 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bee314-2d60-4984-9015-6b479cf11a65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:01.547372 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bee314-2d60-4984-9015-6b479cf11a65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:51:01.552461 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-c5bee314-2d60-4984-9015-6b479cf11a65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:51:01.552461 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:51:01.552461 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:51:01.552461 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:51:01.552461 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:51:01.552461 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:51:01.552461 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:51:01.552461 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:51:01.552461 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:51:01.552461 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:51:01.552461 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:51:01.552461 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:51:01.552461 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:51:01.552461 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:51:01.552461 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:51:01.552461 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:51:01.553664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:51:01.553664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:51:01.553664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:51:01.553664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:51:01.553664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:51:01.553664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:51:01.553664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:51:01.553664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:51:01.553664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:51:01.553664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:51:01.553664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:51:01.553664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:51:01.553664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:51:01.553664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:51:01.553664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:51:01.553664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:51:01.554726 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:51:01.554726 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:51:01.554726 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:51:01.554726 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:51:01.554726 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:51:01.554726 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:51:01.554726 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:51:01.554726 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:51:01.554726 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:51:01.554726 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:51:01.554726 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:51:01.554726 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:51:01.554726 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 595/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:51:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:51:01.559892 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8737cac-a289-419f-a330-3a314689624e None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:01.663403 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8737cac-a289-419f-a330-3a314689624e None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:01.666698 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:01.698603 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746c484-3af0-4345-997a-cf4ff174fc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:01.699228 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746c484-3af0-4345-997a-cf4ff174fc97 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:01.699509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746c484-3af0-4345-997a-cf4ff174fc97 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:01.699782 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746c484-3af0-4345-997a-cf4ff174fc97 None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:01.700527 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746c484-3af0-4345-997a-cf4ff174fc97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:51:01.700830 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746c484-3af0-4345-997a-cf4ff174fc97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:01.702280 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746c484-3af0-4345-997a-cf4ff174fc97 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:01.711907 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 555/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:51:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:51:01.717874 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bee314-2d60-4984-9015-6b479cf11a65 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:01.791711 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:01.823019 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bee314-2d60-4984-9015-6b479cf11a65 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:01.864635 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50154c84-d053-4f97-aa49-391644a73bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:01.865296 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50154c84-d053-4f97-aa49-391644a73bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:01.865576 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50154c84-d053-4f97-aa49-391644a73bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:01.865843 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50154c84-d053-4f97-aa49-391644a73bc4 None admin] PATH_INFO: `/v3/users/2d6ec2eb3aeb4a60adf2774710994c0e` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:01.867071 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50154c84-d053-4f97-aa49-391644a73bc4 None admin] RBAC: Authorizing `identity:get_user(user_id=2d6ec2eb3aeb4a60adf2774710994c0e)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:01.868588 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50154c84-d053-4f97-aa49-391644a73bc4 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:01.870299 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 596/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:51:01 2022] GET /identity/v3/users/2d6ec2eb3aeb4a60adf2774710994c0e => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:51:01.876729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746c484-3af0-4345-997a-cf4ff174fc97 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:01.990353 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746c484-3af0-4345-997a-cf4ff174fc97 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:02.028414 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c03353-1985-4460-a361-3005a5b9083f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:02.029078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c03353-1985-4460-a361-3005a5b9083f None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:02.029356 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c03353-1985-4460-a361-3005a5b9083f None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:02.029630 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c03353-1985-4460-a361-3005a5b9083f None admin] PATH_INFO: `/v3/projects/0cae96a5733742c1b139a1446093e2ac` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:02.030825 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c03353-1985-4460-a361-3005a5b9083f None admin] RBAC: Authorizing `identity:get_project(project_id=0cae96a5733742c1b139a1446093e2ac)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:02.032301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c03353-1985-4460-a361-3005a5b9083f None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:02.034710 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 556/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:51:01 2022] GET /identity/v3/projects/0cae96a5733742c1b139a1446093e2ac => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:51:02.042373 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50154c84-d053-4f97-aa49-391644a73bc4 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:02.150120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50154c84-d053-4f97-aa49-391644a73bc4 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:02.191553 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e64dd5-02a7-4351-b967-bf26539ef2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:02.192266 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e64dd5-02a7-4351-b967-bf26539ef2fe None admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:02.192553 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e64dd5-02a7-4351-b967-bf26539ef2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:02.192833 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e64dd5-02a7-4351-b967-bf26539ef2fe None admin] PATH_INFO: `/v3/projects/0cae96a5733742c1b139a1446093e2ac/users/2d6ec2eb3aeb4a60adf2774710994c0e/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:02.194813 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e64dd5-02a7-4351-b967-bf26539ef2fe None admin] RBAC: Authorizing `identity:create_grant(project_id=0cae96a5733742c1b139a1446093e2ac, user_id=2d6ec2eb3aeb4a60adf2774710994c0e, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:02.196290 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e64dd5-02a7-4351-b967-bf26539ef2fe None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:02.287941 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:02.293409 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 597/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Aug 2 08:51:02 2022] PUT /identity/v3/projects/0cae96a5733742c1b139a1446093e2ac/users/2d6ec2eb3aeb4a60adf2774710994c0e/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:51:04.317148 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f344e-7a96-453b-af06-f4994d212f75 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:04.317761 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f344e-7a96-453b-af06-f4994d212f75 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:04.317761 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f344e-7a96-453b-af06-f4994d212f75 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:04.319037 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 557/1154] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:51:04.324809 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e7477-4561-4a4f-b2a9-c35108e915cf None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:04.325317 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e7477-4561-4a4f-b2a9-c35108e915cf None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:04.325411 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e7477-4561-4a4f-b2a9-c35108e915cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:04.344700 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-d58e7477-4561-4a4f-b2a9-c35108e915cf None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:51:04.346493 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-d58e7477-4561-4a4f-b2a9-c35108e915cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:51:04.424734 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 598/1155] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:51:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:51:04.448705 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f344e-7a96-453b-af06-f4994d212f75 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:04.485899 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:04.556912 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f344e-7a96-453b-af06-f4994d212f75 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:04.591464 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a24eb4-1aea-4395-8436-34eb3b31d083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:04.592109 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a24eb4-1aea-4395-8436-34eb3b31d083 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:04.592419 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a24eb4-1aea-4395-8436-34eb3b31d083 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:04.592689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a24eb4-1aea-4395-8436-34eb3b31d083 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:04.603511 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a24eb4-1aea-4395-8436-34eb3b31d083 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:51:04.607852 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-99a24eb4-1aea-4395-8436-34eb3b31d083 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:51:04.607852 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:51:04.607852 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:51:04.607852 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:51:04.607852 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:51:04.607852 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:51:04.607852 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:51:04.607852 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:51:04.607852 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:51:04.607852 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:51:04.607852 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:51:04.607852 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:51:04.607852 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:51:04.607852 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:51:04.607852 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:51:04.607852 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:51:04.609108 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:51:04.609108 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:51:04.609108 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:51:04.609108 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:51:04.609108 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:51:04.609108 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:51:04.609108 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:51:04.609108 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:51:04.609108 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:51:04.609108 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:51:04.609108 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:51:04.609108 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:51:04.609108 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:51:04.609108 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:51:04.609108 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:51:04.609108 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:51:04.610462 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:51:04.610462 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:51:04.610462 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:51:04.610462 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:51:04.610462 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:51:04.610462 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:51:04.610462 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:51:04.610462 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:51:04.610462 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:51:04.610462 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:51:04.610462 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:51:04.610462 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:51:04.610462 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 558/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:51:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:51:04.616070 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e7477-4561-4a4f-b2a9-c35108e915cf None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:04.718747 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e7477-4561-4a4f-b2a9-c35108e915cf None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:04.749392 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:04.755827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c1bb3-7224-4614-b559-c98f0e992769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:04.764235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c1bb3-7224-4614-b559-c98f0e992769 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:04.764235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c1bb3-7224-4614-b559-c98f0e992769 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:04.764235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c1bb3-7224-4614-b559-c98f0e992769 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:04.764235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c1bb3-7224-4614-b559-c98f0e992769 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:51:04.764235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c1bb3-7224-4614-b559-c98f0e992769 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:04.764235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c1bb3-7224-4614-b559-c98f0e992769 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:04.768798 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 599/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:51:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:51:04.774597 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a24eb4-1aea-4395-8436-34eb3b31d083 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:04.873808 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:04.881005 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a24eb4-1aea-4395-8436-34eb3b31d083 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:04.925216 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd7d6f-9fc2-4eee-9fdb-5675bfdda899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:04.925866 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd7d6f-9fc2-4eee-9fdb-5675bfdda899 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:04.926148 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd7d6f-9fc2-4eee-9fdb-5675bfdda899 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:04.926420 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd7d6f-9fc2-4eee-9fdb-5675bfdda899 None admin] PATH_INFO: `/v3/users/2d6ec2eb3aeb4a60adf2774710994c0e` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:04.927611 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd7d6f-9fc2-4eee-9fdb-5675bfdda899 None admin] RBAC: Authorizing `identity:get_user(user_id=2d6ec2eb3aeb4a60adf2774710994c0e)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:04.929127 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd7d6f-9fc2-4eee-9fdb-5675bfdda899 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:04.935721 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 559/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:51:04 2022] GET /identity/v3/users/2d6ec2eb3aeb4a60adf2774710994c0e => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:51:04.936625 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c1bb3-7224-4614-b559-c98f0e992769 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:05.042926 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c1bb3-7224-4614-b559-c98f0e992769 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:05.083331 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b004434-842c-4cef-bafb-4cbccb10cb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:05.083972 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b004434-842c-4cef-bafb-4cbccb10cb97 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:05.084285 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b004434-842c-4cef-bafb-4cbccb10cb97 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:05.084557 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b004434-842c-4cef-bafb-4cbccb10cb97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:05.150353 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:05.164942 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b004434-842c-4cef-bafb-4cbccb10cb97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:05.167678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b004434-842c-4cef-bafb-4cbccb10cb97 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:05.280357 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 600/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:51:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:51:05.287673 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd7d6f-9fc2-4eee-9fdb-5675bfdda899 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:05.404471 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd7d6f-9fc2-4eee-9fdb-5675bfdda899 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:05.440397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2280f6-a5a8-43ae-8793-ebdb443b01d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:05.441048 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2280f6-a5a8-43ae-8793-ebdb443b01d9 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:05.441334 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2280f6-a5a8-43ae-8793-ebdb443b01d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:05.441611 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2280f6-a5a8-43ae-8793-ebdb443b01d9 None admin] PATH_INFO: `/v3/projects/0cae96a5733742c1b139a1446093e2ac` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:05.442793 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2280f6-a5a8-43ae-8793-ebdb443b01d9 None admin] RBAC: Authorizing `identity:get_project(project_id=0cae96a5733742c1b139a1446093e2ac)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:05.444247 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2280f6-a5a8-43ae-8793-ebdb443b01d9 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:05.445962 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 560/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:51:05 2022] GET /identity/v3/projects/0cae96a5733742c1b139a1446093e2ac => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:51:05.452243 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b004434-842c-4cef-bafb-4cbccb10cb97 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:05.548151 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:05.556891 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b004434-842c-4cef-bafb-4cbccb10cb97 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:05.592030 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2940a-81ef-40b8-8fbb-e0ade08e089b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:05.592675 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2940a-81ef-40b8-8fbb-e0ade08e089b None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:05.592952 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2940a-81ef-40b8-8fbb-e0ade08e089b None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:05.593218 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2940a-81ef-40b8-8fbb-e0ade08e089b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:05.593999 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2940a-81ef-40b8-8fbb-e0ade08e089b None admin] RBAC: Adding query filter params (role.id=b5477d3c4e5a4514b64211ec2452d1d8, scope.project.id=0cae96a5733742c1b139a1446093e2ac, user.id=2d6ec2eb3aeb4a60adf2774710994c0e) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:51:05.594301 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2940a-81ef-40b8-8fbb-e0ade08e089b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:05.595818 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2940a-81ef-40b8-8fbb-e0ade08e089b None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:05.603513 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 601/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:51:05 2022] GET /identity/v3/role_assignments?user.id=2d6ec2eb3aeb4a60adf2774710994c0e&scope.project.id=0cae96a5733742c1b139a1446093e2ac&role.id=b5477d3c4e5a4514b64211ec2452d1d8 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:51:07.706416 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258d8fb-0294-4f5b-a33c-f6e010defa56 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:07.706954 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258d8fb-0294-4f5b-a33c-f6e010defa56 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:07.706954 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258d8fb-0294-4f5b-a33c-f6e010defa56 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:07.708325 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 561/1162] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:51:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:51:07.713847 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4af20-0ae8-41a5-9124-20f475e0791e None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:07.714249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4af20-0ae8-41a5-9124-20f475e0791e None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:07.714389 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4af20-0ae8-41a5-9124-20f475e0791e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:07.734077 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-d9b4af20-0ae8-41a5-9124-20f475e0791e None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:51:07.735282 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-d9b4af20-0ae8-41a5-9124-20f475e0791e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:51:07.805352 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 602/1163] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:51:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:51:07.827631 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258d8fb-0294-4f5b-a33c-f6e010defa56 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:07.859341 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:07.937798 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258d8fb-0294-4f5b-a33c-f6e010defa56 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:07.973349 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0f30c-8b44-46f2-a97a-c8c371e5349f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:07.973882 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0f30c-8b44-46f2-a97a-c8c371e5349f None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:07.974164 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0f30c-8b44-46f2-a97a-c8c371e5349f None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:07.974445 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0f30c-8b44-46f2-a97a-c8c371e5349f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:08.042963 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0f30c-8b44-46f2-a97a-c8c371e5349f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:08.044473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0f30c-8b44-46f2-a97a-c8c371e5349f None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:08.074342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:08.145548 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 562/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:51:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 08:51:08.151609 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4af20-0ae8-41a5-9124-20f475e0791e None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:08.239129 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:08.254583 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4af20-0ae8-41a5-9124-20f475e0791e None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:08.293028 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51c9cd-0f4f-48c7-af40-601d3c900c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:08.293688 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51c9cd-0f4f-48c7-af40-601d3c900c3c None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:08.293968 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51c9cd-0f4f-48c7-af40-601d3c900c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:08.294242 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51c9cd-0f4f-48c7-af40-601d3c900c3c None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:08.301671 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51c9cd-0f4f-48c7-af40-601d3c900c3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:08.303157 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51c9cd-0f4f-48c7-af40-601d3c900c3c None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:08.315670 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-cc51c9cd-0f4f-48c7-af40-601d3c900c3c None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 02 08:51:08.315670 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:51:08.315670 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 02 08:51:08.315670 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 02 08:51:08.315670 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:51:08.315670 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:51:08.315670 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:51:08.315670 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:51:08.315670 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 02 08:51:08.315670 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:51:08.315670 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:51:08.315670 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:51:08.315670 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:51:08.315670 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:51:08.315670 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:51:08.315670 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:51:08.315670 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:51:08.318009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:51:08.318009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:51:08.318009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:51:08.318009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:51:08.318009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:51:08.318009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:51:08.318009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:51:08.318009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:51:08.318009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:51:08.318009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:51:08.318009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:51:08.318009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:51:08.318009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:51:08.318009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:51:08.318009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:51:08.318009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:51:08.320120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:51:08.320120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:51:08.320120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:51:08.320120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:51:08.320120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:51:08.320120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:51:08.320120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:51:08.320120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:51:08.320120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:51:08.320120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:51:08.320120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 02 08:51:08.320120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:51:08.320120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 02 08:51:08.320120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:51:08.320120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 603/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Aug 2 08:51:08 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:51:08.325266 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0f30c-8b44-46f2-a97a-c8c371e5349f None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:08.442192 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0f30c-8b44-46f2-a97a-c8c371e5349f None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:08.474763 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:08.480910 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566da12f-dd1e-41d9-9681-d1911e2a1206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:08.481563 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566da12f-dd1e-41d9-9681-d1911e2a1206 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:08.481844 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566da12f-dd1e-41d9-9681-d1911e2a1206 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:08.482121 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566da12f-dd1e-41d9-9681-d1911e2a1206 None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:08.482833 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566da12f-dd1e-41d9-9681-d1911e2a1206 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:51:08.483170 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566da12f-dd1e-41d9-9681-d1911e2a1206 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:08.484608 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566da12f-dd1e-41d9-9681-d1911e2a1206 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:08.493202 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 563/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Aug 2 08:51:08 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:51:10.541921 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe883b35-2417-4f2e-9dff-24972a23ed23 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:10.542443 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe883b35-2417-4f2e-9dff-24972a23ed23 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:10.542443 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe883b35-2417-4f2e-9dff-24972a23ed23 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:10.543757 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 604/1167] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:51:10.549619 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce54ac-38b1-402c-8764-d2d5588b1e23 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:10.550084 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce54ac-38b1-402c-8764-d2d5588b1e23 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:10.550195 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce54ac-38b1-402c-8764-d2d5588b1e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:10.569530 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-c1ce54ac-38b1-402c-8764-d2d5588b1e23 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:51:10.570832 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-c1ce54ac-38b1-402c-8764-d2d5588b1e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:51:10.640496 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 564/1168] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:51:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:51:10.664556 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe883b35-2417-4f2e-9dff-24972a23ed23 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:10.770730 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe883b35-2417-4f2e-9dff-24972a23ed23 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:10.807944 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd571872-d6a6-4cbb-8572-a9391853bf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:10.808522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd571872-d6a6-4cbb-8572-a9391853bf4a None admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:10.808808 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd571872-d6a6-4cbb-8572-a9391853bf4a None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:10.809084 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd571872-d6a6-4cbb-8572-a9391853bf4a None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:10.809852 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd571872-d6a6-4cbb-8572-a9391853bf4a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:10.811225 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd571872-d6a6-4cbb-8572-a9391853bf4a None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:10.956408 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 605/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Tue Aug 2 08:51:10 2022] POST /identity/v3/domains => generated 267 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:51:13.042287 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737a797-5441-4153-b36c-a8f0d4ca76cc None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:13.042820 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737a797-5441-4153-b36c-a8f0d4ca76cc None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:13.042820 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737a797-5441-4153-b36c-a8f0d4ca76cc None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:13.044229 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 565/1170] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:51:13.049787 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91523a-2402-4cc1-86c4-b94f306ad09e None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:13.050221 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91523a-2402-4cc1-86c4-b94f306ad09e None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:13.050374 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91523a-2402-4cc1-86c4-b94f306ad09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:13.063453 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:13.069218 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-7f91523a-2402-4cc1-86c4-b94f306ad09e None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:51:13.070417 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-7f91523a-2402-4cc1-86c4-b94f306ad09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:51:13.143084 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 606/1171] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:51:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:51:13.167282 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737a797-5441-4153-b36c-a8f0d4ca76cc None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:13.284521 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737a797-5441-4153-b36c-a8f0d4ca76cc None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:13.311139 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:13.323910 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61210d59-c29f-438c-8fdb-f3a9d3d898f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:13.324833 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61210d59-c29f-438c-8fdb-f3a9d3d898f3 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:13.324833 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61210d59-c29f-438c-8fdb-f3a9d3d898f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:13.325107 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61210d59-c29f-438c-8fdb-f3a9d3d898f3 None admin] PATH_INFO: `/v3/domains/22b5dd30b2aa4542a1068b54514b3209` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:13.342079 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61210d59-c29f-438c-8fdb-f3a9d3d898f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=22b5dd30b2aa4542a1068b54514b3209)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:13.343555 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61210d59-c29f-438c-8fdb-f3a9d3d898f3 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:13.345882 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 566/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Tue Aug 2 08:51:13 2022] GET /identity/v3/domains/22b5dd30b2aa4542a1068b54514b3209 => generated 267 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:51:13.352992 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91523a-2402-4cc1-86c4-b94f306ad09e None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:13.468283 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91523a-2402-4cc1-86c4-b94f306ad09e None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:13.502701 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a3b8a-78c3-4da9-9539-de93e8d63467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:13.503404 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a3b8a-78c3-4da9-9539-de93e8d63467 None admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:13.503610 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a3b8a-78c3-4da9-9539-de93e8d63467 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:13.503878 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a3b8a-78c3-4da9-9539-de93e8d63467 None admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:13.504591 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a3b8a-78c3-4da9-9539-de93e8d63467 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:13.506006 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a3b8a-78c3-4da9-9539-de93e8d63467 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:13.511419 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:13.613765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 607/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Aug 2 08:51:13 2022] POST /identity/v3/projects => generated 361 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:51:15.681167 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f12c10-0822-4135-af9b-7f55acf65e78 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:15.681729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f12c10-0822-4135-af9b-7f55acf65e78 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:15.681729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f12c10-0822-4135-af9b-7f55acf65e78 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:15.683086 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 567/1174] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:51:15.688404 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04380e2e-1881-48fc-beb0-59758023c65e None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:15.688881 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04380e2e-1881-48fc-beb0-59758023c65e None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:15.689479 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04380e2e-1881-48fc-beb0-59758023c65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:15.707451 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-04380e2e-1881-48fc-beb0-59758023c65e None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:51:15.708698 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-04380e2e-1881-48fc-beb0-59758023c65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:51:15.779508 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 608/1175] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:51:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:51:15.804755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f12c10-0822-4135-af9b-7f55acf65e78 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:15.909995 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f12c10-0822-4135-af9b-7f55acf65e78 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:15.945388 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c38e8-1563-4c7b-806d-489663f0be61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:15.945945 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c38e8-1563-4c7b-806d-489663f0be61 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:15.946223 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c38e8-1563-4c7b-806d-489663f0be61 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:15.946496 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c38e8-1563-4c7b-806d-489663f0be61 None admin] PATH_INFO: `/v3/domains/22b5dd30b2aa4542a1068b54514b3209` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:15.947641 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c38e8-1563-4c7b-806d-489663f0be61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=22b5dd30b2aa4542a1068b54514b3209)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:15.949095 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c38e8-1563-4c7b-806d-489663f0be61 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:15.950683 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 568/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Tue Aug 2 08:51:15 2022] GET /identity/v3/domains/22b5dd30b2aa4542a1068b54514b3209 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:51:15.957150 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04380e2e-1881-48fc-beb0-59758023c65e None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:16.059465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04380e2e-1881-48fc-beb0-59758023c65e None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:16.076963 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:16.094796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086a555-7926-4ba4-a96d-bb21cafa1941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:16.100084 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086a555-7926-4ba4-a96d-bb21cafa1941 None admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:16.100084 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086a555-7926-4ba4-a96d-bb21cafa1941 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:16.100084 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086a555-7926-4ba4-a96d-bb21cafa1941 None admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:16.100084 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086a555-7926-4ba4-a96d-bb21cafa1941 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:16.100084 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086a555-7926-4ba4-a96d-bb21cafa1941 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:16.269222 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 609/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Aug 2 08:51:15 2022] POST /identity/v3/users => generated 311 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:51:18.536827 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b51b4e-4abd-4f37-a854-8e54f2af18c2 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:18.537408 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b51b4e-4abd-4f37-a854-8e54f2af18c2 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:18.537408 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b51b4e-4abd-4f37-a854-8e54f2af18c2 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:18.538820 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 569/1178] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:51:18.545316 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f0835-31d5-491f-873d-23788edf6049 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:18.545983 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f0835-31d5-491f-873d-23788edf6049 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:18.545983 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f0835-31d5-491f-873d-23788edf6049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:18.566511 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-0a6f0835-31d5-491f-873d-23788edf6049 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:51:18.567756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-0a6f0835-31d5-491f-873d-23788edf6049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:51:18.643119 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 610/1179] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:51:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:51:18.667468 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b51b4e-4abd-4f37-a854-8e54f2af18c2 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:18.728790 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:18.780616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b51b4e-4abd-4f37-a854-8e54f2af18c2 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:18.815583 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad07fd-e2ce-42d3-9fc7-9a9b2d72a6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:18.816137 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad07fd-e2ce-42d3-9fc7-9a9b2d72a6cc None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:18.816456 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad07fd-e2ce-42d3-9fc7-9a9b2d72a6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:18.816733 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad07fd-e2ce-42d3-9fc7-9a9b2d72a6cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:18.827797 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad07fd-e2ce-42d3-9fc7-9a9b2d72a6cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:51:18.832915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-03ad07fd-e2ce-42d3-9fc7-9a9b2d72a6cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:51:18.832915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:51:18.832915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:51:18.832915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:51:18.832915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:51:18.832915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:51:18.832915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:51:18.832915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:51:18.832915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:51:18.832915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:51:18.832915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:51:18.832915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:51:18.832915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:51:18.832915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:51:18.832915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:51:18.832915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:51:18.834689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:51:18.834689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:51:18.834689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:51:18.834689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:51:18.834689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:51:18.834689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:51:18.834689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:51:18.834689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:51:18.834689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:51:18.834689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:51:18.834689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:51:18.834689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:51:18.834689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:51:18.834689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:51:18.834689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:51:18.834689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:51:18.836357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:51:18.836357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:51:18.836357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:51:18.836357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:51:18.836357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:51:18.836357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:51:18.836357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:51:18.836357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:51:18.836357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:51:18.836357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:51:18.836357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:51:18.836357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:51:18.836357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 570/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:51:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:51:18.840354 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f0835-31d5-491f-873d-23788edf6049 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:18.943090 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f0835-31d5-491f-873d-23788edf6049 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:18.945424 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:18.976839 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4472cba-840a-438b-820f-4f8690631a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:18.977524 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4472cba-840a-438b-820f-4f8690631a40 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:18.978194 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4472cba-840a-438b-820f-4f8690631a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:18.978515 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4472cba-840a-438b-820f-4f8690631a40 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:18.979252 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4472cba-840a-438b-820f-4f8690631a40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:51:18.979560 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4472cba-840a-438b-820f-4f8690631a40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:18.981013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4472cba-840a-438b-820f-4f8690631a40 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:18.990279 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 611/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:51:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:51:18.996153 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad07fd-e2ce-42d3-9fc7-9a9b2d72a6cc None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:19.109242 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad07fd-e2ce-42d3-9fc7-9a9b2d72a6cc None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:19.124083 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:19.147490 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c12077-a3e6-4c93-b1b2-ea14afe22f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:19.148132 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c12077-a3e6-4c93-b1b2-ea14afe22f95 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:19.148435 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c12077-a3e6-4c93-b1b2-ea14afe22f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:19.148737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c12077-a3e6-4c93-b1b2-ea14afe22f95 None admin] PATH_INFO: `/v3/users/70b92a602db143dfaf26caaf716b023b` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:19.164661 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c12077-a3e6-4c93-b1b2-ea14afe22f95 None admin] RBAC: Authorizing `identity:get_user(user_id=70b92a602db143dfaf26caaf716b023b)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:19.166145 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c12077-a3e6-4c93-b1b2-ea14afe22f95 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:19.167872 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 571/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:51:18 2022] GET /identity/v3/users/70b92a602db143dfaf26caaf716b023b => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:51:19.175295 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4472cba-840a-438b-820f-4f8690631a40 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:19.282079 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4472cba-840a-438b-820f-4f8690631a40 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:19.318300 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec10e7e-1bea-4d81-8b1f-cf1ea9966bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:19.318923 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec10e7e-1bea-4d81-8b1f-cf1ea9966bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:19.319213 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec10e7e-1bea-4d81-8b1f-cf1ea9966bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:19.319488 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec10e7e-1bea-4d81-8b1f-cf1ea9966bc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:19.354962 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:19.394480 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec10e7e-1bea-4d81-8b1f-cf1ea9966bc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:19.395940 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec10e7e-1bea-4d81-8b1f-cf1ea9966bc1 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:19.508817 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 612/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:51:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:51:19.515198 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c12077-a3e6-4c93-b1b2-ea14afe22f95 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:19.620781 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c12077-a3e6-4c93-b1b2-ea14afe22f95 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:19.656389 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cad34c-eb19-4db5-914e-ec2cf1f78bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:19.656957 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cad34c-eb19-4db5-914e-ec2cf1f78bdf None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:19.657313 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cad34c-eb19-4db5-914e-ec2cf1f78bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:19.658099 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cad34c-eb19-4db5-914e-ec2cf1f78bdf None admin] PATH_INFO: `/v3/projects/98f13361fbe54bc6bb347b13590ff189` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:19.659275 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cad34c-eb19-4db5-914e-ec2cf1f78bdf None admin] RBAC: Authorizing `identity:get_project(project_id=98f13361fbe54bc6bb347b13590ff189)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:19.660822 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cad34c-eb19-4db5-914e-ec2cf1f78bdf None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:19.662514 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 572/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:51:19 2022] GET /identity/v3/projects/98f13361fbe54bc6bb347b13590ff189 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:51:19.668780 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec10e7e-1bea-4d81-8b1f-cf1ea9966bc1 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:19.735188 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:19.770995 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec10e7e-1bea-4d81-8b1f-cf1ea9966bc1 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:19.805981 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a68b37-7492-4f1d-adeb-918a5c765849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:19.806608 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a68b37-7492-4f1d-adeb-918a5c765849 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:19.806894 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a68b37-7492-4f1d-adeb-918a5c765849 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:19.807173 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a68b37-7492-4f1d-adeb-918a5c765849 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:19.807976 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a68b37-7492-4f1d-adeb-918a5c765849 None admin] RBAC: Adding query filter params (role.id=b5477d3c4e5a4514b64211ec2452d1d8, scope.project.id=98f13361fbe54bc6bb347b13590ff189, user.id=70b92a602db143dfaf26caaf716b023b) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:51:19.808320 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a68b37-7492-4f1d-adeb-918a5c765849 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:19.809836 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a68b37-7492-4f1d-adeb-918a5c765849 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:19.815698 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 613/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:51:19 2022] GET /identity/v3/role_assignments?user.id=70b92a602db143dfaf26caaf716b023b&scope.project.id=98f13361fbe54bc6bb347b13590ff189&role.id=b5477d3c4e5a4514b64211ec2452d1d8 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:51:21.881353 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6229ba-2eb3-47f7-8a1e-e9579dc17ebf None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:21.881887 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6229ba-2eb3-47f7-8a1e-e9579dc17ebf None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:21.881887 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6229ba-2eb3-47f7-8a1e-e9579dc17ebf None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:21.883222 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 573/1186] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:51:21.888618 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543b61d-4668-46e4-b980-5557f85efe06 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:21.889066 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543b61d-4668-46e4-b980-5557f85efe06 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:21.889208 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543b61d-4668-46e4-b980-5557f85efe06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:21.912252 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-6543b61d-4668-46e4-b980-5557f85efe06 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:51:21.913467 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-6543b61d-4668-46e4-b980-5557f85efe06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:51:21.982594 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 614/1187] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:51:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:51:22.005890 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6229ba-2eb3-47f7-8a1e-e9579dc17ebf None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:22.050070 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:22.109733 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6229ba-2eb3-47f7-8a1e-e9579dc17ebf None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:22.145163 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc298f77-ded5-42d0-819f-7d5358ae33cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:22.145714 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc298f77-ded5-42d0-819f-7d5358ae33cd None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:22.145991 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc298f77-ded5-42d0-819f-7d5358ae33cd None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:22.146304 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc298f77-ded5-42d0-819f-7d5358ae33cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:22.156996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc298f77-ded5-42d0-819f-7d5358ae33cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:51:22.163636 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-cc298f77-ded5-42d0-819f-7d5358ae33cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:51:22.163636 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:51:22.163636 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:51:22.163636 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:51:22.163636 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:51:22.163636 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:51:22.163636 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:51:22.163636 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:51:22.163636 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:51:22.163636 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:51:22.163636 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:51:22.163636 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:51:22.163636 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:51:22.163636 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:51:22.163636 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:51:22.163636 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:51:22.164874 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:51:22.164874 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:51:22.164874 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:51:22.164874 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:51:22.164874 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:51:22.164874 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:51:22.164874 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:51:22.164874 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:51:22.164874 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:51:22.164874 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:51:22.164874 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:51:22.164874 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:51:22.164874 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:51:22.164874 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:51:22.164874 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:51:22.164874 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:51:22.166179 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:51:22.166179 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:51:22.166179 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:51:22.166179 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:51:22.166179 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:51:22.166179 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:51:22.166179 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:51:22.166179 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:51:22.166179 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:51:22.166179 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:51:22.166179 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:51:22.166179 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:51:22.166179 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 574/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:51:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:51:22.170976 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543b61d-4668-46e4-b980-5557f85efe06 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:22.231316 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:22.272216 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543b61d-4668-46e4-b980-5557f85efe06 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:22.307843 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16a25c-fda1-482b-bbd5-164384c65072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:22.308498 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16a25c-fda1-482b-bbd5-164384c65072 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:22.308785 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16a25c-fda1-482b-bbd5-164384c65072 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:22.309059 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16a25c-fda1-482b-bbd5-164384c65072 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:22.309776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16a25c-fda1-482b-bbd5-164384c65072 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:51:22.310078 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16a25c-fda1-482b-bbd5-164384c65072 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:22.311453 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16a25c-fda1-482b-bbd5-164384c65072 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:22.320021 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 615/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:51:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:51:22.326058 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc298f77-ded5-42d0-819f-7d5358ae33cd None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:22.432143 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:22.435576 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc298f77-ded5-42d0-819f-7d5358ae33cd None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:22.472461 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e331e4-5f27-4193-9738-e0bcedcdd910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:22.473042 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e331e4-5f27-4193-9738-e0bcedcdd910 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:22.473322 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e331e4-5f27-4193-9738-e0bcedcdd910 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:22.473595 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e331e4-5f27-4193-9738-e0bcedcdd910 None admin] PATH_INFO: `/v3/users/70b92a602db143dfaf26caaf716b023b` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:22.474841 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e331e4-5f27-4193-9738-e0bcedcdd910 None admin] RBAC: Authorizing `identity:get_user(user_id=70b92a602db143dfaf26caaf716b023b)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:22.476347 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e331e4-5f27-4193-9738-e0bcedcdd910 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:22.478055 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 575/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:51:22 2022] GET /identity/v3/users/70b92a602db143dfaf26caaf716b023b => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:51:22.484197 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16a25c-fda1-482b-bbd5-164384c65072 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:22.597111 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16a25c-fda1-482b-bbd5-164384c65072 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:22.622750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:22.635354 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0d493-0009-46b5-ae44-62b4fa10f58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:22.636391 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0d493-0009-46b5-ae44-62b4fa10f58b None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:22.636391 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0d493-0009-46b5-ae44-62b4fa10f58b None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:22.636593 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0d493-0009-46b5-ae44-62b4fa10f58b None admin] PATH_INFO: `/v3/projects/98f13361fbe54bc6bb347b13590ff189` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:22.637800 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e0d493-0009-46b5-ae44-62b4fa10f58b None admin] RBAC: Authorizing `identity:get_project(project_id=98f13361fbe54bc6bb347b13590ff189)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:22.639288 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e0d493-0009-46b5-ae44-62b4fa10f58b None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:22.641110 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 616/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:51:22 2022] GET /identity/v3/projects/98f13361fbe54bc6bb347b13590ff189 => generated 361 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:51:22.648148 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e331e4-5f27-4193-9738-e0bcedcdd910 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:22.756048 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e331e4-5f27-4193-9738-e0bcedcdd910 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:22.803263 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76223fd1-4a55-4b39-a456-cdf50bec1dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:22.803948 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76223fd1-4a55-4b39-a456-cdf50bec1dd1 None admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:22.804254 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76223fd1-4a55-4b39-a456-cdf50bec1dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:22.804538 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76223fd1-4a55-4b39-a456-cdf50bec1dd1 None admin] PATH_INFO: `/v3/projects/98f13361fbe54bc6bb347b13590ff189/users/70b92a602db143dfaf26caaf716b023b/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:22.806473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76223fd1-4a55-4b39-a456-cdf50bec1dd1 None admin] RBAC: Authorizing `identity:create_grant(project_id=98f13361fbe54bc6bb347b13590ff189, user_id=70b92a602db143dfaf26caaf716b023b, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:22.807906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76223fd1-4a55-4b39-a456-cdf50bec1dd1 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:22.874894 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 576/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Aug 2 08:51:22 2022] PUT /identity/v3/projects/98f13361fbe54bc6bb347b13590ff189/users/70b92a602db143dfaf26caaf716b023b/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:51:24.949358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b56e4-74eb-4ac0-923f-40d7c40d5c2e None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:24.949952 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b56e4-74eb-4ac0-923f-40d7c40d5c2e None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:24.949952 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b56e4-74eb-4ac0-923f-40d7c40d5c2e None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:24.951301 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 617/1193] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:51:24.959062 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a83732-ac0a-404d-847f-9c50a5d5330c None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:24.959792 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a83732-ac0a-404d-847f-9c50a5d5330c None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:24.959792 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a83732-ac0a-404d-847f-9c50a5d5330c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:24.980145 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-45a83732-ac0a-404d-847f-9c50a5d5330c None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:51:24.981408 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-45a83732-ac0a-404d-847f-9c50a5d5330c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:51:25.004743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:25.052793 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 577/1194] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:51:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:51:25.076629 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b56e4-74eb-4ac0-923f-40d7c40d5c2e None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:25.184409 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b56e4-74eb-4ac0-923f-40d7c40d5c2e None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:25.220693 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb30b5c-b8c0-43fd-8e14-0373fd37c12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:25.221238 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb30b5c-b8c0-43fd-8e14-0373fd37c12a None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:25.221516 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb30b5c-b8c0-43fd-8e14-0373fd37c12a None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:25.221788 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb30b5c-b8c0-43fd-8e14-0373fd37c12a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:25.232277 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb30b5c-b8c0-43fd-8e14-0373fd37c12a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:51:25.237682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-7fb30b5c-b8c0-43fd-8e14-0373fd37c12a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:51:25.237682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:51:25.237682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:51:25.237682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:51:25.237682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:51:25.237682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:51:25.237682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:51:25.237682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:51:25.237682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:51:25.237682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:51:25.237682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:51:25.237682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:51:25.237682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:51:25.237682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:51:25.237682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:51:25.237682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:51:25.238816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:51:25.238816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:51:25.238816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:51:25.238816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:51:25.238816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:51:25.238816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:51:25.238816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:51:25.238816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:51:25.238816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:51:25.238816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:51:25.238816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:51:25.238816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:51:25.238816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:51:25.238816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:51:25.238816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:51:25.238816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:51:25.239843 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:51:25.239843 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:51:25.239843 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:51:25.239843 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:51:25.239843 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:51:25.239843 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:51:25.239843 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:51:25.239843 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:51:25.239843 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:51:25.239843 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:51:25.239843 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:51:25.239843 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:51:25.239843 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 618/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:51:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:51:25.245231 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a83732-ac0a-404d-847f-9c50a5d5330c None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:25.350716 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a83732-ac0a-404d-847f-9c50a5d5330c None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:25.386381 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2129f-b6b0-4ca8-a9d5-d68e458e76c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:25.387006 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2129f-b6b0-4ca8-a9d5-d68e458e76c6 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:25.387281 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2129f-b6b0-4ca8-a9d5-d68e458e76c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:25.387557 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2129f-b6b0-4ca8-a9d5-d68e458e76c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:25.388313 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2129f-b6b0-4ca8-a9d5-d68e458e76c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:51:25.388615 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2129f-b6b0-4ca8-a9d5-d68e458e76c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:25.389986 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2129f-b6b0-4ca8-a9d5-d68e458e76c6 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:25.399581 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 578/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:51:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:51:25.405713 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb30b5c-b8c0-43fd-8e14-0373fd37c12a None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:25.470235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:25.522092 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb30b5c-b8c0-43fd-8e14-0373fd37c12a None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:25.557635 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38baab-4033-4c58-b4a7-f555c9d85029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:25.558287 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38baab-4033-4c58-b4a7-f555c9d85029 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:25.558570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38baab-4033-4c58-b4a7-f555c9d85029 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:25.558850 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38baab-4033-4c58-b4a7-f555c9d85029 None admin] PATH_INFO: `/v3/users/70b92a602db143dfaf26caaf716b023b` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:25.560038 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b38baab-4033-4c58-b4a7-f555c9d85029 None admin] RBAC: Authorizing `identity:get_user(user_id=70b92a602db143dfaf26caaf716b023b)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:25.561520 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b38baab-4033-4c58-b4a7-f555c9d85029 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:25.563784 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 619/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Aug 2 08:51:25 2022] GET /identity/v3/users/70b92a602db143dfaf26caaf716b023b => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:51:25.569907 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2129f-b6b0-4ca8-a9d5-d68e458e76c6 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:25.591279 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:25.677635 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2129f-b6b0-4ca8-a9d5-d68e458e76c6 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:25.713410 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dce397-c1b8-4576-a69d-a2133776b73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:25.714034 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dce397-c1b8-4576-a69d-a2133776b73c None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:25.714324 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dce397-c1b8-4576-a69d-a2133776b73c None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:25.714596 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dce397-c1b8-4576-a69d-a2133776b73c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:25.785121 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dce397-c1b8-4576-a69d-a2133776b73c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:25.786505 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dce397-c1b8-4576-a69d-a2133776b73c None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:25.804820 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:25.886297 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 579/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:51:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:51:25.892788 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38baab-4033-4c58-b4a7-f555c9d85029 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:25.999794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38baab-4033-4c58-b4a7-f555c9d85029 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:26.018906 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:26.036868 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10daf061-259b-404e-9cf5-553bccd9e7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:26.037445 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10daf061-259b-404e-9cf5-553bccd9e7b6 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:26.037730 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10daf061-259b-404e-9cf5-553bccd9e7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:26.038004 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10daf061-259b-404e-9cf5-553bccd9e7b6 None admin] PATH_INFO: `/v3/projects/98f13361fbe54bc6bb347b13590ff189` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:26.039167 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10daf061-259b-404e-9cf5-553bccd9e7b6 None admin] RBAC: Authorizing `identity:get_project(project_id=98f13361fbe54bc6bb347b13590ff189)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:26.040645 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10daf061-259b-404e-9cf5-553bccd9e7b6 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:26.042329 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 620/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Aug 2 08:51:25 2022] GET /identity/v3/projects/98f13361fbe54bc6bb347b13590ff189 => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:51:26.049646 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dce397-c1b8-4576-a69d-a2133776b73c None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:51:26.156047 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dce397-c1b8-4576-a69d-a2133776b73c None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:51:26.174680 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:26.192689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4706b-f309-48b3-98a8-0e9120c0893f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:51:26.193323 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4706b-f309-48b3-98a8-0e9120c0893f None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:51:26.193669 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4706b-f309-48b3-98a8-0e9120c0893f None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:51:26.193950 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4706b-f309-48b3-98a8-0e9120c0893f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:51:26.194749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4706b-f309-48b3-98a8-0e9120c0893f None admin] RBAC: Adding query filter params (role.id=b5477d3c4e5a4514b64211ec2452d1d8, scope.project.id=98f13361fbe54bc6bb347b13590ff189, user.id=70b92a602db143dfaf26caaf716b023b) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:51:26.195066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4706b-f309-48b3-98a8-0e9120c0893f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:51:26.196539 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4706b-f309-48b3-98a8-0e9120c0893f None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:51:26.203213 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 580/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:51:26 2022] GET /identity/v3/role_assignments?user.id=70b92a602db143dfaf26caaf716b023b&scope.project.id=98f13361fbe54bc6bb347b13590ff189&role.id=b5477d3c4e5a4514b64211ec2452d1d8 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:51:36.056249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=7 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:36.205648 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=9 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:52:46.940769 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e55023-af1c-4413-ae99-cc52c927d12c None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:46.941370 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e55023-af1c-4413-ae99-cc52c927d12c None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:46.941370 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e55023-af1c-4413-ae99-cc52c927d12c None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:46.942664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 621/1201] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:52:46.948041 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67379e-79e5-4c53-b7e1-c04483cf7c5a None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:46.948517 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67379e-79e5-4c53-b7e1-c04483cf7c5a None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:46.948649 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67379e-79e5-4c53-b7e1-c04483cf7c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:46.969573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-3a67379e-79e5-4c53-b7e1-c04483cf7c5a None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:52:46.970851 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-3a67379e-79e5-4c53-b7e1-c04483cf7c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:52:47.041474 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 581/1202] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:52:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:52:47.067733 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e55023-af1c-4413-ae99-cc52c927d12c None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:47.171879 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e55023-af1c-4413-ae99-cc52c927d12c None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:47.207839 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e0f61-99fa-49c4-aaf2-c1fd3cfd6320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:47.208523 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e0f61-99fa-49c4-aaf2-c1fd3cfd6320 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:47.208851 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e0f61-99fa-49c4-aaf2-c1fd3cfd6320 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:47.209175 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e0f61-99fa-49c4-aaf2-c1fd3cfd6320 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:47.220651 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e0f61-99fa-49c4-aaf2-c1fd3cfd6320 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:52:47.222103 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e0f61-99fa-49c4-aaf2-c1fd3cfd6320 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:52:47.237750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-cf7e0f61-99fa-49c4-aaf2-c1fd3cfd6320 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:52:47.237750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:52:47.237750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:52:47.237750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:52:47.237750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:52:47.237750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:52:47.237750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:52:47.237750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:52:47.237750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:52:47.237750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:52:47.237750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:52:47.237750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:52:47.237750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:52:47.237750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:52:47.237750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:52:47.242361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:52:47.242361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:52:47.242361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:52:47.242361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:52:47.242361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:52:47.242361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:52:47.242361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:52:47.242361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:52:47.242361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:52:47.242361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:52:47.242361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:52:47.242361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:52:47.242361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:52:47.242361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:52:47.242361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:52:47.242361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:52:47.242361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:52:47.243588 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:52:47.243588 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:52:47.243588 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:52:47.243588 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:52:47.243588 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 622/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:52:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:52:47.245430 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67379e-79e5-4c53-b7e1-c04483cf7c5a None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:47.349247 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67379e-79e5-4c53-b7e1-c04483cf7c5a None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:47.379758 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:52:47.385939 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c549a4c-f5f3-42bd-9a65-50aeab8fbaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:47.386563 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c549a4c-f5f3-42bd-9a65-50aeab8fbaea None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:47.386843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c549a4c-f5f3-42bd-9a65-50aeab8fbaea None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:47.387109 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c549a4c-f5f3-42bd-9a65-50aeab8fbaea None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:47.387869 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c549a4c-f5f3-42bd-9a65-50aeab8fbaea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:52:47.388198 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c549a4c-f5f3-42bd-9a65-50aeab8fbaea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:52:47.389578 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c549a4c-f5f3-42bd-9a65-50aeab8fbaea None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:52:47.401885 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 582/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:52:47.408737 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e0f61-99fa-49c4-aaf2-c1fd3cfd6320 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:47.464787 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:52:47.514047 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e0f61-99fa-49c4-aaf2-c1fd3cfd6320 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:47.548633 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327f968-b6b7-4b2a-a7c3-276c1ee756dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:47.549251 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327f968-b6b7-4b2a-a7c3-276c1ee756dd None admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:47.549528 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327f968-b6b7-4b2a-a7c3-276c1ee756dd None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:47.549799 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327f968-b6b7-4b2a-a7c3-276c1ee756dd None admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:47.550486 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327f968-b6b7-4b2a-a7c3-276c1ee756dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:52:47.551915 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327f968-b6b7-4b2a-a7c3-276c1ee756dd None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:52:47.654109 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 623/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Aug 2 08:52:47 2022] POST /identity/v3/users => generated 251 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:52:49.726610 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289f79d-bf9c-4fa8-82f0-ecaaf3dc017e None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:49.727238 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289f79d-bf9c-4fa8-82f0-ecaaf3dc017e None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:49.727238 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289f79d-bf9c-4fa8-82f0-ecaaf3dc017e None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:49.728549 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 583/1206] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:52:49.733797 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2421d-0567-4f16-bb49-80d4b43d6e34 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:49.734294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2421d-0567-4f16-bb49-80d4b43d6e34 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:49.734405 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2421d-0567-4f16-bb49-80d4b43d6e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:49.753312 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-c2d2421d-0567-4f16-bb49-80d4b43d6e34 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:52:49.754504 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-c2d2421d-0567-4f16-bb49-80d4b43d6e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:52:49.822414 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 624/1207] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:52:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:52:49.846555 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289f79d-bf9c-4fa8-82f0-ecaaf3dc017e None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:49.959132 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289f79d-bf9c-4fa8-82f0-ecaaf3dc017e None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:49.994546 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5aaf05-a4b0-4d1a-80c5-ba85ab23ed59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:49.995102 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5aaf05-a4b0-4d1a-80c5-ba85ab23ed59 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:49.995378 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5aaf05-a4b0-4d1a-80c5-ba85ab23ed59 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:49.995648 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5aaf05-a4b0-4d1a-80c5-ba85ab23ed59 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:50.006779 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5aaf05-a4b0-4d1a-80c5-ba85ab23ed59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:52:50.011557 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-ed5aaf05-a4b0-4d1a-80c5-ba85ab23ed59 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:52:50.011557 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:52:50.011557 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:52:50.011557 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:52:50.011557 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:52:50.011557 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:52:50.011557 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:52:50.011557 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:52:50.011557 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:52:50.011557 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:52:50.011557 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:52:50.011557 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:52:50.011557 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:52:50.011557 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:52:50.011557 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:52:50.011557 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:52:50.018849 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:52:50.018849 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:52:50.018849 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:52:50.018849 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:52:50.018849 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:52:50.018849 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:52:50.018849 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:52:50.018849 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:52:50.018849 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:52:50.018849 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:52:50.018849 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:52:50.018849 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:52:50.018849 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:52:50.018849 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:52:50.018849 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:52:50.018849 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:52:50.019894 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:52:50.019894 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:52:50.019894 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:52:50.019894 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:52:50.019894 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:52:50.019894 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:52:50.019894 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:52:50.019894 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:52:50.019894 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:52:50.019894 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:52:50.019894 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:52:50.019894 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:52:50.019894 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 584/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Aug 2 08:52:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:52:50.020692 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2421d-0567-4f16-bb49-80d4b43d6e34 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:50.058871 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:52:50.120081 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2421d-0567-4f16-bb49-80d4b43d6e34 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:50.155444 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a186bd-0304-4677-83c4-18aa49351516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:50.156092 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a186bd-0304-4677-83c4-18aa49351516 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:50.156403 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a186bd-0304-4677-83c4-18aa49351516 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:50.156681 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a186bd-0304-4677-83c4-18aa49351516 None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:50.157407 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a186bd-0304-4677-83c4-18aa49351516 None admin] RBAC: Adding query filter params (name=service) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:52:50.157710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a186bd-0304-4677-83c4-18aa49351516 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:52:50.159088 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a186bd-0304-4677-83c4-18aa49351516 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:52:50.167523 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 625/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Aug 2 08:52:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:52:50.174572 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5aaf05-a4b0-4d1a-80c5-ba85ab23ed59 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:50.228685 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:52:50.286987 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5aaf05-a4b0-4d1a-80c5-ba85ab23ed59 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:50.321143 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda4a23-2926-426e-ada3-dfbe7aedc06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:50.321780 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda4a23-2926-426e-ada3-dfbe7aedc06e None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:50.322062 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda4a23-2926-426e-ada3-dfbe7aedc06e None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:50.322335 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda4a23-2926-426e-ada3-dfbe7aedc06e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:50.333798 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda4a23-2926-426e-ada3-dfbe7aedc06e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:52:50.338436 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda4a23-2926-426e-ada3-dfbe7aedc06e None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:52:50.350741 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-cbda4a23-2926-426e-ada3-dfbe7aedc06e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:52:50.350741 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:52:50.350741 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:52:50.350741 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:52:50.350741 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:52:50.350741 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:52:50.350741 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:52:50.350741 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:52:50.350741 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:52:50.350741 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:52:50.350741 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:52:50.350741 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:52:50.350741 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:52:50.350741 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:52:50.350741 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:52:50.351835 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:52:50.351835 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:52:50.351835 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:52:50.351835 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:52:50.351835 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:52:50.351835 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:52:50.351835 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:52:50.351835 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:52:50.351835 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:52:50.351835 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:52:50.351835 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:52:50.351835 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:52:50.351835 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:52:50.351835 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:52:50.351835 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:52:50.351835 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:52:50.351835 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:52:50.353015 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:52:50.353015 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:52:50.353015 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:52:50.353015 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:52:50.353015 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 585/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:52:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:52:50.358430 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a186bd-0304-4677-83c4-18aa49351516 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:50.459354 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:52:50.462261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a186bd-0304-4677-83c4-18aa49351516 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:50.496604 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75e2fa-a016-4c30-bfd5-00cb12872b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:50.497303 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75e2fa-a016-4c30-bfd5-00cb12872b5b None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:50.497587 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75e2fa-a016-4c30-bfd5-00cb12872b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:50.497864 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75e2fa-a016-4c30-bfd5-00cb12872b5b None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:50.499629 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75e2fa-a016-4c30-bfd5-00cb12872b5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:52:50.499938 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75e2fa-a016-4c30-bfd5-00cb12872b5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:52:50.501347 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75e2fa-a016-4c30-bfd5-00cb12872b5b None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:52:50.512770 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 626/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:52:50.519471 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda4a23-2926-426e-ada3-dfbe7aedc06e None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:50.632610 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda4a23-2926-426e-ada3-dfbe7aedc06e None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:50.634325 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:52:50.667494 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f0954-e866-45c4-8178-ac4e64b513c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:50.668144 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f0954-e866-45c4-8178-ac4e64b513c1 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:50.702947 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f0954-e866-45c4-8178-ac4e64b513c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:50.702947 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f0954-e866-45c4-8178-ac4e64b513c1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:50.702947 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f0954-e866-45c4-8178-ac4e64b513c1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:52:50.702947 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f0954-e866-45c4-8178-ac4e64b513c1 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:52:50.702947 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-fa8f0954-e866-45c4-8178-ac4e64b513c1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:52:50.702947 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:52:50.702947 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:52:50.702947 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:52:50.702947 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:52:50.703784 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:52:50.703784 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:52:50.703784 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:52:50.703784 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:52:50.703784 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:52:50.703784 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:52:50.703784 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:52:50.703784 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:52:50.703784 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:52:50.703784 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:52:50.703784 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:52:50.703784 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:52:50.703784 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:52:50.703784 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:52:50.703784 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:52:50.703784 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:52:50.703784 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:52:50.705085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:52:50.705085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:52:50.705085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:52:50.705085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:52:50.705085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:52:50.705085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:52:50.705085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:52:50.705085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:52:50.705085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:52:50.705085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:52:50.705085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:52:50.705085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:52:50.705085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:52:50.705085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:52:50.705085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:52:50.705085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:52:50.705085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:52:50.706224 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:52:50.706224 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:52:50.706224 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:52:50.706224 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:52:50.706224 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:52:50.706224 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 586/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:52:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:52:50.706641 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75e2fa-a016-4c30-bfd5-00cb12872b5b None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:50.803682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75e2fa-a016-4c30-bfd5-00cb12872b5b None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:50.838825 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e3ff8-56cd-4644-b203-014b71221b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:50.839547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e3ff8-56cd-4644-b203-014b71221b85 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:50.841060 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e3ff8-56cd-4644-b203-014b71221b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:50.841060 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e3ff8-56cd-4644-b203-014b71221b85 None admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:50.841060 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e3ff8-56cd-4644-b203-014b71221b85 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:52:50.841334 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e3ff8-56cd-4644-b203-014b71221b85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:52:50.843550 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e3ff8-56cd-4644-b203-014b71221b85 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:52:50.861675 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 627/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Aug 2 08:52:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:52:50.867953 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f0954-e866-45c4-8178-ac4e64b513c1 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:50.972813 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f0954-e866-45c4-8178-ac4e64b513c1 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:51.007953 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea8183-ee10-4071-b02a-6b0d95476c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:51.008616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea8183-ee10-4071-b02a-6b0d95476c55 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:51.008931 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea8183-ee10-4071-b02a-6b0d95476c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:51.009161 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea8183-ee10-4071-b02a-6b0d95476c55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:51.041018 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:52:51.080325 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea8183-ee10-4071-b02a-6b0d95476c55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:52:51.081783 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea8183-ee10-4071-b02a-6b0d95476c55 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:52:51.181737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 587/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:52:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:52:51.187728 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e3ff8-56cd-4644-b203-014b71221b85 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:51.207063 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:52:51.289579 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e3ff8-56cd-4644-b203-014b71221b85 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:51.323498 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb8c1b-3949-48ec-bbac-a05d872bc435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:51.324140 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb8c1b-3949-48ec-bbac-a05d872bc435 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:51.324461 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb8c1b-3949-48ec-bbac-a05d872bc435 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:51.324731 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb8c1b-3949-48ec-bbac-a05d872bc435 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:51.334793 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb8c1b-3949-48ec-bbac-a05d872bc435 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:52:51.336289 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb8c1b-3949-48ec-bbac-a05d872bc435 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:52:51.352501 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-3abb8c1b-3949-48ec-bbac-a05d872bc435 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:52:51.352501 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:52:51.352501 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:52:51.352501 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:52:51.352501 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:52:51.352501 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:52:51.352501 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:52:51.352501 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:52:51.352501 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:52:51.352501 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:52:51.352501 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:52:51.352501 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:52:51.352501 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:52:51.352501 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:52:51.352501 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:52:51.353765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:52:51.353765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:52:51.353765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:52:51.353765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:52:51.353765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:52:51.353765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:52:51.353765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:52:51.353765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:52:51.353765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:52:51.353765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:52:51.353765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:52:51.353765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:52:51.353765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:52:51.353765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:52:51.353765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:52:51.353765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:52:51.353765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:52:51.355048 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:52:51.355048 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:52:51.355048 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:52:51.355048 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:52:51.355048 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 628/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:52:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:52:51.360154 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea8183-ee10-4071-b02a-6b0d95476c55 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:51.429486 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:52:51.471258 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea8183-ee10-4071-b02a-6b0d95476c55 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:51.509087 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2f500-ec58-4a11-a164-10e555ebaf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:51.523978 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2f500-ec58-4a11-a164-10e555ebaf9f None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:51.523978 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2f500-ec58-4a11-a164-10e555ebaf9f None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:51.523978 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2f500-ec58-4a11-a164-10e555ebaf9f None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:51.523978 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb2f500-ec58-4a11-a164-10e555ebaf9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:52:51.523978 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb2f500-ec58-4a11-a164-10e555ebaf9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:52:51.523978 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb2f500-ec58-4a11-a164-10e555ebaf9f None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:52:51.564425 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 588/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:52:51.564617 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb8c1b-3949-48ec-bbac-a05d872bc435 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:51.605776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:52:51.637072 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb8c1b-3949-48ec-bbac-a05d872bc435 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:51.671413 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e26c7-116d-4a86-ad11-de3d1a275941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:51.672055 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e26c7-116d-4a86-ad11-de3d1a275941 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:51.672372 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e26c7-116d-4a86-ad11-de3d1a275941 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:51.672647 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e26c7-116d-4a86-ad11-de3d1a275941 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:51.679191 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e26c7-116d-4a86-ad11-de3d1a275941 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:52:51.680741 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e26c7-116d-4a86-ad11-de3d1a275941 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:52:51.692023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-381e26c7-116d-4a86-ad11-de3d1a275941 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:52:51.692023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:52:51.692023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:52:51.692023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:52:51.692023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:52:51.692023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:52:51.692023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:52:51.692023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:52:51.692023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:52:51.692023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:52:51.692023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:52:51.692023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:52:51.692023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:52:51.692023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:52:51.692023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:52:51.695663 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:52:51.695663 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:52:51.695663 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:52:51.695663 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:52:51.695663 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:52:51.695663 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:52:51.695663 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:52:51.695663 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:52:51.695663 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:52:51.695663 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:52:51.695663 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:52:51.695663 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:52:51.695663 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:52:51.695663 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:52:51.695663 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:52:51.695663 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:52:51.695663 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:52:51.696764 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:52:51.696764 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:52:51.696764 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:52:51.696764 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:52:51.696764 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:52:51.696764 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:52:51.696764 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:52:51.696764 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:52:51.696764 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 629/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:52:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:52:51.699315 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2f500-ec58-4a11-a164-10e555ebaf9f None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:51.803103 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2f500-ec58-4a11-a164-10e555ebaf9f None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:51.826554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:52:51.838073 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd08c1-7e69-4a38-8df7-5bd921d7280c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:51.838690 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd08c1-7e69-4a38-8df7-5bd921d7280c None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:51.838975 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd08c1-7e69-4a38-8df7-5bd921d7280c None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:51.839248 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd08c1-7e69-4a38-8df7-5bd921d7280c None admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:51.839989 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd08c1-7e69-4a38-8df7-5bd921d7280c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:52:51.840320 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd08c1-7e69-4a38-8df7-5bd921d7280c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:52:51.841753 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd08c1-7e69-4a38-8df7-5bd921d7280c None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:52:51.853818 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 589/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:52:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:52:51.861159 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e26c7-116d-4a86-ad11-de3d1a275941 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:51.962888 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e26c7-116d-4a86-ad11-de3d1a275941 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:51.991813 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:52:51.997751 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154dd84a-045d-42cd-b3ce-1181c4fa6eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:51.998975 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154dd84a-045d-42cd-b3ce-1181c4fa6eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:51.999262 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154dd84a-045d-42cd-b3ce-1181c4fa6eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:51.999538 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154dd84a-045d-42cd-b3ce-1181c4fa6eb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:52.000357 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154dd84a-045d-42cd-b3ce-1181c4fa6eb6 None admin] RBAC: Adding query filter params (role.id=bc21bdc3d9dd4091a04f1e2fef77a8c3, scope.project.id=6910e69702854607889bab124edd60c9, user.id=aa8cac76aa21415d8ab0a2524a7049d8) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:52:52.000662 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154dd84a-045d-42cd-b3ce-1181c4fa6eb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:52:52.002088 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154dd84a-045d-42cd-b3ce-1181c4fa6eb6 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:52:52.007395 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 630/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:52:51 2022] GET /identity/v3/role_assignments?user.id=aa8cac76aa21415d8ab0a2524a7049d8&scope.project.id=6910e69702854607889bab124edd60c9&role.id=bc21bdc3d9dd4091a04f1e2fef77a8c3 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:52:54.012288 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60334db7-45dd-4df6-a6d8-404e7bdfee6c None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:54.012866 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60334db7-45dd-4df6-a6d8-404e7bdfee6c None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:54.012866 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60334db7-45dd-4df6-a6d8-404e7bdfee6c None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:54.014244 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 590/1220] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:52:54.020184 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5c982-9448-4188-a31e-9c4b546d73f8 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:54.020598 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5c982-9448-4188-a31e-9c4b546d73f8 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:54.023481 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5c982-9448-4188-a31e-9c4b546d73f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:54.038810 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-fce5c982-9448-4188-a31e-9c4b546d73f8 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:52:54.039994 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-fce5c982-9448-4188-a31e-9c4b546d73f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:52:54.106802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 631/1221] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:52:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:52:54.129723 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60334db7-45dd-4df6-a6d8-404e7bdfee6c None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:54.233539 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60334db7-45dd-4df6-a6d8-404e7bdfee6c None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:54.268417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629c1e1-8e0a-438e-81e1-d530e758cfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:54.269029 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629c1e1-8e0a-438e-81e1-d530e758cfad None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:54.269385 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629c1e1-8e0a-438e-81e1-d530e758cfad None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:54.269663 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629c1e1-8e0a-438e-81e1-d530e758cfad None admin] PATH_INFO: `/v3/roles/service` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:54.280255 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629c1e1-8e0a-438e-81e1-d530e758cfad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:52:54.285251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-1629c1e1-8e0a-438e-81e1-d530e758cfad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:52:54.285251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:52:54.285251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:52:54.285251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:52:54.285251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:52:54.285251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:52:54.285251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:52:54.285251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:52:54.285251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:52:54.285251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:52:54.285251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:52:54.285251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:52:54.285251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:52:54.285251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:52:54.285251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:52:54.285251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:52:54.287019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:52:54.287019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:52:54.287019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:52:54.287019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:52:54.287019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:52:54.287019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:52:54.287019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:52:54.287019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:52:54.287019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:52:54.287019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:52:54.287019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:52:54.287019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:52:54.287019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:52:54.287019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:52:54.287019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:52:54.287019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:52:54.287906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:52:54.287906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:52:54.287906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:52:54.287906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:52:54.287906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:52:54.287906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:52:54.287906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:52:54.287906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:52:54.287906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:52:54.287906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:52:54.287906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:52:54.287906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:52:54.287906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 591/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Aug 2 08:52:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:52:54.293592 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5c982-9448-4188-a31e-9c4b546d73f8 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:54.394582 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5c982-9448-4188-a31e-9c4b546d73f8 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:54.419256 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:52:54.431405 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371a81a-aaf7-4006-a18b-c85b9b7a52ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:54.432042 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371a81a-aaf7-4006-a18b-c85b9b7a52ee None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:54.432367 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371a81a-aaf7-4006-a18b-c85b9b7a52ee None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:54.432643 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371a81a-aaf7-4006-a18b-c85b9b7a52ee None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:54.433404 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371a81a-aaf7-4006-a18b-c85b9b7a52ee None admin] RBAC: Adding query filter params (name=service) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:52:54.433693 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371a81a-aaf7-4006-a18b-c85b9b7a52ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:52:54.435182 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371a81a-aaf7-4006-a18b-c85b9b7a52ee None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:52:54.444468 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 632/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Aug 2 08:52:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:52:54.450330 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629c1e1-8e0a-438e-81e1-d530e758cfad None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:54.495739 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:52:54.551620 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629c1e1-8e0a-438e-81e1-d530e758cfad None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:54.592110 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee25120-0722-4e93-847f-b7d0c24cae55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:54.592843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee25120-0722-4e93-847f-b7d0c24cae55 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:54.593126 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee25120-0722-4e93-847f-b7d0c24cae55 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:54.593398 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee25120-0722-4e93-847f-b7d0c24cae55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:54.604222 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee25120-0722-4e93-847f-b7d0c24cae55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:52:54.605684 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee25120-0722-4e93-847f-b7d0c24cae55 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:52:54.620652 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-fee25120-0722-4e93-847f-b7d0c24cae55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:52:54.620652 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:52:54.620652 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:52:54.620652 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:52:54.620652 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:52:54.620652 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:52:54.620652 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:52:54.620652 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:52:54.620652 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:52:54.620652 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:52:54.620652 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:52:54.620652 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:52:54.620652 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:52:54.620652 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:52:54.620652 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:52:54.621796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:52:54.621796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:52:54.621796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:52:54.621796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:52:54.621796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:52:54.621796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:52:54.621796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:52:54.621796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:52:54.621796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:52:54.621796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:52:54.621796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:52:54.621796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:52:54.621796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:52:54.621796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:52:54.621796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:52:54.621796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:52:54.621796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:52:54.622701 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:52:54.622701 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:52:54.622701 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:52:54.622701 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:52:54.622701 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 592/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:52:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:52:54.628234 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371a81a-aaf7-4006-a18b-c85b9b7a52ee None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:54.729290 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371a81a-aaf7-4006-a18b-c85b9b7a52ee None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:54.763067 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf3864-c849-4aa0-8207-bb4fab14f9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:54.763724 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf3864-c849-4aa0-8207-bb4fab14f9bd None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:54.764678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf3864-c849-4aa0-8207-bb4fab14f9bd None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:54.764952 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf3864-c849-4aa0-8207-bb4fab14f9bd None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:54.765646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf3864-c849-4aa0-8207-bb4fab14f9bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:52:54.765945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf3864-c849-4aa0-8207-bb4fab14f9bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:52:54.767316 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf3864-c849-4aa0-8207-bb4fab14f9bd None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:52:54.779332 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 633/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:52:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:52:54.785637 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee25120-0722-4e93-847f-b7d0c24cae55 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:54.883111 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:52:54.889546 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee25120-0722-4e93-847f-b7d0c24cae55 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:54.923903 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae85aa-37d2-4340-a61c-b36d8f67da0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:54.924626 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae85aa-37d2-4340-a61c-b36d8f67da0e None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:54.924913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae85aa-37d2-4340-a61c-b36d8f67da0e None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:54.925186 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae85aa-37d2-4340-a61c-b36d8f67da0e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:54.932627 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae85aa-37d2-4340-a61c-b36d8f67da0e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:52:54.934119 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae85aa-37d2-4340-a61c-b36d8f67da0e None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:52:54.946267 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-9bae85aa-37d2-4340-a61c-b36d8f67da0e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:52:54.946267 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:52:54.946267 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:52:54.946267 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:52:54.946267 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:52:54.946267 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:52:54.946267 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:52:54.946267 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:52:54.946267 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:52:54.946267 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:52:54.946267 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:52:54.946267 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:52:54.946267 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:52:54.946267 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:52:54.946267 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:52:54.946267 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:52:54.947552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:52:54.947552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:52:54.947552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:52:54.947552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:52:54.947552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:52:54.947552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:52:54.947552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:52:54.947552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:52:54.947552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:52:54.947552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:52:54.947552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:52:54.947552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:52:54.947552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:52:54.947552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:52:54.947552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:52:54.947552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:52:54.947552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:52:54.947552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:52:54.953173 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:52:54.953173 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:52:54.953173 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:52:54.953173 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:52:54.953173 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:52:54.953173 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:52:54.953173 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:52:54.953173 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:52:54.953173 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:52:54.953173 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:52:54.953173 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 593/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:52:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:52:54.958143 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf3864-c849-4aa0-8207-bb4fab14f9bd None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:55.011880 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:52:55.065980 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf3864-c849-4aa0-8207-bb4fab14f9bd None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:55.099545 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14552ee7-0926-47cb-9232-0da5b8239e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:55.100278 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14552ee7-0926-47cb-9232-0da5b8239e35 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:55.100565 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14552ee7-0926-47cb-9232-0da5b8239e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:55.100842 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14552ee7-0926-47cb-9232-0da5b8239e35 None admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:55.101641 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14552ee7-0926-47cb-9232-0da5b8239e35 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:52:55.101952 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14552ee7-0926-47cb-9232-0da5b8239e35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:52:55.103382 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14552ee7-0926-47cb-9232-0da5b8239e35 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:52:55.124558 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 634/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Aug 2 08:52:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:52:55.127818 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae85aa-37d2-4340-a61c-b36d8f67da0e None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:55.230710 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae85aa-37d2-4340-a61c-b36d8f67da0e None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:55.277426 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995b879-95b2-4d6c-98f8-aef5e9bafc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:55.278368 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995b879-95b2-4d6c-98f8-aef5e9bafc8c None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:55.278786 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995b879-95b2-4d6c-98f8-aef5e9bafc8c None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:55.279195 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995b879-95b2-4d6c-98f8-aef5e9bafc8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:55.296002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995b879-95b2-4d6c-98f8-aef5e9bafc8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:52:55.298326 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995b879-95b2-4d6c-98f8-aef5e9bafc8c None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:52:55.319521 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-b995b879-95b2-4d6c-98f8-aef5e9bafc8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:52:55.319521 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:52:55.319521 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:52:55.319521 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:52:55.319521 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:52:55.319521 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:52:55.319521 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:52:55.319521 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:52:55.319521 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:52:55.319521 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:52:55.319521 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:52:55.319521 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:52:55.319521 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:52:55.319521 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:52:55.319521 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:52:55.320753 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:52:55.320753 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:52:55.320753 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:52:55.320753 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:52:55.320753 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:52:55.320753 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:52:55.320753 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:52:55.320753 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:52:55.320753 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:52:55.320753 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:52:55.320753 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:52:55.320753 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:52:55.320753 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:52:55.320753 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:52:55.320753 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:52:55.320753 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:52:55.320753 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:52:55.326968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:52:55.326968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:52:55.326968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:52:55.326968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:52:55.326968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 594/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:52:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:52:55.327663 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14552ee7-0926-47cb-9232-0da5b8239e35 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:55.432972 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14552ee7-0926-47cb-9232-0da5b8239e35 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:55.435396 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:52:55.470488 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502df18c-8e66-4d33-93a9-d7828b40c37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:55.471214 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502df18c-8e66-4d33-93a9-d7828b40c37e None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:55.471497 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502df18c-8e66-4d33-93a9-d7828b40c37e None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:55.471773 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502df18c-8e66-4d33-93a9-d7828b40c37e None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:55.472538 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502df18c-8e66-4d33-93a9-d7828b40c37e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:52:55.472842 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502df18c-8e66-4d33-93a9-d7828b40c37e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:52:55.474213 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502df18c-8e66-4d33-93a9-d7828b40c37e None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:52:55.486024 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 635/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:52:55.491908 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995b879-95b2-4d6c-98f8-aef5e9bafc8c None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:55.502222 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:52:55.593821 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995b879-95b2-4d6c-98f8-aef5e9bafc8c None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:55.631231 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f7121-fbc3-40ec-9930-c57dedf2e27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:55.631879 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f7121-fbc3-40ec-9930-c57dedf2e27a None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:55.632178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f7121-fbc3-40ec-9930-c57dedf2e27a None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:55.632473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f7121-fbc3-40ec-9930-c57dedf2e27a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:55.640010 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f7121-fbc3-40ec-9930-c57dedf2e27a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:52:55.641481 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f7121-fbc3-40ec-9930-c57dedf2e27a None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:52:55.653019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-566f7121-fbc3-40ec-9930-c57dedf2e27a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:52:55.653019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:52:55.653019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:52:55.653019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:52:55.653019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:52:55.653019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:52:55.653019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:52:55.653019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:52:55.653019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:52:55.653019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:52:55.653019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:52:55.653019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:52:55.653019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:52:55.653019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:52:55.653019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:52:55.654190 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:52:55.654190 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:52:55.654190 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:52:55.654190 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:52:55.654190 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:52:55.654190 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:52:55.654190 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:52:55.654190 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:52:55.654190 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:52:55.654190 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:52:55.654190 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:52:55.654190 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:52:55.654190 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:52:55.654190 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:52:55.654190 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:52:55.654190 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:52:55.654190 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:52:55.656029 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:52:55.656029 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:52:55.656029 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:52:55.656029 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:52:55.656029 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:52:55.656029 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:52:55.656029 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:52:55.656029 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:52:55.656029 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 595/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:52:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:52:55.660850 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502df18c-8e66-4d33-93a9-d7828b40c37e None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:55.762093 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502df18c-8e66-4d33-93a9-d7828b40c37e None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:55.797033 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4043ba-0a03-40b3-9d01-2d459474df28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:55.797662 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4043ba-0a03-40b3-9d01-2d459474df28 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:55.797949 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4043ba-0a03-40b3-9d01-2d459474df28 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:55.798228 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4043ba-0a03-40b3-9d01-2d459474df28 None admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:55.798980 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4043ba-0a03-40b3-9d01-2d459474df28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:52:55.799290 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4043ba-0a03-40b3-9d01-2d459474df28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:52:55.800801 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4043ba-0a03-40b3-9d01-2d459474df28 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:52:55.813263 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 636/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:52:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:52:55.819496 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f7121-fbc3-40ec-9930-c57dedf2e27a None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:55.887154 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:52:55.931581 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f7121-fbc3-40ec-9930-c57dedf2e27a None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:55.966883 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d69c9-1a2e-4c75-8785-21b80e4fbe31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:55.967739 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d69c9-1a2e-4c75-8785-21b80e4fbe31 None admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:55.968018 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d69c9-1a2e-4c75-8785-21b80e4fbe31 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:55.968356 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d69c9-1a2e-4c75-8785-21b80e4fbe31 None admin] PATH_INFO: `/v3/projects/6910e69702854607889bab124edd60c9/users/aa8cac76aa21415d8ab0a2524a7049d8/roles/bc21bdc3d9dd4091a04f1e2fef77a8c3` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:55.983487 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d69c9-1a2e-4c75-8785-21b80e4fbe31 None admin] RBAC: Authorizing `identity:create_grant(project_id=6910e69702854607889bab124edd60c9, user_id=aa8cac76aa21415d8ab0a2524a7049d8, role_id=bc21bdc3d9dd4091a04f1e2fef77a8c3)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:52:55.985078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d69c9-1a2e-4c75-8785-21b80e4fbe31 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:52:56.131255 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 596/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Aug 2 08:52:55 2022] PUT /identity/v3/projects/6910e69702854607889bab124edd60c9/users/aa8cac76aa21415d8ab0a2524a7049d8/roles/bc21bdc3d9dd4091a04f1e2fef77a8c3 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:52:58.179640 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb99c9-be5c-4363-9d4d-2cd2cce71cfd None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:58.180227 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb99c9-be5c-4363-9d4d-2cd2cce71cfd None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:58.180227 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb99c9-be5c-4363-9d4d-2cd2cce71cfd None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:58.181708 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 637/1233] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:52:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:52:58.186969 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d21066-4d47-4f2d-afe9-917b9ed44845 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:58.187400 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d21066-4d47-4f2d-afe9-917b9ed44845 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:58.187528 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d21066-4d47-4f2d-afe9-917b9ed44845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:58.207639 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-91d21066-4d47-4f2d-afe9-917b9ed44845 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:52:58.208864 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-91d21066-4d47-4f2d-afe9-917b9ed44845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:52:58.279001 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 597/1234] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:52:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:52:58.301855 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb99c9-be5c-4363-9d4d-2cd2cce71cfd None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:58.328715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:52:58.407662 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb99c9-be5c-4363-9d4d-2cd2cce71cfd None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:58.443417 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a0006-ae09-49c9-a96a-9b5ffbbb976a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:58.443982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a0006-ae09-49c9-a96a-9b5ffbbb976a None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:58.444291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a0006-ae09-49c9-a96a-9b5ffbbb976a None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:58.444613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a0006-ae09-49c9-a96a-9b5ffbbb976a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:58.455130 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a0006-ae09-49c9-a96a-9b5ffbbb976a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:52:58.461274 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-c70a0006-ae09-49c9-a96a-9b5ffbbb976a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:52:58.461274 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:52:58.461274 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:52:58.461274 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:52:58.461274 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:52:58.461274 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:52:58.461274 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:52:58.461274 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:52:58.461274 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:52:58.461274 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:52:58.461274 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:52:58.461274 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:52:58.461274 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:52:58.461274 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:52:58.461274 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:52:58.461274 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:52:58.462304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:52:58.462304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:52:58.462304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:52:58.462304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:52:58.462304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:52:58.462304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:52:58.462304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:52:58.462304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:52:58.462304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:52:58.462304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:52:58.462304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:52:58.462304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:52:58.462304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:52:58.462304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:52:58.462304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:52:58.462304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:52:58.463190 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:52:58.463190 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:52:58.463190 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:52:58.463190 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:52:58.463190 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:52:58.463190 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:52:58.463190 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:52:58.463190 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:52:58.463190 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:52:58.463190 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:52:58.463190 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:52:58.463190 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:52:58.463190 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 638/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Aug 2 08:52:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:52:58.469051 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d21066-4d47-4f2d-afe9-917b9ed44845 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:58.516474 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:52:58.570356 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d21066-4d47-4f2d-afe9-917b9ed44845 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:58.605132 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9b28c-d0fd-4083-9b4c-821d56d08482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:58.605758 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9b28c-d0fd-4083-9b4c-821d56d08482 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:58.606041 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9b28c-d0fd-4083-9b4c-821d56d08482 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:58.606318 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9b28c-d0fd-4083-9b4c-821d56d08482 None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:58.607035 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd9b28c-d0fd-4083-9b4c-821d56d08482 None admin] RBAC: Adding query filter params (name=service) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:52:58.607340 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd9b28c-d0fd-4083-9b4c-821d56d08482 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:52:58.609286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd9b28c-d0fd-4083-9b4c-821d56d08482 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:52:58.617728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 598/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Aug 2 08:52:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:52:58.625735 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a0006-ae09-49c9-a96a-9b5ffbbb976a None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:58.714405 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:52:58.729630 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a0006-ae09-49c9-a96a-9b5ffbbb976a None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:58.764666 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad80c2-5b66-450f-ae2b-8416341cc377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:58.765335 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad80c2-5b66-450f-ae2b-8416341cc377 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:58.765604 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad80c2-5b66-450f-ae2b-8416341cc377 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:58.765868 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad80c2-5b66-450f-ae2b-8416341cc377 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:58.775568 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad80c2-5b66-450f-ae2b-8416341cc377 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:52:58.777038 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad80c2-5b66-450f-ae2b-8416341cc377 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:52:58.791834 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-d6ad80c2-5b66-450f-ae2b-8416341cc377 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:52:58.791834 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:52:58.791834 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:52:58.791834 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:52:58.791834 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:52:58.791834 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:52:58.791834 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:52:58.791834 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:52:58.791834 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:52:58.791834 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:52:58.791834 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:52:58.791834 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:52:58.791834 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:52:58.791834 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:52:58.791834 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:52:58.793181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:52:58.793181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:52:58.793181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:52:58.793181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:52:58.793181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:52:58.793181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:52:58.793181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:52:58.793181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:52:58.793181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:52:58.793181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:52:58.793181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:52:58.793181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:52:58.793181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:52:58.793181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:52:58.793181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:52:58.793181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:52:58.793181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:52:58.794330 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:52:58.794330 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:52:58.794330 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:52:58.794330 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:52:58.794330 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 639/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:52:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:52:58.799012 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9b28c-d0fd-4083-9b4c-821d56d08482 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:58.905534 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9b28c-d0fd-4083-9b4c-821d56d08482 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:58.915045 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:52:58.940527 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d561e-e992-4011-89f7-ee2030f809b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:58.941228 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d561e-e992-4011-89f7-ee2030f809b7 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:58.941446 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d561e-e992-4011-89f7-ee2030f809b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:58.941720 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d561e-e992-4011-89f7-ee2030f809b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:58.942411 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d561e-e992-4011-89f7-ee2030f809b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:52:58.942710 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d561e-e992-4011-89f7-ee2030f809b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:52:58.944120 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d561e-e992-4011-89f7-ee2030f809b7 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:52:58.956479 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 599/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:52:58.962359 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad80c2-5b66-450f-ae2b-8416341cc377 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:59.065006 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad80c2-5b66-450f-ae2b-8416341cc377 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:59.099198 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5229f-3bcd-4d4c-91e7-bede2e300ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:59.099954 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5229f-3bcd-4d4c-91e7-bede2e300ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:59.100265 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5229f-3bcd-4d4c-91e7-bede2e300ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:59.100543 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5229f-3bcd-4d4c-91e7-bede2e300ef3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:59.103336 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:52:59.108700 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5229f-3bcd-4d4c-91e7-bede2e300ef3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:52:59.110202 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5229f-3bcd-4d4c-91e7-bede2e300ef3 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:52:59.121986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-7fe5229f-3bcd-4d4c-91e7-bede2e300ef3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:52:59.121986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:52:59.121986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:52:59.121986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:52:59.121986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:52:59.121986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:52:59.121986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:52:59.121986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:52:59.121986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:52:59.121986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:52:59.121986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:52:59.121986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:52:59.121986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:52:59.121986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:52:59.121986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:52:59.121986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:52:59.130470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:52:59.130470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:52:59.130470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:52:59.130470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:52:59.130470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:52:59.130470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:52:59.130470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:52:59.130470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:52:59.130470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:52:59.130470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:52:59.130470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:52:59.130470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:52:59.130470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:52:59.130470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:52:59.130470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:52:59.130470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:52:59.130470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:52:59.130470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:52:59.131806 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:52:59.131806 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:52:59.131806 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:52:59.131806 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:52:59.131806 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:52:59.131806 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:52:59.131806 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:52:59.131806 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:52:59.131806 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:52:59.131806 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:52:59.131806 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 640/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:52:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:52:59.132634 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d561e-e992-4011-89f7-ee2030f809b7 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:59.231644 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d561e-e992-4011-89f7-ee2030f809b7 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:59.267670 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6913d33-bf93-48d6-ad81-5df4505027fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:59.268330 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6913d33-bf93-48d6-ad81-5df4505027fe None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:59.268619 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6913d33-bf93-48d6-ad81-5df4505027fe None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:59.268919 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6913d33-bf93-48d6-ad81-5df4505027fe None admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:59.269719 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6913d33-bf93-48d6-ad81-5df4505027fe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:52:59.270026 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6913d33-bf93-48d6-ad81-5df4505027fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:52:59.271472 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6913d33-bf93-48d6-ad81-5df4505027fe None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:52:59.289696 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 600/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Aug 2 08:52:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:52:59.296367 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5229f-3bcd-4d4c-91e7-bede2e300ef3 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:59.399436 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5229f-3bcd-4d4c-91e7-bede2e300ef3 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:59.435068 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9bd2a-f989-4539-9f6b-33b25ecfa9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:59.436537 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9bd2a-f989-4539-9f6b-33b25ecfa9ab None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:59.436780 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9bd2a-f989-4539-9f6b-33b25ecfa9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:59.437223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9bd2a-f989-4539-9f6b-33b25ecfa9ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:59.501308 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:52:59.507987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9bd2a-f989-4539-9f6b-33b25ecfa9ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:52:59.509524 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9bd2a-f989-4539-9f6b-33b25ecfa9ab None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:52:59.610229 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 641/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:52:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:52:59.616265 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6913d33-bf93-48d6-ad81-5df4505027fe None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:59.644622 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:52:59.721905 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6913d33-bf93-48d6-ad81-5df4505027fe None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:59.756132 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df6cad-0b23-4107-8915-56efb19bded4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:59.756811 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df6cad-0b23-4107-8915-56efb19bded4 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:59.757334 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df6cad-0b23-4107-8915-56efb19bded4 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:59.758246 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df6cad-0b23-4107-8915-56efb19bded4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:59.769026 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df6cad-0b23-4107-8915-56efb19bded4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:52:59.770469 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df6cad-0b23-4107-8915-56efb19bded4 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:52:59.784954 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-02df6cad-0b23-4107-8915-56efb19bded4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:52:59.784954 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:52:59.784954 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:52:59.784954 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:52:59.784954 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:52:59.784954 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:52:59.784954 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:52:59.784954 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:52:59.784954 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:52:59.784954 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:52:59.784954 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:52:59.784954 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:52:59.784954 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:52:59.784954 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:52:59.784954 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:52:59.785926 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:52:59.785926 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:52:59.785926 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:52:59.785926 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:52:59.785926 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:52:59.785926 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:52:59.785926 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:52:59.785926 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:52:59.785926 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:52:59.785926 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:52:59.785926 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:52:59.785926 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:52:59.785926 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:52:59.785926 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:52:59.785926 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:52:59.785926 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:52:59.785926 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:52:59.787034 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:52:59.787034 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:52:59.787034 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:52:59.787034 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:52:59.787034 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 601/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:52:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:52:59.791932 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9bd2a-f989-4539-9f6b-33b25ecfa9ab None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:52:59.886177 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:52:59.892910 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9bd2a-f989-4539-9f6b-33b25ecfa9ab None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:52:59.927017 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f9e95-d9bb-4158-a6f5-1106260e0a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:52:59.927639 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f9e95-d9bb-4158-a6f5-1106260e0a16 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:52:59.927921 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f9e95-d9bb-4158-a6f5-1106260e0a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:52:59.928224 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f9e95-d9bb-4158-a6f5-1106260e0a16 None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:52:59.928919 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f9e95-d9bb-4158-a6f5-1106260e0a16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:52:59.929223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f9e95-d9bb-4158-a6f5-1106260e0a16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:52:59.930606 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f9e95-d9bb-4158-a6f5-1106260e0a16 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:52:59.942563 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 642/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:52:59.948715 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df6cad-0b23-4107-8915-56efb19bded4 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:00.033503 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:00.055719 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df6cad-0b23-4107-8915-56efb19bded4 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:00.089712 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9cfc3-33d5-406c-8f96-a5043e4cb8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:00.090348 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9cfc3-33d5-406c-8f96-a5043e4cb8be None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:00.090628 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9cfc3-33d5-406c-8f96-a5043e4cb8be None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:00.090902 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9cfc3-33d5-406c-8f96-a5043e4cb8be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:00.097733 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9cfc3-33d5-406c-8f96-a5043e4cb8be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:00.099217 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9cfc3-33d5-406c-8f96-a5043e4cb8be None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:00.111106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-6cd9cfc3-33d5-406c-8f96-a5043e4cb8be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:53:00.111106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:53:00.111106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:53:00.111106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:53:00.111106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:53:00.111106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:53:00.111106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:53:00.111106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:53:00.111106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:53:00.111106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:53:00.111106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:53:00.111106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:53:00.111106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:53:00.111106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:53:00.111106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:53:00.112191 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:53:00.112191 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:53:00.112191 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:53:00.112191 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:53:00.112191 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:53:00.112191 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:53:00.112191 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:53:00.112191 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:53:00.112191 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:53:00.112191 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:53:00.112191 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:53:00.112191 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:53:00.112191 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:53:00.112191 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:53:00.112191 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:53:00.112191 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:53:00.112191 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:53:00.113217 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:53:00.113217 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:53:00.113217 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:53:00.113217 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:53:00.113217 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:53:00.113217 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:53:00.113217 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:53:00.113217 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:53:00.113217 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 602/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:52:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:53:00.118748 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f9e95-d9bb-4158-a6f5-1106260e0a16 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:00.221411 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f9e95-d9bb-4158-a6f5-1106260e0a16 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:00.256552 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42481ce8-f592-45cb-8b27-6639118dcecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:00.257226 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42481ce8-f592-45cb-8b27-6639118dcecc None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:00.257511 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42481ce8-f592-45cb-8b27-6639118dcecc None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:00.257788 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42481ce8-f592-45cb-8b27-6639118dcecc None admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:00.258540 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42481ce8-f592-45cb-8b27-6639118dcecc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:00.258845 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42481ce8-f592-45cb-8b27-6639118dcecc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:00.260302 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42481ce8-f592-45cb-8b27-6639118dcecc None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:00.272651 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 643/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:53:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:53:00.279243 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9cfc3-33d5-406c-8f96-a5043e4cb8be None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:00.382261 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9cfc3-33d5-406c-8f96-a5043e4cb8be None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:00.418261 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebef6f0-d471-4828-ba65-4a24aa9d4af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:00.418881 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebef6f0-d471-4828-ba65-4a24aa9d4af2 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:00.419165 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebef6f0-d471-4828-ba65-4a24aa9d4af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:00.419441 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebef6f0-d471-4828-ba65-4a24aa9d4af2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:00.420945 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebef6f0-d471-4828-ba65-4a24aa9d4af2 None admin] RBAC: Adding query filter params (role.id=bc21bdc3d9dd4091a04f1e2fef77a8c3, scope.project.id=6910e69702854607889bab124edd60c9, user.id=aa8cac76aa21415d8ab0a2524a7049d8) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:00.421259 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebef6f0-d471-4828-ba65-4a24aa9d4af2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:00.422707 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebef6f0-d471-4828-ba65-4a24aa9d4af2 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:00.428768 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 603/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:53:00 2022] GET /identity/v3/role_assignments?user.id=aa8cac76aa21415d8ab0a2524a7049d8&scope.project.id=6910e69702854607889bab124edd60c9&role.id=bc21bdc3d9dd4091a04f1e2fef77a8c3 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:53:02.499038 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8f311-951f-422c-a901-2c95aa37a825 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:02.499618 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8f311-951f-422c-a901-2c95aa37a825 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:02.499618 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8f311-951f-422c-a901-2c95aa37a825 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:02.500985 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 644/1247] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:53:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:53:02.506219 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021d67f-3f1a-4bf0-b361-62e31e3162a1 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:02.506620 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021d67f-3f1a-4bf0-b361-62e31e3162a1 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:02.506987 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021d67f-3f1a-4bf0-b361-62e31e3162a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:02.513166 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:02.524933 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-7021d67f-3f1a-4bf0-b361-62e31e3162a1 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:02.526160 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-7021d67f-3f1a-4bf0-b361-62e31e3162a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:02.590755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 604/1248] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:53:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:53:02.613908 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8f311-951f-422c-a901-2c95aa37a825 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:02.633514 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:02.726874 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8f311-951f-422c-a901-2c95aa37a825 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:02.762059 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d4bfb-785e-4639-98db-c936705e075a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:02.762748 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d4bfb-785e-4639-98db-c936705e075a None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:02.763029 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d4bfb-785e-4639-98db-c936705e075a None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:02.763302 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d4bfb-785e-4639-98db-c936705e075a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:02.774082 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68d4bfb-785e-4639-98db-c936705e075a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:53:02.778938 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-d68d4bfb-785e-4639-98db-c936705e075a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:53:02.778938 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:53:02.778938 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:53:02.778938 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:53:02.778938 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:53:02.778938 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:53:02.778938 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:53:02.778938 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:53:02.778938 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:53:02.778938 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:53:02.778938 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:53:02.778938 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:53:02.778938 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:53:02.778938 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:53:02.778938 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:53:02.778938 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:53:02.784069 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:53:02.784069 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:53:02.784069 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:53:02.784069 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:53:02.784069 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:53:02.784069 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:53:02.784069 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:53:02.784069 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:53:02.784069 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:53:02.784069 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:53:02.784069 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:53:02.784069 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:53:02.784069 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:53:02.784069 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:53:02.784069 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:53:02.784069 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:53:02.785206 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:53:02.785206 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:53:02.785206 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:53:02.785206 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:53:02.785206 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:53:02.785206 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:53:02.785206 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:53:02.785206 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:53:02.785206 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:53:02.785206 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:53:02.785206 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:53:02.785206 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:53:02.785206 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 645/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:53:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:53:02.786782 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021d67f-3f1a-4bf0-b361-62e31e3162a1 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:02.887455 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021d67f-3f1a-4bf0-b361-62e31e3162a1 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:02.923932 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:02.928741 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044326d-dad4-4656-9cf1-8815a193b1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:02.929354 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044326d-dad4-4656-9cf1-8815a193b1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:02.929631 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044326d-dad4-4656-9cf1-8815a193b1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:02.929897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044326d-dad4-4656-9cf1-8815a193b1b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:02.930601 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044326d-dad4-4656-9cf1-8815a193b1b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:02.930899 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044326d-dad4-4656-9cf1-8815a193b1b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:02.932279 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044326d-dad4-4656-9cf1-8815a193b1b0 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:02.940905 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 605/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:53:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:53:02.946688 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d4bfb-785e-4639-98db-c936705e075a None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:03.024963 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:03.048651 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d4bfb-785e-4639-98db-c936705e075a None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:03.083567 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b09fcb-6ed1-4603-a745-c920fc9bf95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:03.084231 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b09fcb-6ed1-4603-a745-c920fc9bf95d None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:03.084518 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b09fcb-6ed1-4603-a745-c920fc9bf95d None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:03.084793 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b09fcb-6ed1-4603-a745-c920fc9bf95d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:03.094878 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b09fcb-6ed1-4603-a745-c920fc9bf95d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:03.096411 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b09fcb-6ed1-4603-a745-c920fc9bf95d None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:03.112668 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-d8b09fcb-6ed1-4603-a745-c920fc9bf95d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:53:03.112668 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:53:03.112668 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:53:03.112668 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:53:03.112668 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:53:03.112668 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:53:03.112668 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:53:03.112668 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:53:03.112668 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:53:03.112668 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:53:03.112668 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:53:03.112668 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:53:03.112668 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:53:03.112668 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:53:03.112668 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:53:03.113827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:53:03.113827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:53:03.113827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:53:03.113827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:53:03.113827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:53:03.113827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:53:03.113827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:53:03.113827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:53:03.113827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:53:03.113827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:53:03.113827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:53:03.113827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:53:03.113827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:53:03.113827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:53:03.113827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:53:03.113827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:53:03.113827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:53:03.114792 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:53:03.114792 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:53:03.114792 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:53:03.114792 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:53:03.114792 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 646/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:53:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:53:03.119969 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044326d-dad4-4656-9cf1-8815a193b1b0 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:03.221485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044326d-dad4-4656-9cf1-8815a193b1b0 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:03.255881 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f9c76-a626-4374-b7e0-1443ab54192c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:03.256534 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f9c76-a626-4374-b7e0-1443ab54192c None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:03.256816 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f9c76-a626-4374-b7e0-1443ab54192c None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:03.257093 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f9c76-a626-4374-b7e0-1443ab54192c None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:03.257854 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f9c76-a626-4374-b7e0-1443ab54192c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:03.258173 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f9c76-a626-4374-b7e0-1443ab54192c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:03.259555 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f9c76-a626-4374-b7e0-1443ab54192c None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:03.272360 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 606/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:53:03.278524 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b09fcb-6ed1-4603-a745-c920fc9bf95d None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:03.382367 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b09fcb-6ed1-4603-a745-c920fc9bf95d None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:03.409999 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:03.418524 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8c3f6-9398-43c5-ab5f-59067aa15034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:03.419188 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8c3f6-9398-43c5-ab5f-59067aa15034 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:03.419470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8c3f6-9398-43c5-ab5f-59067aa15034 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:03.419746 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8c3f6-9398-43c5-ab5f-59067aa15034 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:03.428710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8c3f6-9398-43c5-ab5f-59067aa15034 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:03.430218 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8c3f6-9398-43c5-ab5f-59067aa15034 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:03.442425 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-36d8c3f6-9398-43c5-ab5f-59067aa15034 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:53:03.442425 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:53:03.442425 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:53:03.442425 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:53:03.442425 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:53:03.442425 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:53:03.442425 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:53:03.442425 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:53:03.442425 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:53:03.442425 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:53:03.442425 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:53:03.442425 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:53:03.442425 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:53:03.442425 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:53:03.442425 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:53:03.442425 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:53:03.443612 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:53:03.443612 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:53:03.443612 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:53:03.443612 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:53:03.443612 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:53:03.443612 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:53:03.443612 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:53:03.443612 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:53:03.443612 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:53:03.443612 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:53:03.443612 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:53:03.443612 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:53:03.443612 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:53:03.443612 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:53:03.443612 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:53:03.443612 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:53:03.443612 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:53:03.443612 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:53:03.449411 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:53:03.449411 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:53:03.449411 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:53:03.449411 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:53:03.449411 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:53:03.449411 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:53:03.449411 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:53:03.449411 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:53:03.449411 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:53:03.449411 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:53:03.449411 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 647/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:53:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:53:03.450076 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f9c76-a626-4374-b7e0-1443ab54192c None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:03.510348 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:03.565506 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f9c76-a626-4374-b7e0-1443ab54192c None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:03.601202 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a334d5-1455-4f5f-9ac7-2af0d7990f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:03.601821 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a334d5-1455-4f5f-9ac7-2af0d7990f47 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:03.602100 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a334d5-1455-4f5f-9ac7-2af0d7990f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:03.602373 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a334d5-1455-4f5f-9ac7-2af0d7990f47 None admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:03.603167 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a334d5-1455-4f5f-9ac7-2af0d7990f47 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:03.603473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a334d5-1455-4f5f-9ac7-2af0d7990f47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:03.604936 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a334d5-1455-4f5f-9ac7-2af0d7990f47 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:03.624064 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 607/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Aug 2 08:53:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:53:03.630258 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8c3f6-9398-43c5-ab5f-59067aa15034 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:03.759643 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8c3f6-9398-43c5-ab5f-59067aa15034 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:03.822634 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2436f43b-14d4-4aaa-a6bc-030658aa56e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:03.823334 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436f43b-14d4-4aaa-a6bc-030658aa56e1 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:03.823538 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436f43b-14d4-4aaa-a6bc-030658aa56e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:03.823806 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436f43b-14d4-4aaa-a6bc-030658aa56e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:03.881469 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:03.893763 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2436f43b-14d4-4aaa-a6bc-030658aa56e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:03.895215 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2436f43b-14d4-4aaa-a6bc-030658aa56e1 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:03.995833 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 648/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:53:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:53:04.003862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a334d5-1455-4f5f-9ac7-2af0d7990f47 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:04.105372 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a334d5-1455-4f5f-9ac7-2af0d7990f47 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:04.119878 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:04.141602 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289662b-0201-4b72-9e81-c07a42da15fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:04.142246 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289662b-0201-4b72-9e81-c07a42da15fb None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:04.142529 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289662b-0201-4b72-9e81-c07a42da15fb None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:04.142806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289662b-0201-4b72-9e81-c07a42da15fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:04.153056 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289662b-0201-4b72-9e81-c07a42da15fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:04.155168 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289662b-0201-4b72-9e81-c07a42da15fb None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:04.170614 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-2289662b-0201-4b72-9e81-c07a42da15fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:53:04.170614 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:53:04.170614 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:53:04.170614 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:53:04.170614 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:53:04.170614 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:53:04.170614 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:53:04.170614 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:53:04.170614 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:53:04.170614 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:53:04.170614 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:53:04.170614 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:53:04.170614 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:53:04.170614 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:53:04.170614 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:53:04.171689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:53:04.171689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:53:04.171689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:53:04.171689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:53:04.171689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:53:04.171689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:53:04.171689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:53:04.171689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:53:04.171689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:53:04.171689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:53:04.171689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:53:04.171689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:53:04.171689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:53:04.171689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:53:04.171689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:53:04.171689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:53:04.171689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:53:04.177016 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:53:04.177016 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:53:04.177016 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:53:04.177016 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:53:04.177016 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 608/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:53:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:53:04.177696 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2436f43b-14d4-4aaa-a6bc-030658aa56e1 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:04.267959 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:04.280833 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2436f43b-14d4-4aaa-a6bc-030658aa56e1 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:04.316537 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af833581-3a9d-44ce-9dd4-44388b097e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:04.317366 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af833581-3a9d-44ce-9dd4-44388b097e77 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:04.317657 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af833581-3a9d-44ce-9dd4-44388b097e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:04.317935 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af833581-3a9d-44ce-9dd4-44388b097e77 None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:04.318629 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af833581-3a9d-44ce-9dd4-44388b097e77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:04.318937 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af833581-3a9d-44ce-9dd4-44388b097e77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:04.320372 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af833581-3a9d-44ce-9dd4-44388b097e77 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:04.331946 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 649/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:53:04.337900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289662b-0201-4b72-9e81-c07a42da15fb None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:04.450458 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289662b-0201-4b72-9e81-c07a42da15fb None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:04.485272 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9bdf2-85db-4684-bf1f-d7a039d67aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:04.485909 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9bdf2-85db-4684-bf1f-d7a039d67aec None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:04.486235 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9bdf2-85db-4684-bf1f-d7a039d67aec None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:04.486497 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9bdf2-85db-4684-bf1f-d7a039d67aec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:04.493672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9bdf2-85db-4684-bf1f-d7a039d67aec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:04.495085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9bdf2-85db-4684-bf1f-d7a039d67aec None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:04.506938 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-d0c9bdf2-85db-4684-bf1f-d7a039d67aec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:53:04.506938 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:53:04.506938 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:53:04.506938 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:53:04.506938 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:53:04.506938 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:53:04.506938 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:53:04.506938 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:53:04.506938 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:53:04.506938 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:53:04.506938 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:53:04.506938 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:53:04.506938 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:53:04.506938 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:53:04.506938 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:53:04.508136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:53:04.508136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:53:04.508136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:53:04.508136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:53:04.508136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:53:04.508136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:53:04.508136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:53:04.508136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:53:04.508136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:53:04.508136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:53:04.508136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:53:04.508136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:53:04.508136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:53:04.508136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:53:04.508136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:53:04.508136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:53:04.508136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:53:04.509087 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:53:04.509087 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:53:04.509087 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:53:04.509087 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:53:04.509087 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:53:04.509087 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:53:04.509087 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:53:04.509087 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:53:04.509087 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 609/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:53:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:53:04.514534 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af833581-3a9d-44ce-9dd4-44388b097e77 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:04.614514 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af833581-3a9d-44ce-9dd4-44388b097e77 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:04.649152 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f90f6-b0cf-40b1-b133-a82052477b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:04.649820 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f90f6-b0cf-40b1-b133-a82052477b61 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:04.650037 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f90f6-b0cf-40b1-b133-a82052477b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:04.650310 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f90f6-b0cf-40b1-b133-a82052477b61 None admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:04.651058 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f90f6-b0cf-40b1-b133-a82052477b61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:04.651358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f90f6-b0cf-40b1-b133-a82052477b61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:04.652912 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f90f6-b0cf-40b1-b133-a82052477b61 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:04.665907 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 650/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:53:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:53:04.672645 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9bdf2-85db-4684-bf1f-d7a039d67aec None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:04.699387 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:04.776769 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9bdf2-85db-4684-bf1f-d7a039d67aec None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:04.810341 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb7334-9bac-4729-996d-c73a004c2ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:04.811567 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb7334-9bac-4729-996d-c73a004c2ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:04.811869 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb7334-9bac-4729-996d-c73a004c2ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:04.812149 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb7334-9bac-4729-996d-c73a004c2ef8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:04.812952 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb7334-9bac-4729-996d-c73a004c2ef8 None admin] RBAC: Adding query filter params (role.id=b5477d3c4e5a4514b64211ec2452d1d8, scope.project.id=6910e69702854607889bab124edd60c9, user.id=aa8cac76aa21415d8ab0a2524a7049d8) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:04.813258 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb7334-9bac-4729-996d-c73a004c2ef8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:04.814710 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb7334-9bac-4729-996d-c73a004c2ef8 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:04.820226 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 610/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:53:04 2022] GET /identity/v3/role_assignments?user.id=aa8cac76aa21415d8ab0a2524a7049d8&scope.project.id=6910e69702854607889bab124edd60c9&role.id=b5477d3c4e5a4514b64211ec2452d1d8 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:53:06.857610 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc254a9-4760-496f-8889-a4e65cef9f08 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:06.858305 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc254a9-4760-496f-8889-a4e65cef9f08 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:06.858305 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc254a9-4760-496f-8889-a4e65cef9f08 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:06.859539 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 651/1261] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:53:06.864993 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31909e55-c4e5-4302-99ac-d978e7fd749a None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:06.865470 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31909e55-c4e5-4302-99ac-d978e7fd749a None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:06.865651 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31909e55-c4e5-4302-99ac-d978e7fd749a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:06.887799 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-31909e55-c4e5-4302-99ac-d978e7fd749a None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:06.893899 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-31909e55-c4e5-4302-99ac-d978e7fd749a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:06.963103 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 611/1262] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:53:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:53:06.986951 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc254a9-4760-496f-8889-a4e65cef9f08 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:06.998517 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:07.093904 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc254a9-4760-496f-8889-a4e65cef9f08 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:07.128353 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e38364-fe92-41ea-a673-9e889a2a5ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:07.129044 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e38364-fe92-41ea-a673-9e889a2a5ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:07.129324 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e38364-fe92-41ea-a673-9e889a2a5ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:07.129599 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e38364-fe92-41ea-a673-9e889a2a5ec6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:07.140323 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e38364-fe92-41ea-a673-9e889a2a5ec6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:53:07.145396 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-04e38364-fe92-41ea-a673-9e889a2a5ec6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:53:07.145396 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:53:07.145396 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:53:07.145396 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:53:07.145396 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:53:07.145396 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:53:07.145396 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:53:07.145396 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:53:07.145396 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:53:07.145396 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:53:07.145396 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:53:07.145396 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:53:07.145396 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:53:07.145396 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:53:07.145396 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:53:07.145396 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:53:07.148550 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:53:07.148550 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:53:07.148550 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:53:07.148550 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:53:07.148550 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:53:07.148550 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:53:07.148550 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:53:07.148550 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:53:07.148550 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:53:07.148550 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:53:07.148550 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:53:07.148550 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:53:07.148550 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:53:07.148550 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:53:07.148550 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:53:07.148550 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:53:07.151011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:53:07.151011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:53:07.151011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:53:07.151011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:53:07.151011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:53:07.151011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:53:07.151011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:53:07.151011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:53:07.151011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:53:07.151011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:53:07.151011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:53:07.151011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:53:07.151011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 652/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:53:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:53:07.153044 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31909e55-c4e5-4302-99ac-d978e7fd749a None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:07.175467 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:07.261350 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31909e55-c4e5-4302-99ac-d978e7fd749a None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:07.298523 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5c3a6-5567-410b-b65b-bce669790561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:07.299141 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5c3a6-5567-410b-b65b-bce669790561 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:07.299417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5c3a6-5567-410b-b65b-bce669790561 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:07.299689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5c3a6-5567-410b-b65b-bce669790561 None admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:07.300439 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5c3a6-5567-410b-b65b-bce669790561 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:07.300750 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5c3a6-5567-410b-b65b-bce669790561 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:07.302086 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5c3a6-5567-410b-b65b-bce669790561 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:07.315894 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 612/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:53:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:53:07.317171 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e38364-fe92-41ea-a673-9e889a2a5ec6 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:07.390287 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:07.423046 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e38364-fe92-41ea-a673-9e889a2a5ec6 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:07.458541 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10165780-eded-4b02-96d4-512426fa84b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:07.459185 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10165780-eded-4b02-96d4-512426fa84b5 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:07.459464 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10165780-eded-4b02-96d4-512426fa84b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:07.459738 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10165780-eded-4b02-96d4-512426fa84b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:07.470225 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10165780-eded-4b02-96d4-512426fa84b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:07.471676 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10165780-eded-4b02-96d4-512426fa84b5 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:07.486606 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-10165780-eded-4b02-96d4-512426fa84b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:53:07.486606 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:53:07.486606 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:53:07.486606 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:53:07.486606 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:53:07.486606 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:53:07.486606 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:53:07.486606 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:53:07.486606 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:53:07.486606 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:53:07.486606 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:53:07.486606 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:53:07.486606 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:53:07.486606 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:53:07.486606 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:53:07.487766 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:53:07.487766 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:53:07.487766 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:53:07.487766 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:53:07.487766 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:53:07.487766 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:53:07.487766 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:53:07.487766 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:53:07.487766 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:53:07.487766 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:53:07.487766 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:53:07.487766 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:53:07.487766 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:53:07.487766 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:53:07.487766 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:53:07.487766 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:53:07.487766 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:53:07.488941 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:53:07.488941 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:53:07.488941 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:53:07.488941 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:53:07.488941 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 653/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:53:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:53:07.493990 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5c3a6-5567-410b-b65b-bce669790561 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:07.580436 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:07.599590 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5c3a6-5567-410b-b65b-bce669790561 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:07.635024 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46dfdc-63dd-4ebc-8087-fe17e85fc474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:07.635662 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46dfdc-63dd-4ebc-8087-fe17e85fc474 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:07.636216 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46dfdc-63dd-4ebc-8087-fe17e85fc474 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:07.636495 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46dfdc-63dd-4ebc-8087-fe17e85fc474 None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:07.637264 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46dfdc-63dd-4ebc-8087-fe17e85fc474 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:07.637794 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46dfdc-63dd-4ebc-8087-fe17e85fc474 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:07.639490 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46dfdc-63dd-4ebc-8087-fe17e85fc474 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:07.651251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 613/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:53:07.657297 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10165780-eded-4b02-96d4-512426fa84b5 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:07.761129 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10165780-eded-4b02-96d4-512426fa84b5 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:07.780931 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:07.794498 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3d1ff-a58b-48b7-8467-fa4c1a847032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:07.795827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3d1ff-a58b-48b7-8467-fa4c1a847032 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:07.796108 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3d1ff-a58b-48b7-8467-fa4c1a847032 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:07.796411 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3d1ff-a58b-48b7-8467-fa4c1a847032 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:07.804081 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3d1ff-a58b-48b7-8467-fa4c1a847032 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:07.805547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3d1ff-a58b-48b7-8467-fa4c1a847032 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:07.817484 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-b4e3d1ff-a58b-48b7-8467-fa4c1a847032 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:53:07.817484 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:53:07.817484 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:53:07.817484 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:53:07.817484 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:53:07.817484 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:53:07.817484 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:53:07.817484 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:53:07.817484 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:53:07.817484 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:53:07.817484 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:53:07.817484 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:53:07.817484 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:53:07.817484 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:53:07.817484 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:53:07.817484 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:53:07.818571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:53:07.818571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:53:07.818571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:53:07.818571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:53:07.818571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:53:07.818571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:53:07.818571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:53:07.818571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:53:07.818571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:53:07.818571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:53:07.818571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:53:07.818571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:53:07.818571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:53:07.818571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:53:07.818571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:53:07.818571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:53:07.818571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:53:07.818571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:53:07.824848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:53:07.824848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:53:07.824848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:53:07.824848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:53:07.824848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:53:07.824848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:53:07.824848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:53:07.824848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:53:07.824848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:53:07.824848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:53:07.824848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 654/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:53:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:53:07.825572 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46dfdc-63dd-4ebc-8087-fe17e85fc474 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:07.928902 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46dfdc-63dd-4ebc-8087-fe17e85fc474 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:07.963113 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8dd3c-0ebf-4d01-a9ec-627562b78e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:07.963738 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8dd3c-0ebf-4d01-a9ec-627562b78e80 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:07.964029 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8dd3c-0ebf-4d01-a9ec-627562b78e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:07.964338 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8dd3c-0ebf-4d01-a9ec-627562b78e80 None admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:07.965142 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8dd3c-0ebf-4d01-a9ec-627562b78e80 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:07.965462 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8dd3c-0ebf-4d01-a9ec-627562b78e80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:07.967427 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8dd3c-0ebf-4d01-a9ec-627562b78e80 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:07.976725 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:07.985239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 614/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Aug 2 08:53:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:53:07.991139 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3d1ff-a58b-48b7-8467-fa4c1a847032 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:08.094630 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3d1ff-a58b-48b7-8467-fa4c1a847032 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:08.129336 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df111d2b-6097-4b8b-b922-523e002cfef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:08.129978 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df111d2b-6097-4b8b-b922-523e002cfef0 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:08.130258 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df111d2b-6097-4b8b-b922-523e002cfef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:08.130530 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df111d2b-6097-4b8b-b922-523e002cfef0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:08.142242 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df111d2b-6097-4b8b-b922-523e002cfef0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:08.143713 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df111d2b-6097-4b8b-b922-523e002cfef0 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:08.158789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-df111d2b-6097-4b8b-b922-523e002cfef0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:53:08.158789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:53:08.158789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:53:08.158789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:53:08.158789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:53:08.158789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:53:08.158789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:53:08.158789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:53:08.158789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:53:08.158789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:53:08.158789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:53:08.158789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:53:08.158789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:53:08.158789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:53:08.158789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:53:08.159889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:53:08.159889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:53:08.159889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:53:08.159889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:53:08.159889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:53:08.159889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:53:08.159889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:53:08.159889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:53:08.159889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:53:08.159889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:53:08.159889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:53:08.159889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:53:08.159889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:53:08.159889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:53:08.159889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:53:08.159889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:53:08.159889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:53:08.160996 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:53:08.160996 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:53:08.160996 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:53:08.160996 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:53:08.160996 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 655/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:53:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:53:08.165927 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8dd3c-0ebf-4d01-a9ec-627562b78e80 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:08.268506 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8dd3c-0ebf-4d01-a9ec-627562b78e80 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:08.304331 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ebf70-5853-43b2-a703-ca66b4cdd754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:08.304935 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ebf70-5853-43b2-a703-ca66b4cdd754 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:08.305214 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ebf70-5853-43b2-a703-ca66b4cdd754 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:08.305484 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ebf70-5853-43b2-a703-ca66b4cdd754 None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:08.306166 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ebf70-5853-43b2-a703-ca66b4cdd754 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:08.306464 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ebf70-5853-43b2-a703-ca66b4cdd754 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:08.307815 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ebf70-5853-43b2-a703-ca66b4cdd754 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:08.319310 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 615/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:53:08.325019 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df111d2b-6097-4b8b-b922-523e002cfef0 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:08.359370 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:08.430101 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df111d2b-6097-4b8b-b922-523e002cfef0 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:08.468536 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb615197-e679-48a1-9b34-583a0fa25874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:08.473931 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb615197-e679-48a1-9b34-583a0fa25874 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:08.473931 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb615197-e679-48a1-9b34-583a0fa25874 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:08.473931 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb615197-e679-48a1-9b34-583a0fa25874 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:08.480060 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb615197-e679-48a1-9b34-583a0fa25874 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:08.481648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb615197-e679-48a1-9b34-583a0fa25874 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:08.493623 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-cb615197-e679-48a1-9b34-583a0fa25874 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:53:08.493623 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:53:08.493623 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:53:08.493623 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:53:08.493623 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:53:08.493623 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:53:08.493623 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:53:08.493623 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:53:08.493623 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:53:08.493623 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:53:08.493623 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:53:08.493623 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:53:08.493623 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:53:08.493623 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:53:08.493623 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:53:08.499201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:53:08.499201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:53:08.499201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:53:08.499201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:53:08.499201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:53:08.499201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:53:08.499201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:53:08.499201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:53:08.499201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:53:08.499201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:53:08.499201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:53:08.499201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:53:08.499201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:53:08.499201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:53:08.499201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:53:08.499201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:53:08.499201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:53:08.500664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:53:08.500664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:53:08.500664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:53:08.500664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:53:08.500664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:53:08.500664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:53:08.500664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:53:08.500664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:53:08.500664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 656/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:53:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:53:08.501380 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ebf70-5853-43b2-a703-ca66b4cdd754 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:08.561489 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:08.603558 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ebf70-5853-43b2-a703-ca66b4cdd754 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:08.637848 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1021a010-ed33-49d2-a3a9-89ddccaf677f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:08.638526 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021a010-ed33-49d2-a3a9-89ddccaf677f None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:08.638774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021a010-ed33-49d2-a3a9-89ddccaf677f None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:08.639045 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021a010-ed33-49d2-a3a9-89ddccaf677f None admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:08.639796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1021a010-ed33-49d2-a3a9-89ddccaf677f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:08.640092 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1021a010-ed33-49d2-a3a9-89ddccaf677f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:08.642185 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1021a010-ed33-49d2-a3a9-89ddccaf677f None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:08.654462 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 616/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:53:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:53:08.660761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb615197-e679-48a1-9b34-583a0fa25874 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:08.756197 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:08.764859 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb615197-e679-48a1-9b34-583a0fa25874 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:08.804385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787d77e-d774-4a61-aeb9-75bf334e0fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:08.805070 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787d77e-d774-4a61-aeb9-75bf334e0fd9 None admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:08.805356 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787d77e-d774-4a61-aeb9-75bf334e0fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:08.805661 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787d77e-d774-4a61-aeb9-75bf334e0fd9 None admin] PATH_INFO: `/v3/projects/6910e69702854607889bab124edd60c9/users/aa8cac76aa21415d8ab0a2524a7049d8/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:08.807696 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787d77e-d774-4a61-aeb9-75bf334e0fd9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6910e69702854607889bab124edd60c9, user_id=aa8cac76aa21415d8ab0a2524a7049d8, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:08.809190 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787d77e-d774-4a61-aeb9-75bf334e0fd9 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:08.941380 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 657/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Aug 2 08:53:08 2022] PUT /identity/v3/projects/6910e69702854607889bab124edd60c9/users/aa8cac76aa21415d8ab0a2524a7049d8/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:53:10.973934 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c6f96-9d16-4a30-b7f5-8586893c7740 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:10.974490 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c6f96-9d16-4a30-b7f5-8586893c7740 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:10.974609 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c6f96-9d16-4a30-b7f5-8586893c7740 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:10.975895 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 617/1274] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:53:10.981481 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba28e6e-af7c-40da-a970-0cc000e098a0 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:10.982062 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba28e6e-af7c-40da-a970-0cc000e098a0 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:10.982062 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba28e6e-af7c-40da-a970-0cc000e098a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:11.001498 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-7ba28e6e-af7c-40da-a970-0cc000e098a0 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:11.002744 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-7ba28e6e-af7c-40da-a970-0cc000e098a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:11.072071 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 658/1275] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:53:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:53:11.096714 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c6f96-9d16-4a30-b7f5-8586893c7740 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:11.208518 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c6f96-9d16-4a30-b7f5-8586893c7740 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:11.226216 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:11.243814 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b9493-7f56-4768-9baa-576e8b35bae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:11.244492 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b9493-7f56-4768-9baa-576e8b35bae0 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:11.244772 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b9493-7f56-4768-9baa-576e8b35bae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:11.245049 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b9493-7f56-4768-9baa-576e8b35bae0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:11.255921 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b9493-7f56-4768-9baa-576e8b35bae0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:53:11.260782 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-e70b9493-7f56-4768-9baa-576e8b35bae0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:53:11.260782 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:53:11.260782 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:53:11.260782 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:53:11.260782 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:53:11.260782 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:53:11.260782 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:53:11.260782 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:53:11.260782 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:53:11.260782 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:53:11.260782 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:53:11.260782 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:53:11.260782 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:53:11.260782 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:53:11.260782 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:53:11.260782 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:53:11.262055 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:53:11.262055 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:53:11.262055 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:53:11.262055 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:53:11.262055 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:53:11.262055 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:53:11.262055 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:53:11.262055 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:53:11.262055 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:53:11.262055 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:53:11.262055 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:53:11.262055 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:53:11.262055 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:53:11.262055 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:53:11.262055 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:53:11.262055 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:53:11.262952 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:53:11.262952 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:53:11.262952 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:53:11.262952 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:53:11.262952 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:53:11.262952 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:53:11.262952 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:53:11.262952 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:53:11.262952 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:53:11.262952 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:53:11.262952 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:53:11.262952 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:53:11.262952 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 618/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Aug 2 08:53:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:53:11.268222 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba28e6e-af7c-40da-a970-0cc000e098a0 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:11.351921 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:11.370457 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba28e6e-af7c-40da-a970-0cc000e098a0 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:11.405452 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab556ee2-f5e0-41f8-aab9-afd101e4d16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:11.406174 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab556ee2-f5e0-41f8-aab9-afd101e4d16f None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:11.406464 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab556ee2-f5e0-41f8-aab9-afd101e4d16f None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:11.406739 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab556ee2-f5e0-41f8-aab9-afd101e4d16f None admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:11.407582 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab556ee2-f5e0-41f8-aab9-afd101e4d16f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:11.407892 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab556ee2-f5e0-41f8-aab9-afd101e4d16f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:11.409326 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab556ee2-f5e0-41f8-aab9-afd101e4d16f None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:11.417873 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 659/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Aug 2 08:53:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:53:11.424513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b9493-7f56-4768-9baa-576e8b35bae0 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:11.534375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b9493-7f56-4768-9baa-576e8b35bae0 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:11.570885 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f51eb7-e222-4465-a8b9-3c9871acd54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:11.571535 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f51eb7-e222-4465-a8b9-3c9871acd54e None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:11.571818 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f51eb7-e222-4465-a8b9-3c9871acd54e None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:11.572092 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f51eb7-e222-4465-a8b9-3c9871acd54e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:11.582455 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f51eb7-e222-4465-a8b9-3c9871acd54e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:11.583910 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f51eb7-e222-4465-a8b9-3c9871acd54e None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:11.599159 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-b8f51eb7-e222-4465-a8b9-3c9871acd54e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:53:11.599159 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:53:11.599159 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:53:11.599159 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:53:11.599159 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:53:11.599159 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:53:11.599159 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:53:11.599159 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:53:11.599159 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:53:11.599159 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:53:11.599159 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:53:11.599159 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:53:11.599159 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:53:11.599159 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:53:11.599159 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:53:11.600896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:53:11.600896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:53:11.600896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:53:11.600896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:53:11.600896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:53:11.600896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:53:11.600896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:53:11.600896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:53:11.600896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:53:11.600896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:53:11.600896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:53:11.600896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:53:11.600896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:53:11.600896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:53:11.600896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:53:11.600896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:53:11.600896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:53:11.602652 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:53:11.602652 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:53:11.602652 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:53:11.602652 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:53:11.604325 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 619/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:53:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:53:11.606348 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab556ee2-f5e0-41f8-aab9-afd101e4d16f None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:11.715651 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab556ee2-f5e0-41f8-aab9-afd101e4d16f None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:11.750468 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cce779-8b49-49dd-987b-2c667c1cf8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:11.751115 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cce779-8b49-49dd-987b-2c667c1cf8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:11.751449 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cce779-8b49-49dd-987b-2c667c1cf8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:11.751681 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cce779-8b49-49dd-987b-2c667c1cf8f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:11.752441 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cce779-8b49-49dd-987b-2c667c1cf8f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:11.752705 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cce779-8b49-49dd-987b-2c667c1cf8f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:11.754073 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cce779-8b49-49dd-987b-2c667c1cf8f2 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:11.766718 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 660/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:53:11.772651 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f51eb7-e222-4465-a8b9-3c9871acd54e None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:11.804645 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:11.873862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f51eb7-e222-4465-a8b9-3c9871acd54e None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:11.908859 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820158b-510b-4e4e-99a4-1849f025c5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:11.909631 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820158b-510b-4e4e-99a4-1849f025c5d4 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:11.909908 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820158b-510b-4e4e-99a4-1849f025c5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:11.910178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820158b-510b-4e4e-99a4-1849f025c5d4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:11.917830 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820158b-510b-4e4e-99a4-1849f025c5d4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:11.919294 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820158b-510b-4e4e-99a4-1849f025c5d4 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:11.932028 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-9820158b-510b-4e4e-99a4-1849f025c5d4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:53:11.932028 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:53:11.932028 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:53:11.932028 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:53:11.932028 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:53:11.932028 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:53:11.932028 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:53:11.932028 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:53:11.932028 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:53:11.932028 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:53:11.932028 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:53:11.932028 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:53:11.932028 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:53:11.932028 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:53:11.932028 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:53:11.932028 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:53:11.938639 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:53:11.938639 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:53:11.938639 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:53:11.938639 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:53:11.938639 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:53:11.938639 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:53:11.938639 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:53:11.938639 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:53:11.938639 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:53:11.938639 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:53:11.938639 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:53:11.938639 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:53:11.938639 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:53:11.938639 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:53:11.938639 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:53:11.938639 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:53:11.938639 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:53:11.938639 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:53:11.939792 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:53:11.939792 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:53:11.939792 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:53:11.939792 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:53:11.939792 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:53:11.939792 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:53:11.939792 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:53:11.939792 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:53:11.939792 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:53:11.939792 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:53:11.939792 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 620/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:53:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:53:11.941663 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cce779-8b49-49dd-987b-2c667c1cf8f2 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:11.945487 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:12.040263 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cce779-8b49-49dd-987b-2c667c1cf8f2 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:12.075733 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c766ed3-4d87-44d9-9b19-c74817328a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:12.076334 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c766ed3-4d87-44d9-9b19-c74817328a61 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:12.076635 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c766ed3-4d87-44d9-9b19-c74817328a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:12.076910 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c766ed3-4d87-44d9-9b19-c74817328a61 None admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:12.077711 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c766ed3-4d87-44d9-9b19-c74817328a61 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:12.078241 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c766ed3-4d87-44d9-9b19-c74817328a61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:12.079758 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c766ed3-4d87-44d9-9b19-c74817328a61 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:12.097004 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 661/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Aug 2 08:53:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:53:12.102851 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820158b-510b-4e4e-99a4-1849f025c5d4 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:12.203397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:12.213089 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820158b-510b-4e4e-99a4-1849f025c5d4 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:12.248799 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b52acd-a3fa-4f24-8975-85232f8e9091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:12.249419 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b52acd-a3fa-4f24-8975-85232f8e9091 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:12.249908 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b52acd-a3fa-4f24-8975-85232f8e9091 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:12.250150 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b52acd-a3fa-4f24-8975-85232f8e9091 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:12.319595 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b52acd-a3fa-4f24-8975-85232f8e9091 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:12.321150 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b52acd-a3fa-4f24-8975-85232f8e9091 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:12.414501 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:12.425819 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 621/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Aug 2 08:53:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:53:12.431953 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c766ed3-4d87-44d9-9b19-c74817328a61 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:12.498840 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:12.540277 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c766ed3-4d87-44d9-9b19-c74817328a61 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:12.575279 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460247b-837d-4a65-ba34-8b75d992fb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:12.576187 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460247b-837d-4a65-ba34-8b75d992fb34 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:12.576470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460247b-837d-4a65-ba34-8b75d992fb34 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:12.577411 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460247b-837d-4a65-ba34-8b75d992fb34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:12.588288 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460247b-837d-4a65-ba34-8b75d992fb34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:12.597304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460247b-837d-4a65-ba34-8b75d992fb34 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:12.604152 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-e460247b-837d-4a65-ba34-8b75d992fb34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:53:12.604152 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:53:12.604152 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:53:12.604152 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:53:12.604152 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:53:12.604152 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:53:12.604152 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:53:12.604152 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:53:12.604152 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:53:12.604152 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:53:12.604152 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:53:12.604152 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:53:12.604152 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:53:12.604152 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:53:12.604152 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:53:12.605236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:53:12.605236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:53:12.605236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:53:12.605236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:53:12.605236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:53:12.605236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:53:12.605236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:53:12.605236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:53:12.605236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:53:12.605236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:53:12.605236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:53:12.605236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:53:12.605236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:53:12.605236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:53:12.605236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:53:12.605236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:53:12.605236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:53:12.606514 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:53:12.606514 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:53:12.606514 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:53:12.606514 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:53:12.606514 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 662/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 08:53:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:53:12.611391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b52acd-a3fa-4f24-8975-85232f8e9091 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:12.713812 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b52acd-a3fa-4f24-8975-85232f8e9091 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:12.749377 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d82d98-bc6e-438f-874e-b79a0ca94ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:12.750816 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d82d98-bc6e-438f-874e-b79a0ca94ced None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:12.751077 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d82d98-bc6e-438f-874e-b79a0ca94ced None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:12.751352 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d82d98-bc6e-438f-874e-b79a0ca94ced None admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:12.752044 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d82d98-bc6e-438f-874e-b79a0ca94ced None admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:12.752388 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d82d98-bc6e-438f-874e-b79a0ca94ced None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:12.753766 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d82d98-bc6e-438f-874e-b79a0ca94ced None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:12.765132 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 622/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Aug 2 08:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:53:12.771773 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460247b-837d-4a65-ba34-8b75d992fb34 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:12.885717 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460247b-837d-4a65-ba34-8b75d992fb34 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:12.900424 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:12.921600 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b53a9-4be3-48f3-b71a-596134093ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:12.926146 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b53a9-4be3-48f3-b71a-596134093ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:12.926146 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b53a9-4be3-48f3-b71a-596134093ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:12.926146 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b53a9-4be3-48f3-b71a-596134093ff5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:12.929411 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b53a9-4be3-48f3-b71a-596134093ff5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:12.930868 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b53a9-4be3-48f3-b71a-596134093ff5 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:12.942408 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application [None req-9f1b53a9-4be3-48f3-b71a-596134093ff5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:53:12.942408 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:53:12.942408 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:53:12.942408 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:53:12.942408 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:53:12.942408 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:53:12.942408 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:53:12.942408 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:53:12.942408 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:53:12.942408 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:53:12.942408 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:53:12.942408 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:53:12.942408 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:53:12.942408 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:53:12.942408 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:53:12.943474 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:53:12.943474 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:53:12.943474 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:53:12.943474 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:53:12.943474 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:53:12.943474 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:53:12.943474 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:53:12.943474 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:53:12.943474 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application with Lock( Aug 02 08:53:12.943474 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:53:12.943474 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:53:12.943474 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:53:12.943474 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:53:12.943474 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:53:12.943474 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:53:12.943474 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:53:12.943474 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:53:12.944686 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:53:12.944686 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:53:12.944686 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:53:12.944686 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:53:12.944686 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:53:12.944686 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:53:12.944686 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:53:12.944686 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: ERROR keystone.server.flask.application Aug 02 08:53:12.944686 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 663/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Aug 2 08:53:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:53:12.950057 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d82d98-bc6e-438f-874e-b79a0ca94ced None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:13.002096 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:13.052668 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d82d98-bc6e-438f-874e-b79a0ca94ced None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:13.085312 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44dc2b-9997-4854-94da-50575a8c0cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:13.085930 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44dc2b-9997-4854-94da-50575a8c0cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:13.086208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44dc2b-9997-4854-94da-50575a8c0cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:13.086480 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44dc2b-9997-4854-94da-50575a8c0cc5 None admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:13.087221 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44dc2b-9997-4854-94da-50575a8c0cc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:13.087525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44dc2b-9997-4854-94da-50575a8c0cc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:13.088982 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44dc2b-9997-4854-94da-50575a8c0cc5 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:13.101397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 623/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Aug 2 08:53:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:53:13.107807 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b53a9-4be3-48f3-b71a-596134093ff5 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:13.211711 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b53a9-4be3-48f3-b71a-596134093ff5 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:13.245425 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed99899-8dd6-4661-8917-a9a04981dccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:13.246065 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed99899-8dd6-4661-8917-a9a04981dccb None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:13.246328 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed99899-8dd6-4661-8917-a9a04981dccb None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:13.246662 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed99899-8dd6-4661-8917-a9a04981dccb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:13.247400 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed99899-8dd6-4661-8917-a9a04981dccb None admin] RBAC: Adding query filter params (role.id=b5477d3c4e5a4514b64211ec2452d1d8, scope.project.id=6910e69702854607889bab124edd60c9, user.id=aa8cac76aa21415d8ab0a2524a7049d8) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:13.247744 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed99899-8dd6-4661-8917-a9a04981dccb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:13.249166 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed99899-8dd6-4661-8917-a9a04981dccb None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:13.255677 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 664/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Aug 2 08:53:13 2022] GET /identity/v3/role_assignments?user.id=aa8cac76aa21415d8ab0a2524a7049d8&scope.project.id=6910e69702854607889bab124edd60c9&role.id=b5477d3c4e5a4514b64211ec2452d1d8 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:53:15.298662 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af36b24-9111-4f5b-abed-887620250bd4 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:15.299181 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af36b24-9111-4f5b-abed-887620250bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:15.299271 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af36b24-9111-4f5b-abed-887620250bd4 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:15.300755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 624/1288] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:53:15.306250 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0298a0-93c8-43e5-8d90-78d46a7c7c34 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:15.306757 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0298a0-93c8-43e5-8d90-78d46a7c7c34 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:15.306871 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0298a0-93c8-43e5-8d90-78d46a7c7c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:15.325443 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-5b0298a0-93c8-43e5-8d90-78d46a7c7c34 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:15.326633 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-5b0298a0-93c8-43e5-8d90-78d46a7c7c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:15.357547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:15.396061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 665/1289] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:53:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:53:15.419156 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af36b24-9111-4f5b-abed-887620250bd4 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:15.526394 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af36b24-9111-4f5b-abed-887620250bd4 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:15.537560 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:15.560443 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742ae52-cade-4030-a46e-4c520e9fdbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:15.561172 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742ae52-cade-4030-a46e-4c520e9fdbb1 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:15.561456 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742ae52-cade-4030-a46e-4c520e9fdbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:15.561729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742ae52-cade-4030-a46e-4c520e9fdbb1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:15.563038 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742ae52-cade-4030-a46e-4c520e9fdbb1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:15.564446 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742ae52-cade-4030-a46e-4c520e9fdbb1 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:15.573769 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-d742ae52-cade-4030-a46e-4c520e9fdbb1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 08:53:15.573769 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:53:15.573769 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:53:15.573769 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:53:15.573769 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:53:15.573769 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:53:15.573769 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:53:15.573769 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:53:15.573769 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 08:53:15.573769 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:53:15.573769 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:53:15.573769 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:53:15.573769 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:53:15.573769 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:53:15.573769 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:53:15.573769 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:53:15.573769 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:53:15.575025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:53:15.575025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:53:15.575025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:53:15.575025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:53:15.575025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:53:15.575025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:53:15.575025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:53:15.575025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:53:15.575025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:53:15.575025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:53:15.575025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:53:15.575025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:53:15.575025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:53:15.575025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:53:15.575025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:53:15.575025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:53:15.576204 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:53:15.576204 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:53:15.576204 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:53:15.576204 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:53:15.576204 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:53:15.576204 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:53:15.576204 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:53:15.576204 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:53:15.576204 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:53:15.576204 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:53:15.576204 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:53:15.576204 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:53:15.576204 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 08:53:15.576204 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:53:15.576204 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 625/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Aug 2 08:53:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:53:15.581848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0298a0-93c8-43e5-8d90-78d46a7c7c34 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:15.680566 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0298a0-93c8-43e5-8d90-78d46a7c7c34 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:15.724005 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c9101-3d2f-44df-8cd7-f59d75113956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:15.724659 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c9101-3d2f-44df-8cd7-f59d75113956 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:15.724944 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c9101-3d2f-44df-8cd7-f59d75113956 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:15.725220 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c9101-3d2f-44df-8cd7-f59d75113956 None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:15.725901 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c9101-3d2f-44df-8cd7-f59d75113956 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:15.726203 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c9101-3d2f-44df-8cd7-f59d75113956 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:15.727671 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c9101-3d2f-44df-8cd7-f59d75113956 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:15.732587 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 666/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Tue Aug 2 08:53:15 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:53:15.739236 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742ae52-cade-4030-a46e-4c520e9fdbb1 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:15.844993 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742ae52-cade-4030-a46e-4c520e9fdbb1 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:15.879477 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212aed9c-6105-4fce-8869-0f9471971974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:15.880095 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212aed9c-6105-4fce-8869-0f9471971974 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:15.880404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212aed9c-6105-4fce-8869-0f9471971974 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:15.880717 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212aed9c-6105-4fce-8869-0f9471971974 None admin] PATH_INFO: `/v3/services` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:15.881422 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212aed9c-6105-4fce-8869-0f9471971974 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:15.881706 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212aed9c-6105-4fce-8869-0f9471971974 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:15.883082 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212aed9c-6105-4fce-8869-0f9471971974 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:15.887693 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 626/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Tue Aug 2 08:53:15 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:53:18.025804 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bce9a-476e-4888-abb7-06422315d189 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:18.026403 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bce9a-476e-4888-abb7-06422315d189 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:18.026403 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bce9a-476e-4888-abb7-06422315d189 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:18.027954 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 667/1293] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:53:18.034025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62d5d1-02cf-40c9-b48a-67c5e275094e None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:18.034560 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62d5d1-02cf-40c9-b48a-67c5e275094e None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:18.034560 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62d5d1-02cf-40c9-b48a-67c5e275094e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:18.056865 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-8c62d5d1-02cf-40c9-b48a-67c5e275094e None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:18.059041 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-8c62d5d1-02cf-40c9-b48a-67c5e275094e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:18.095144 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:18.144649 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 627/1294] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:53:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:53:18.175780 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bce9a-476e-4888-abb7-06422315d189 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:18.214293 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:18.314553 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bce9a-476e-4888-abb7-06422315d189 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:18.356039 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a832939-bfc7-4e5e-91f7-58726a37626c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:18.356817 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a832939-bfc7-4e5e-91f7-58726a37626c None admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:18.357106 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a832939-bfc7-4e5e-91f7-58726a37626c None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:18.357386 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a832939-bfc7-4e5e-91f7-58726a37626c None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:18.358092 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a832939-bfc7-4e5e-91f7-58726a37626c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:18.360346 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a832939-bfc7-4e5e-91f7-58726a37626c None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:18.558404 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 668/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Aug 2 08:53:18 2022] POST /identity/v3/services => generated 246 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:53:20.621440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d1cdf-83dc-46f4-bc7c-36c16b4bb3d3 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:20.621966 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d1cdf-83dc-46f4-bc7c-36c16b4bb3d3 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:20.621966 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d1cdf-83dc-46f4-bc7c-36c16b4bb3d3 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:20.623346 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 628/1296] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:53:20.629310 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514fefa-418f-4d7e-b42f-eb56b42ba8f9 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:20.629774 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514fefa-418f-4d7e-b42f-eb56b42ba8f9 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:20.629884 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514fefa-418f-4d7e-b42f-eb56b42ba8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:20.648522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-f514fefa-418f-4d7e-b42f-eb56b42ba8f9 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:20.649713 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-f514fefa-418f-4d7e-b42f-eb56b42ba8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:20.723356 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 669/1297] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:53:20 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:53:20.747481 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d1cdf-83dc-46f4-bc7c-36c16b4bb3d3 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:20.860620 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d1cdf-83dc-46f4-bc7c-36c16b4bb3d3 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:20.898205 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8421f-4f4e-4018-8a3b-02a0ed02f93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:20.899597 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8421f-4f4e-4018-8a3b-02a0ed02f93a None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:20.899597 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8421f-4f4e-4018-8a3b-02a0ed02f93a None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:20.899597 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8421f-4f4e-4018-8a3b-02a0ed02f93a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:20.900000 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f8421f-4f4e-4018-8a3b-02a0ed02f93a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:20.901411 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f8421f-4f4e-4018-8a3b-02a0ed02f93a None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:20.910862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-03f8421f-4f4e-4018-8a3b-02a0ed02f93a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 08:53:20.910862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:53:20.910862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:53:20.910862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:53:20.910862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:53:20.910862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:53:20.910862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:53:20.910862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:53:20.910862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 08:53:20.910862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:53:20.910862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:53:20.910862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:53:20.910862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:53:20.910862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:53:20.910862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:53:20.910862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:53:20.910862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:53:20.912323 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:53:20.912323 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:53:20.912323 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:53:20.912323 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:53:20.912323 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:53:20.912323 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:53:20.912323 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:53:20.912323 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:53:20.912323 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:53:20.912323 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:53:20.912323 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:53:20.912323 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:53:20.912323 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:53:20.912323 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:53:20.912323 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:53:20.912323 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:53:20.913301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:53:20.913301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:53:20.913301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:53:20.913301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:53:20.913301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:53:20.913301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:53:20.913301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:53:20.913301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:53:20.913301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:53:20.913301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:53:20.913301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:53:20.913301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:53:20.913301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 08:53:20.913301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:53:20.913301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 629/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Aug 2 08:53:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:53:20.918942 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514fefa-418f-4d7e-b42f-eb56b42ba8f9 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:20.938812 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:21.020516 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514fefa-418f-4d7e-b42f-eb56b42ba8f9 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:21.054276 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446320f-2373-451c-8ae4-ee0e05cbffb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:21.054894 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446320f-2373-451c-8ae4-ee0e05cbffb1 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:21.055171 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446320f-2373-451c-8ae4-ee0e05cbffb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:21.055441 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446320f-2373-451c-8ae4-ee0e05cbffb1 None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:21.056113 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446320f-2373-451c-8ae4-ee0e05cbffb1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:21.056441 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446320f-2373-451c-8ae4-ee0e05cbffb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:21.057807 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446320f-2373-451c-8ae4-ee0e05cbffb1 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:21.064044 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 670/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Tue Aug 2 08:53:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:53:21.070222 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8421f-4f4e-4018-8a3b-02a0ed02f93a None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:21.101805 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:21.173930 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8421f-4f4e-4018-8a3b-02a0ed02f93a None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:21.212757 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06bce8-b4fb-4bba-9661-3dcc06762511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:21.212757 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06bce8-b4fb-4bba-9661-3dcc06762511 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:21.213126 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06bce8-b4fb-4bba-9661-3dcc06762511 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:21.213126 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06bce8-b4fb-4bba-9661-3dcc06762511 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:21.213897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06bce8-b4fb-4bba-9661-3dcc06762511 None admin] RBAC: Adding query filter params (interface=public, service_id=d329b65299d24f72b2431e8f37e23182, region_id=RegionOne) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:21.214208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06bce8-b4fb-4bba-9661-3dcc06762511 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:21.215626 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06bce8-b4fb-4bba-9661-3dcc06762511 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:21.221670 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 630/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Aug 2 08:53:21 2022] GET /identity/v3/endpoints?service_id=d329b65299d24f72b2431e8f37e23182&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:53:21.228194 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446320f-2373-451c-8ae4-ee0e05cbffb1 None admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:21.316529 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:21.334314 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446320f-2373-451c-8ae4-ee0e05cbffb1 None admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:21.369966 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a780b7-4e7a-4ab0-b2bd-dbefa45ea7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:21.370606 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a780b7-4e7a-4ab0-b2bd-dbefa45ea7e2 None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:21.371150 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a780b7-4e7a-4ab0-b2bd-dbefa45ea7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:21.371637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a780b7-4e7a-4ab0-b2bd-dbefa45ea7e2 None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:21.372398 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a780b7-4e7a-4ab0-b2bd-dbefa45ea7e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:21.374149 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a780b7-4e7a-4ab0-b2bd-dbefa45ea7e2 None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:21.381211 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 671/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Aug 2 08:53:21 2022] GET /identity/v3/services => generated 2191 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:53:23.429359 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8f221-6a24-4de0-ae9d-58cb3b0a6ed8 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:23.429895 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8f221-6a24-4de0-ae9d-58cb3b0a6ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:23.429895 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8f221-6a24-4de0-ae9d-58cb3b0a6ed8 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:23.431215 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 631/1302] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 08:53:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:53:23.437949 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca337d-fd4b-4307-aaf4-9bc3d82c39c4 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:23.438483 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca337d-fd4b-4307-aaf4-9bc3d82c39c4 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:23.438571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca337d-fd4b-4307-aaf4-9bc3d82c39c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:23.457723 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-90ca337d-fd4b-4307-aaf4-9bc3d82c39c4 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:53:23.458921 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-90ca337d-fd4b-4307-aaf4-9bc3d82c39c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:53:23.530503 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 672/1303] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 08:53:23 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:53:23.553831 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8f221-6a24-4de0-ae9d-58cb3b0a6ed8 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:23.653553 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:23.660880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8f221-6a24-4de0-ae9d-58cb3b0a6ed8 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:23.695981 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27c21a-92fe-47c7-b46b-23dd87601af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:23.696652 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27c21a-92fe-47c7-b46b-23dd87601af2 None admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:23.696938 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27c21a-92fe-47c7-b46b-23dd87601af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:23.697218 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27c21a-92fe-47c7-b46b-23dd87601af2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:23.697850 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27c21a-92fe-47c7-b46b-23dd87601af2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:23.699247 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27c21a-92fe-47c7-b46b-23dd87601af2 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:23.708857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application [None req-dc27c21a-92fe-47c7-b46b-23dd87601af2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 08:53:23.708857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:53:23.708857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:53:23.708857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:53:23.708857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:53:23.708857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:53:23.708857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:53:23.708857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:53:23.708857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 08:53:23.708857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:53:23.708857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:53:23.708857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:53:23.708857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:53:23.708857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:53:23.708857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:53:23.708857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:53:23.708857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:53:23.710129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:53:23.710129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:53:23.710129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:53:23.710129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:53:23.710129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:53:23.710129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:53:23.710129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:53:23.710129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:53:23.710129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:53:23.710129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:53:23.710129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:53:23.710129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:53:23.710129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:53:23.710129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:53:23.710129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:53:23.710129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:53:23.710995 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:53:23.710995 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application with Lock( Aug 02 08:53:23.710995 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:53:23.710995 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:53:23.710995 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:53:23.710995 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:53:23.710995 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:53:23.710995 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:53:23.710995 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:53:23.710995 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:53:23.710995 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:53:23.710995 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:53:23.710995 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 08:53:23.710995 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: ERROR keystone.server.flask.application Aug 02 08:53:23.710995 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 632/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Aug 2 08:53:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:53:23.716258 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca337d-fd4b-4307-aaf4-9bc3d82c39c4 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:23.793701 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:23.821121 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca337d-fd4b-4307-aaf4-9bc3d82c39c4 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:23.858024 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cae2dd-7583-4f0f-ac19-ad581ad3be4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:23.858659 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cae2dd-7583-4f0f-ac19-ad581ad3be4e None admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:23.859016 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cae2dd-7583-4f0f-ac19-ad581ad3be4e None admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:23.859287 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cae2dd-7583-4f0f-ac19-ad581ad3be4e None admin] PATH_INFO: `/v3/services` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:23.859996 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cae2dd-7583-4f0f-ac19-ad581ad3be4e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:53:23.860313 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cae2dd-7583-4f0f-ac19-ad581ad3be4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:23.861686 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cae2dd-7583-4f0f-ac19-ad581ad3be4e None admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:23.866894 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 673/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Tue Aug 2 08:53:23 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:53:23.873150 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27c21a-92fe-47c7-b46b-23dd87601af2 None admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:53:23.979558 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27c21a-92fe-47c7-b46b-23dd87601af2 None admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:53:24.016686 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffea65b-74de-4669-ae10-11758c3a7120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:53:24.017310 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffea65b-74de-4669-ae10-11758c3a7120 None admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:53:24.017588 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffea65b-74de-4669-ae10-11758c3a7120 None admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:53:24.017862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffea65b-74de-4669-ae10-11758c3a7120 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:53:24.018569 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffea65b-74de-4669-ae10-11758c3a7120 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:53:24.019944 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffea65b-74de-4669-ae10-11758c3a7120 None admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:53:24.140640 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 633/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 08:53:23 2022] POST /identity/v3/endpoints => generated 331 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:53:33.983245 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=30 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:34.135484 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:17.391465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb6985-f961-4741-b23c-440517d2f590 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:17.392578 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb6985-f961-4741-b23c-440517d2f590 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:17.393071 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb6985-f961-4741-b23c-440517d2f590 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:17.401516 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069c06c-b346-4165-99c3-954310feb6fa None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:17.402782 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069c06c-b346-4165-99c3-954310feb6fa None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:17.403279 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069c06c-b346-4165-99c3-954310feb6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:17.409432 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 674/1307] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 09:01:17 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:01:17.514746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-e069c06c-b346-4165-99c3-954310feb6fa None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:01:17.516857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-e069c06c-b346-4165-99c3-954310feb6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:17.770970 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 634/1308] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 09:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:01:17.838752 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb96323-14e0-497e-8e1b-91215287cc5a None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:17.839635 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb96323-14e0-497e-8e1b-91215287cc5a None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:17.840109 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb96323-14e0-497e-8e1b-91215287cc5a None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:17.841891 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 675/1309] 10.222.0.20 () {54 vars in 965 bytes} [Tue Aug 2 09:01:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:01:17.850545 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da10b47-db6b-4af1-a2e2-53c2e454d54d None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:17.851264 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da10b47-db6b-4af1-a2e2-53c2e454d54d None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:17.851766 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da10b47-db6b-4af1-a2e2-53c2e454d54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:17.957811 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-6da10b47-db6b-4af1-a2e2-53c2e454d54d None None] MFA Rules not processed for user `6128f07ffd5f4357968b0e2e300f2e09`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:01:17.961044 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-6da10b47-db6b-4af1-a2e2-53c2e454d54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:18.001257 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:18.203843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 635/1310] 10.222.0.20 () {58 vars in 1062 bytes} [Tue Aug 2 09:01:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:01:18.214842 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb96323-14e0-497e-8e1b-91215287cc5a None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:18.216713 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-ddb96323-14e0-497e-8e1b-91215287cc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:18.357876 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb96323-14e0-497e-8e1b-91215287cc5a None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:18.488284 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0a4ed-c73a-4439-8713-6bd6fcdba0f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:18.488284 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0a4ed-c73a-4439-8713-6bd6fcdba0f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:18.488284 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0a4ed-c73a-4439-8713-6bd6fcdba0f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:18.488284 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0a4ed-c73a-4439-8713-6bd6fcdba0f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:18.489230 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-a1a0a4ed-c73a-4439-8713-6bd6fcdba0f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:18.533036 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:18.604237 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a0a4ed-c73a-4439-8713-6bd6fcdba0f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:18.666195 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a0a4ed-c73a-4439-8713-6bd6fcdba0f3 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:18.666195 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 676/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:01:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:01:21.434928 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16ae04-7750-4f4a-b17e-8937693b447d None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:21.435620 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16ae04-7750-4f4a-b17e-8937693b447d None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:21.435620 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16ae04-7750-4f4a-b17e-8937693b447d None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:21.437259 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 636/1312] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 09:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:01:21.444434 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8e919-93b8-47cb-86fc-6147e922c3fa None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:21.445240 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8e919-93b8-47cb-86fc-6147e922c3fa None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:21.445240 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8e919-93b8-47cb-86fc-6147e922c3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:21.542259 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-c0c8e919-93b8-47cb-86fc-6147e922c3fa None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:01:21.543523 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-c0c8e919-93b8-47cb-86fc-6147e922c3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:21.645297 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 677/1313] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 09:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:01:21.685535 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16ae04-7750-4f4a-b17e-8937693b447d None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:21.687091 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-9a16ae04-7750-4f4a-b17e-8937693b447d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:21.803230 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16ae04-7750-4f4a-b17e-8937693b447d None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:21.884715 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:21.887480 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd5bf8-d900-4051-9967-838d060f2445 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:21.888109 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd5bf8-d900-4051-9967-838d060f2445 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:21.888426 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd5bf8-d900-4051-9967-838d060f2445 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:21.888697 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd5bf8-d900-4051-9967-838d060f2445 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:21.890366 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-bfcd5bf8-d900-4051-9967-838d060f2445 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:22.007819 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd5bf8-d900-4051-9967-838d060f2445 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:22.009318 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd5bf8-d900-4051-9967-838d060f2445 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:22.029429 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 637/1314] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:01:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:01:24.668655 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f7044-d5a8-4b64-b2b4-6f0f49a89162 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:24.669236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f7044-d5a8-4b64-b2b4-6f0f49a89162 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:24.669350 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f7044-d5a8-4b64-b2b4-6f0f49a89162 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:24.670928 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 678/1315] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 09:01:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:01:24.677441 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95a00c-abc6-4de5-b054-7d8b8778787f None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:24.677996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95a00c-abc6-4de5-b054-7d8b8778787f None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:24.678138 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95a00c-abc6-4de5-b054-7d8b8778787f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:24.771240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-1a95a00c-abc6-4de5-b054-7d8b8778787f None None] MFA Rules not processed for user `e7f2a812f0a7455abe8064344eabe693`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:01:24.772797 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-1a95a00c-abc6-4de5-b054-7d8b8778787f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:24.833302 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:24.911316 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 638/1316] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 09:01:24 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:01:24.958039 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f7044-d5a8-4b64-b2b4-6f0f49a89162 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:24.959723 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-2b8f7044-d5a8-4b64-b2b4-6f0f49a89162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:24.970246 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:25.076073 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f7044-d5a8-4b64-b2b4-6f0f49a89162 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:25.155520 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f1bc3-503e-40ad-b2a3-35ea3e131beb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:25.156045 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f1bc3-503e-40ad-b2a3-35ea3e131beb service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:25.156356 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f1bc3-503e-40ad-b2a3-35ea3e131beb service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:25.156624 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f1bc3-503e-40ad-b2a3-35ea3e131beb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:25.158302 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-6d3f1bc3-503e-40ad-b2a3-35ea3e131beb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:25.239899 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:25.289753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f1bc3-503e-40ad-b2a3-35ea3e131beb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:25.291209 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f1bc3-503e-40ad-b2a3-35ea3e131beb service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:25.311352 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 679/1317] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:01:24 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:01:28.722187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb57ae-ea42-4a78-830d-93cd3751a18e None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:28.723564 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb57ae-ea42-4a78-830d-93cd3751a18e None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:28.723564 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb57ae-ea42-4a78-830d-93cd3751a18e None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:28.725420 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 639/1318] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 09:01:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:01:28.731875 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66541625-e931-4c67-89d0-155b07348c05 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:28.732434 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66541625-e931-4c67-89d0-155b07348c05 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:28.732555 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66541625-e931-4c67-89d0-155b07348c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:28.808732 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-66541625-e931-4c67-89d0-155b07348c05 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:01:28.810706 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-66541625-e931-4c67-89d0-155b07348c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:28.923678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 680/1319] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 09:01:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:01:28.964497 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb57ae-ea42-4a78-830d-93cd3751a18e None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:28.966704 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-0afb57ae-ea42-4a78-830d-93cd3751a18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:29.082207 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb57ae-ea42-4a78-830d-93cd3751a18e None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:29.165918 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaeaf5c-9631-4d36-bede-f796db1e44a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:29.166547 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaeaf5c-9631-4d36-bede-f796db1e44a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:29.166830 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaeaf5c-9631-4d36-bede-f796db1e44a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:29.167104 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaeaf5c-9631-4d36-bede-f796db1e44a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:29.168842 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-beaeaf5c-9631-4d36-bede-f796db1e44a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:29.177467 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:29.310788 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaeaf5c-9631-4d36-bede-f796db1e44a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:29.312375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaeaf5c-9631-4d36-bede-f796db1e44a4 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:29.333451 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 640/1320] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:01:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:01:32.652774 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59a988-a9eb-40e9-9c74-02c0e10c2625 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:32.653575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59a988-a9eb-40e9-9c74-02c0e10c2625 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:32.654092 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59a988-a9eb-40e9-9c74-02c0e10c2625 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:32.656488 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 681/1321] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 09:01:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:01:32.665395 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9ab31-0685-4e35-9b98-ae3a403eaca1 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:32.666206 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9ab31-0685-4e35-9b98-ae3a403eaca1 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:32.666466 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9ab31-0685-4e35-9b98-ae3a403eaca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:32.765288 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-3ac9ab31-0685-4e35-9b98-ae3a403eaca1 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:01:32.766723 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-3ac9ab31-0685-4e35-9b98-ae3a403eaca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:32.839048 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:32.890417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 641/1322] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 09:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:01:32.934265 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59a988-a9eb-40e9-9c74-02c0e10c2625 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:32.936768 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-5c59a988-a9eb-40e9-9c74-02c0e10c2625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:32.962832 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:33.085010 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59a988-a9eb-40e9-9c74-02c0e10c2625 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:33.201676 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef99a3-0aeb-42db-80ab-86c2331689f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:33.202656 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef99a3-0aeb-42db-80ab-86c2331689f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:33.203143 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef99a3-0aeb-42db-80ab-86c2331689f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:33.203618 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef99a3-0aeb-42db-80ab-86c2331689f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:33.206833 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-1fef99a3-0aeb-42db-80ab-86c2331689f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:33.317692 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:33.365250 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef99a3-0aeb-42db-80ab-86c2331689f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:33.368141 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef99a3-0aeb-42db-80ab-86c2331689f8 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:33.391106 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 682/1323] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:01:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:01:35.989951 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af012bdb-3f17-4bfe-ac68-316f157bdbaa None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:35.990664 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af012bdb-3f17-4bfe-ac68-316f157bdbaa None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:35.990790 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af012bdb-3f17-4bfe-ac68-316f157bdbaa None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:35.992252 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 642/1324] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 09:01:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:01:35.998274 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba6af5-119b-47f6-b30f-17f53084fd7c None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:35.999086 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba6af5-119b-47f6-b30f-17f53084fd7c None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:35.999274 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba6af5-119b-47f6-b30f-17f53084fd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:36.092831 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-c5ba6af5-119b-47f6-b30f-17f53084fd7c None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:01:36.094080 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-c5ba6af5-119b-47f6-b30f-17f53084fd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:36.222401 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 683/1325] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 09:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:01:36.276487 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85559a6c-1bd5-404b-80aa-7cb8d14ef810 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:36.276966 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85559a6c-1bd5-404b-80aa-7cb8d14ef810 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:36.277449 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85559a6c-1bd5-404b-80aa-7cb8d14ef810 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:36.280582 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 643/1326] 10.222.0.20 () {54 vars in 965 bytes} [Tue Aug 2 09:01:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:01:36.288644 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55af4c6-76c8-4ec8-aa7b-47d84a1e72a9 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:36.289046 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55af4c6-76c8-4ec8-aa7b-47d84a1e72a9 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:36.289458 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55af4c6-76c8-4ec8-aa7b-47d84a1e72a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:36.329754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:36.424551 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-d55af4c6-76c8-4ec8-aa7b-47d84a1e72a9 None None] MFA Rules not processed for user `6128f07ffd5f4357968b0e2e300f2e09`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:01:36.426818 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-d55af4c6-76c8-4ec8-aa7b-47d84a1e72a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:36.570128 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 684/1327] 10.222.0.20 () {58 vars in 1062 bytes} [Tue Aug 2 09:01:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:01:36.580660 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85559a6c-1bd5-404b-80aa-7cb8d14ef810 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:36.582344 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-85559a6c-1bd5-404b-80aa-7cb8d14ef810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:36.734007 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85559a6c-1bd5-404b-80aa-7cb8d14ef810 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:36.827005 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2b7eb-75fb-451a-b616-2ece4b79c13d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:36.827650 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2b7eb-75fb-451a-b616-2ece4b79c13d service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:36.828034 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2b7eb-75fb-451a-b616-2ece4b79c13d service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:36.828342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2b7eb-75fb-451a-b616-2ece4b79c13d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:36.830240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-bbf2b7eb-75fb-451a-b616-2ece4b79c13d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:36.854385 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:36.980073 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf2b7eb-75fb-451a-b616-2ece4b79c13d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:36.981706 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf2b7eb-75fb-451a-b616-2ece4b79c13d service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:37.012531 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 644/1328] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:01:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:01:39.508123 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5411a7-cd6c-41ed-b1a9-3d05373efaab None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:39.508964 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5411a7-cd6c-41ed-b1a9-3d05373efaab None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:39.508964 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5411a7-cd6c-41ed-b1a9-3d05373efaab None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:39.510118 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 685/1329] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 09:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:01:39.516091 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45e19d-e7df-452d-b385-198434176f13 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:39.516924 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45e19d-e7df-452d-b385-198434176f13 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:39.516924 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45e19d-e7df-452d-b385-198434176f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:39.607956 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-7d45e19d-e7df-452d-b385-198434176f13 None None] MFA Rules not processed for user `e7f2a812f0a7455abe8064344eabe693`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:01:39.609115 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-7d45e19d-e7df-452d-b385-198434176f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:39.697950 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:39.746015 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 645/1330] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 09:01:39 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:01:39.787315 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5411a7-cd6c-41ed-b1a9-3d05373efaab None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:39.788989 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-9c5411a7-cd6c-41ed-b1a9-3d05373efaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:39.952634 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5411a7-cd6c-41ed-b1a9-3d05373efaab None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:39.986136 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:40.050245 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0f884-e4ce-4b0f-b325-fa575a92e736 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:40.051842 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0f884-e4ce-4b0f-b325-fa575a92e736 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:40.052145 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0f884-e4ce-4b0f-b325-fa575a92e736 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:40.052475 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0f884-e4ce-4b0f-b325-fa575a92e736 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:40.058134 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-e1c0f884-e4ce-4b0f-b325-fa575a92e736 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:40.190348 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0f884-e4ce-4b0f-b325-fa575a92e736 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:40.192649 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0f884-e4ce-4b0f-b325-fa575a92e736 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:40.214021 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 686/1331] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:01:39 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:01:42.923001 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf4c55-c1ae-4783-b797-8e47c29cde91 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:42.923757 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf4c55-c1ae-4783-b797-8e47c29cde91 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:42.923757 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf4c55-c1ae-4783-b797-8e47c29cde91 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:42.925068 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 646/1332] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 09:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:01:42.931684 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d027a3-b933-4227-a241-f740aa43d465 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:42.932551 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d027a3-b933-4227-a241-f740aa43d465 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:42.932714 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d027a3-b933-4227-a241-f740aa43d465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:43.007718 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:43.010655 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-b2d027a3-b933-4227-a241-f740aa43d465 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:01:43.011950 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-b2d027a3-b933-4227-a241-f740aa43d465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:43.117505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 687/1333] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 09:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:01:43.154227 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf4c55-c1ae-4783-b797-8e47c29cde91 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:43.155769 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-bebf4c55-c1ae-4783-b797-8e47c29cde91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:43.276322 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf4c55-c1ae-4783-b797-8e47c29cde91 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:43.354823 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb9e74-3683-43f3-a7f7-550f8ed00bdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:43.355452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb9e74-3683-43f3-a7f7-550f8ed00bdc service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:43.355738 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb9e74-3683-43f3-a7f7-550f8ed00bdc service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:43.356014 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb9e74-3683-43f3-a7f7-550f8ed00bdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:43.357889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-71cb9e74-3683-43f3-a7f7-550f8ed00bdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:43.392158 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:43.480756 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb9e74-3683-43f3-a7f7-550f8ed00bdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:43.482218 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb9e74-3683-43f3-a7f7-550f8ed00bdc service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:43.504292 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 647/1334] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:01:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:01:45.680531 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3d4bf-af75-4b05-8cf7-eabaffbf6723 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:45.681072 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3d4bf-af75-4b05-8cf7-eabaffbf6723 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:45.681168 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3d4bf-af75-4b05-8cf7-eabaffbf6723 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:45.682597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 688/1335] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 09:01:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:01:45.688119 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02580ff8-a528-43e3-94c1-64910e5fba6d None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:45.688836 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02580ff8-a528-43e3-94c1-64910e5fba6d None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:45.688836 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02580ff8-a528-43e3-94c1-64910e5fba6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:45.761121 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-02580ff8-a528-43e3-94c1-64910e5fba6d None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:01:45.762338 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-02580ff8-a528-43e3-94c1-64910e5fba6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:45.844388 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:45.869187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 648/1336] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 09:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:01:45.913070 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3d4bf-af75-4b05-8cf7-eabaffbf6723 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:45.914567 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-8cf3d4bf-af75-4b05-8cf7-eabaffbf6723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:46.039477 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3d4bf-af75-4b05-8cf7-eabaffbf6723 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:46.078318 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:46.143719 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e759e-1647-45e3-abe1-cc5d68cb03bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:46.144788 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e759e-1647-45e3-abe1-cc5d68cb03bc service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:46.145069 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e759e-1647-45e3-abe1-cc5d68cb03bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:46.145343 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e759e-1647-45e3-abe1-cc5d68cb03bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:46.147074 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-a01e759e-1647-45e3-abe1-cc5d68cb03bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:46.288602 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e759e-1647-45e3-abe1-cc5d68cb03bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:46.290291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e759e-1647-45e3-abe1-cc5d68cb03bc service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:46.312021 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 689/1337] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:01:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:01:49.663251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09958be-e5a3-418d-b405-4bcd03312d6d None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:49.663983 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09958be-e5a3-418d-b405-4bcd03312d6d None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:49.663983 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09958be-e5a3-418d-b405-4bcd03312d6d None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:49.665255 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 649/1338] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 09:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:01:49.673358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c6ea1-6aeb-4be6-b634-6ba878fa8e90 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:49.673948 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c6ea1-6aeb-4be6-b634-6ba878fa8e90 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:49.673948 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c6ea1-6aeb-4be6-b634-6ba878fa8e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:49.792370 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-cc1c6ea1-6aeb-4be6-b634-6ba878fa8e90 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:01:49.794421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-cc1c6ea1-6aeb-4be6-b634-6ba878fa8e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:49.812128 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:49.938835 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 690/1339] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 09:01:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:01:49.978132 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09958be-e5a3-418d-b405-4bcd03312d6d None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:49.979701 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-f09958be-e5a3-418d-b405-4bcd03312d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:50.098238 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09958be-e5a3-418d-b405-4bcd03312d6d None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:50.202694 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f73021-ff9d-460a-a1e6-e40d5250f498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:50.203575 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f73021-ff9d-460a-a1e6-e40d5250f498 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:50.204072 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f73021-ff9d-460a-a1e6-e40d5250f498 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:50.204606 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f73021-ff9d-460a-a1e6-e40d5250f498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:50.208014 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-45f73021-ff9d-460a-a1e6-e40d5250f498 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:50.256551 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:50.340151 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f73021-ff9d-460a-a1e6-e40d5250f498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:50.341641 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f73021-ff9d-460a-a1e6-e40d5250f498 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:50.363416 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 650/1340] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:01:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:01:55.162219 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593b0ce-76e4-443c-8ed8-5cbface6e9a2 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:55.162926 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593b0ce-76e4-443c-8ed8-5cbface6e9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:55.163071 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593b0ce-76e4-443c-8ed8-5cbface6e9a2 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:55.165954 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 691/1341] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 09:01:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:01:55.172721 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc514681-1aa7-4d8d-b8ac-a70ca155ce28 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:55.173590 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc514681-1aa7-4d8d-b8ac-a70ca155ce28 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:55.173771 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc514681-1aa7-4d8d-b8ac-a70ca155ce28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:55.266985 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-bc514681-1aa7-4d8d-b8ac-a70ca155ce28 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:01:55.268252 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-bc514681-1aa7-4d8d-b8ac-a70ca155ce28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:55.389897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:55.405531 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 651/1342] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 09:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:01:55.461873 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593b0ce-76e4-443c-8ed8-5cbface6e9a2 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:55.463949 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-a593b0ce-76e4-443c-8ed8-5cbface6e9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:55.623522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593b0ce-76e4-443c-8ed8-5cbface6e9a2 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:55.679660 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:55.742896 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1be5f5-5411-493c-a66b-707e7042b5a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:55.743950 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1be5f5-5411-493c-a66b-707e7042b5a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:55.744798 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1be5f5-5411-493c-a66b-707e7042b5a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:55.745097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1be5f5-5411-493c-a66b-707e7042b5a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:55.748352 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-8b1be5f5-5411-493c-a66b-707e7042b5a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:55.947934 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1be5f5-5411-493c-a66b-707e7042b5a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:55.950816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1be5f5-5411-493c-a66b-707e7042b5a0 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:55.991169 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 692/1343] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:01:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:01:59.257796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f92c3-622b-402c-b18c-9134aed38c3e None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:59.258556 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f92c3-622b-402c-b18c-9134aed38c3e None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:59.258556 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f92c3-622b-402c-b18c-9134aed38c3e None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:59.260021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 652/1344] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 09:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:01:59.266074 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4372c4-b9db-485c-9ab2-9123f65dc863 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:59.266796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4372c4-b9db-485c-9ab2-9123f65dc863 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:59.266936 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4372c4-b9db-485c-9ab2-9123f65dc863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:59.344302 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-be4372c4-b9db-485c-9ab2-9123f65dc863 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:01:59.345549 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-be4372c4-b9db-485c-9ab2-9123f65dc863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:59.365321 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:59.464770 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 693/1345] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 09:01:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:01:59.503629 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f92c3-622b-402c-b18c-9134aed38c3e None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:01:59.505363 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-d61f92c3-622b-402c-b18c-9134aed38c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:59.627396 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f92c3-622b-402c-b18c-9134aed38c3e None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:01:59.740390 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69074e-e891-4921-bd22-49730b1f5637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:01:59.741228 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69074e-e891-4921-bd22-49730b1f5637 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:01:59.741727 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69074e-e891-4921-bd22-49730b1f5637 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:01:59.742214 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69074e-e891-4921-bd22-49730b1f5637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:01:59.745544 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-dc69074e-e891-4921-bd22-49730b1f5637 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:01:59.798267 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:59.876109 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69074e-e891-4921-bd22-49730b1f5637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:01:59.878252 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69074e-e891-4921-bd22-49730b1f5637 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:01:59.899879 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 653/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:01:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:02:05.167742 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bc43c-71b4-4782-91aa-4585fde171b9 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:05.168514 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bc43c-71b4-4782-91aa-4585fde171b9 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:05.168514 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bc43c-71b4-4782-91aa-4585fde171b9 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:05.174954 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 694/1347] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 09:02:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:05.176712 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43518958-4823-49d6-9310-8f98d72242c4 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:05.177179 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43518958-4823-49d6-9310-8f98d72242c4 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:05.177442 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43518958-4823-49d6-9310-8f98d72242c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:05.285870 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-43518958-4823-49d6-9310-8f98d72242c4 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:05.287583 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-43518958-4823-49d6-9310-8f98d72242c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:05.443955 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:05.460021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 654/1348] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:05.501926 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bc43c-71b4-4782-91aa-4585fde171b9 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:05.503131 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-a28bc43c-71b4-4782-91aa-4585fde171b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:05.687947 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bc43c-71b4-4782-91aa-4585fde171b9 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:05.762137 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:05.807360 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf0d03-6b86-4082-8ce0-c52f57e87f44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:05.808092 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf0d03-6b86-4082-8ce0-c52f57e87f44 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:05.808423 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf0d03-6b86-4082-8ce0-c52f57e87f44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:05.813563 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf0d03-6b86-4082-8ce0-c52f57e87f44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:05.813563 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-5edf0d03-6b86-4082-8ce0-c52f57e87f44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:05.990931 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf0d03-6b86-4082-8ce0-c52f57e87f44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:05.992582 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf0d03-6b86-4082-8ce0-c52f57e87f44 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:06.017740 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 695/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:02:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:02:11.735040 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a46461-d7a5-4d78-8c64-b6f52cea2b8a None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:11.735912 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a46461-d7a5-4d78-8c64-b6f52cea2b8a None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:11.736626 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a46461-d7a5-4d78-8c64-b6f52cea2b8a None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:11.740467 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 655/1350] 10.222.0.20 () {54 vars in 921 bytes} [Tue Aug 2 09:02:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:11.749641 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363aac2-92fd-4f82-bbbb-c23458f522e7 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:11.750242 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363aac2-92fd-4f82-bbbb-c23458f522e7 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:11.750863 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363aac2-92fd-4f82-bbbb-c23458f522e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:11.949903 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-0363aac2-92fd-4f82-bbbb-c23458f522e7 None None] MFA Rules not processed for user `aa8cac76aa21415d8ab0a2524a7049d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:11.951641 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-0363aac2-92fd-4f82-bbbb-c23458f522e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:11.972223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:12.109274 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 696/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Aug 2 09:02:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:16.912132 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897753c-bd60-467e-ac1a-bf6124d87301 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:16.912978 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897753c-bd60-467e-ac1a-bf6124d87301 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:16.913127 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897753c-bd60-467e-ac1a-bf6124d87301 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:16.916154 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 656/1352] 10.222.0.20 () {54 vars in 921 bytes} [Tue Aug 2 09:02:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:16.922233 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d964b-f838-414d-89b9-486ba255ae9f None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:16.923051 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d964b-f838-414d-89b9-486ba255ae9f None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:16.923198 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d964b-f838-414d-89b9-486ba255ae9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:17.062616 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-643d964b-f838-414d-89b9-486ba255ae9f None None] MFA Rules not processed for user `aa8cac76aa21415d8ab0a2524a7049d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:17.065300 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-643d964b-f838-414d-89b9-486ba255ae9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:17.190022 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:17.254227 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 697/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Aug 2 09:02:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:18.931875 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871d9e4-63d5-461b-a8e8-512cbd08f8d0 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:18.932730 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871d9e4-63d5-461b-a8e8-512cbd08f8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:18.932730 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871d9e4-63d5-461b-a8e8-512cbd08f8d0 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:18.933843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 657/1354] 10.222.0.20 () {54 vars in 921 bytes} [Tue Aug 2 09:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:18.940803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85253f-6ee3-4232-8628-dde9186a6d14 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:18.941424 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85253f-6ee3-4232-8628-dde9186a6d14 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:18.941780 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85253f-6ee3-4232-8628-dde9186a6d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:19.065450 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-1c85253f-6ee3-4232-8628-dde9186a6d14 None None] MFA Rules not processed for user `aa8cac76aa21415d8ab0a2524a7049d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:19.066916 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-1c85253f-6ee3-4232-8628-dde9186a6d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:19.230016 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 698/1355] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Aug 2 09:02:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:23.391493 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe28249-ba4d-41f3-8ea9-ca01a82c7ab2 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:23.392801 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe28249-ba4d-41f3-8ea9-ca01a82c7ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:23.393491 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe28249-ba4d-41f3-8ea9-ca01a82c7ab2 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:23.396255 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 658/1356] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 09:02:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:23.401989 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab288a-75d2-4e22-b9df-5bc9ce3c0107 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:23.402811 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab288a-75d2-4e22-b9df-5bc9ce3c0107 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:23.402811 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab288a-75d2-4e22-b9df-5bc9ce3c0107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:23.448602 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:23.488533 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-0aab288a-75d2-4e22-b9df-5bc9ce3c0107 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:23.491418 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-0aab288a-75d2-4e22-b9df-5bc9ce3c0107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:23.623610 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 699/1357] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:23.695055 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044cf27-f111-4ae3-9c73-8f632bd114fa None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:23.696208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044cf27-f111-4ae3-9c73-8f632bd114fa None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:23.697143 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044cf27-f111-4ae3-9c73-8f632bd114fa None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:23.700010 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 659/1358] 10.222.0.20 () {54 vars in 962 bytes} [Tue Aug 2 09:02:23 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:02:23.709003 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a54547-ec83-4d0f-ad1d-038fc94c1f5e None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:23.710046 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a54547-ec83-4d0f-ad1d-038fc94c1f5e None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:23.711080 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a54547-ec83-4d0f-ad1d-038fc94c1f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:23.829287 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-c5a54547-ec83-4d0f-ad1d-038fc94c1f5e None None] MFA Rules not processed for user `7bfcddefa71546d28078a38325c723a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:23.831419 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-c5a54547-ec83-4d0f-ad1d-038fc94c1f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:23.900595 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:23.994209 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 700/1359] 10.222.0.20 () {58 vars in 1059 bytes} [Tue Aug 2 09:02:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:24.011514 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044cf27-f111-4ae3-9c73-8f632bd114fa None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:24.014703 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-f044cf27-f111-4ae3-9c73-8f632bd114fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:24.277844 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044cf27-f111-4ae3-9c73-8f632bd114fa None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:24.400562 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:24.473594 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2751e9-6686-40bf-b95e-dd4a5ee9abae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:24.474419 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2751e9-6686-40bf-b95e-dd4a5ee9abae service nova] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:24.474817 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2751e9-6686-40bf-b95e-dd4a5ee9abae service nova] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:24.475451 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2751e9-6686-40bf-b95e-dd4a5ee9abae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:24.477317 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-db2751e9-6686-40bf-b95e-dd4a5ee9abae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:24.601899 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2751e9-6686-40bf-b95e-dd4a5ee9abae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:24.603451 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2751e9-6686-40bf-b95e-dd4a5ee9abae service nova] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:24.624761 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 660/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:02:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:02:27.697791 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8bf7fe-c4f6-4df6-aa45-a2d438d61ac7 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:27.698809 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8bf7fe-c4f6-4df6-aa45-a2d438d61ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:27.699304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8bf7fe-c4f6-4df6-aa45-a2d438d61ac7 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:27.700937 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 701/1361] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 09:02:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:02:27.707926 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934af48-66f5-4d56-83c2-b5a403e04874 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:27.708561 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934af48-66f5-4d56-83c2-b5a403e04874 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:27.708765 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934af48-66f5-4d56-83c2-b5a403e04874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:27.815232 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-5934af48-66f5-4d56-83c2-b5a403e04874 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:27.818901 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-5934af48-66f5-4d56-83c2-b5a403e04874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:27.908255 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:27.996067 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 661/1362] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:28.044413 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8bf7fe-c4f6-4df6-aa45-a2d438d61ac7 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:28.046099 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-1a8bf7fe-c4f6-4df6-aa45-a2d438d61ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:28.256352 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8bf7fe-c4f6-4df6-aa45-a2d438d61ac7 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:28.275757 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:28.463527 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f37a2d-c2d4-40ea-b50a-4db1c3e4edf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:28.464222 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f37a2d-c2d4-40ea-b50a-4db1c3e4edf0 service nova] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:28.464480 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f37a2d-c2d4-40ea-b50a-4db1c3e4edf0 service nova] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:28.464755 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f37a2d-c2d4-40ea-b50a-4db1c3e4edf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:28.466467 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-a0f37a2d-c2d4-40ea-b50a-4db1c3e4edf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:28.592615 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f37a2d-c2d4-40ea-b50a-4db1c3e4edf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:28.594296 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f37a2d-c2d4-40ea-b50a-4db1c3e4edf0 service nova] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:28.617313 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 702/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:02:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:02:31.348452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964988c5-0f70-484d-9de4-dcab41f9ec6f None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:31.349062 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964988c5-0f70-484d-9de4-dcab41f9ec6f None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:31.349062 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964988c5-0f70-484d-9de4-dcab41f9ec6f None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:31.350691 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 662/1364] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 09:02:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:31.357369 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f969af8-5f03-4db0-b2d3-dbfed21f7481 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:31.358221 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f969af8-5f03-4db0-b2d3-dbfed21f7481 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:31.358558 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f969af8-5f03-4db0-b2d3-dbfed21f7481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:31.375238 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:31.456236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-4f969af8-5f03-4db0-b2d3-dbfed21f7481 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:31.458559 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-4f969af8-5f03-4db0-b2d3-dbfed21f7481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:31.656203 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 703/1365] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:02:31.730209 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d43895-5f4a-4682-b842-2a7f3e32316f None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:31.730741 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d43895-5f4a-4682-b842-2a7f3e32316f None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:31.731271 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d43895-5f4a-4682-b842-2a7f3e32316f None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:31.734602 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 663/1366] 10.222.0.20 () {54 vars in 962 bytes} [Tue Aug 2 09:02:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:31.742401 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521b004-0b12-480f-a9d9-8a6a15ab08cd None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:31.742818 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521b004-0b12-480f-a9d9-8a6a15ab08cd None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:31.743235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521b004-0b12-480f-a9d9-8a6a15ab08cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:31.866943 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-b521b004-0b12-480f-a9d9-8a6a15ab08cd None None] MFA Rules not processed for user `7bfcddefa71546d28078a38325c723a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:31.868541 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-b521b004-0b12-480f-a9d9-8a6a15ab08cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:31.947419 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:32.112645 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 704/1367] 10.222.0.20 () {58 vars in 1059 bytes} [Tue Aug 2 09:02:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:32.122444 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d43895-5f4a-4682-b842-2a7f3e32316f None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:32.124938 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-33d43895-5f4a-4682-b842-2a7f3e32316f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:32.387702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d43895-5f4a-4682-b842-2a7f3e32316f None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:32.421626 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:32.600578 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926025a-0311-4d22-b52c-ef48f5cd6709 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:32.601695 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926025a-0311-4d22-b52c-ef48f5cd6709 service nova] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:32.602220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926025a-0311-4d22-b52c-ef48f5cd6709 service nova] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:32.602742 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926025a-0311-4d22-b52c-ef48f5cd6709 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:32.606257 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-b926025a-0311-4d22-b52c-ef48f5cd6709 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:32.752076 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7182f-ac12-4ab8-a1a0-f3f02d8da21e None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:32.753192 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7182f-ac12-4ab8-a1a0-f3f02d8da21e None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:32.753192 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7182f-ac12-4ab8-a1a0-f3f02d8da21e None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:32.760143 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 705/1368] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 09:02:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:02:32.762831 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82519f26-58da-4aef-bb4b-32cc518b6094 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:32.763227 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82519f26-58da-4aef-bb4b-32cc518b6094 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:32.763918 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82519f26-58da-4aef-bb4b-32cc518b6094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:32.781775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926025a-0311-4d22-b52c-ef48f5cd6709 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:32.783483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926025a-0311-4d22-b52c-ef48f5cd6709 service nova] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:32.816110 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 664/1369] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:02:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 695 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:02:32.871518 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-82519f26-58da-4aef-bb4b-32cc518b6094 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:32.873808 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-82519f26-58da-4aef-bb4b-32cc518b6094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:33.031949 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:33.046289 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 706/1370] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:33.424969 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fda31b-ff58-48dc-9f70-a8e575658615 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:33.424969 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fda31b-ff58-48dc-9f70-a8e575658615 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:33.432223 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fda31b-ff58-48dc-9f70-a8e575658615 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:33.432223 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 665/1371] 10.222.0.20 () {54 vars in 964 bytes} [Tue Aug 2 09:02:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:33.439739 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30174fc-9fb6-41c1-a7dd-965af9e1b2c1 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:33.440184 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30174fc-9fb6-41c1-a7dd-965af9e1b2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:33.440585 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30174fc-9fb6-41c1-a7dd-965af9e1b2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:33.561497 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-f30174fc-9fb6-41c1-a7dd-965af9e1b2c1 None None] MFA Rules not processed for user `ada53ed554844560843ab84198ac373c`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:33.572217 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-f30174fc-9fb6-41c1-a7dd-965af9e1b2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:33.668232 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 707/1372] 10.222.0.20 () {58 vars in 1061 bytes} [Tue Aug 2 09:02:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:33.676253 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fda31b-ff58-48dc-9f70-a8e575658615 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:33.677773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-b2fda31b-ff58-48dc-9f70-a8e575658615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:33.710631 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:33.811019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fda31b-ff58-48dc-9f70-a8e575658615 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:33.915213 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d5346-a49c-484e-ac73-5fe979d92989 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:33.916047 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d5346-a49c-484e-ac73-5fe979d92989 service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:33.916546 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d5346-a49c-484e-ac73-5fe979d92989 service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:33.916888 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d5346-a49c-484e-ac73-5fe979d92989 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:33.919175 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-e65d5346-a49c-484e-ac73-5fe979d92989 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:34.045653 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:34.093620 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d5346-a49c-484e-ac73-5fe979d92989 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:34.095256 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d5346-a49c-484e-ac73-5fe979d92989 service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:34.122173 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 666/1373] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:02:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:02:35.256692 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abaf406-1dd3-4ae6-a15c-c594441b02ec None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:35.257275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abaf406-1dd3-4ae6-a15c-c594441b02ec None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:35.257383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abaf406-1dd3-4ae6-a15c-c594441b02ec None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:35.258806 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 708/1374] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 09:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:35.264733 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a026a-3a7f-4f35-9fd8-ff260369b4ac None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:35.265254 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a026a-3a7f-4f35-9fd8-ff260369b4ac None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:35.265366 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a026a-3a7f-4f35-9fd8-ff260369b4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:35.351794 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-351a026a-3a7f-4f35-9fd8-ff260369b4ac None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:35.353089 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-351a026a-3a7f-4f35-9fd8-ff260369b4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:35.468743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 667/1375] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:35.513179 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abaf406-1dd3-4ae6-a15c-c594441b02ec None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:35.514754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-4abaf406-1dd3-4ae6-a15c-c594441b02ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:35.618989 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:35.693134 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abaf406-1dd3-4ae6-a15c-c594441b02ec None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:35.824390 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290bac5e-c888-4856-839d-057962280d28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:35.825568 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bac5e-c888-4856-839d-057962280d28 service nova] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:35.825866 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bac5e-c888-4856-839d-057962280d28 service nova] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:35.826004 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bac5e-c888-4856-839d-057962280d28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:35.827952 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-290bac5e-c888-4856-839d-057962280d28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:35.897350 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:35.953881 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290bac5e-c888-4856-839d-057962280d28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:35.955812 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290bac5e-c888-4856-839d-057962280d28 service nova] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:35.980916 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 709/1376] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:02:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:02:38.332251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b79df-987f-4319-a844-3267fd541579 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:38.332793 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b79df-987f-4319-a844-3267fd541579 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:38.333030 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b79df-987f-4319-a844-3267fd541579 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:38.334511 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 668/1377] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 09:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:38.340259 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a12dd-e276-48e6-b9c8-3d5e8c951fde None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:38.340903 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a12dd-e276-48e6-b9c8-3d5e8c951fde None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:38.341045 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a12dd-e276-48e6-b9c8-3d5e8c951fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:38.452930 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-b56a12dd-e276-48e6-b9c8-3d5e8c951fde None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:38.454170 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-b56a12dd-e276-48e6-b9c8-3d5e8c951fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:38.588288 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 710/1378] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:38.631985 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b79df-987f-4319-a844-3267fd541579 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:38.633516 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-990b79df-987f-4319-a844-3267fd541579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:38.681051 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:38.810905 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b79df-987f-4319-a844-3267fd541579 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:38.957125 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:38.963221 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921e729-2633-48d8-800b-cb467de3ff09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:38.963877 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921e729-2633-48d8-800b-cb467de3ff09 service nova] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:38.964179 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921e729-2633-48d8-800b-cb467de3ff09 service nova] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:38.964497 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921e729-2633-48d8-800b-cb467de3ff09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:38.966116 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-e921e729-2633-48d8-800b-cb467de3ff09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:39.077797 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921e729-2633-48d8-800b-cb467de3ff09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:39.081008 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921e729-2633-48d8-800b-cb467de3ff09 service nova] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:39.103754 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 669/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:02:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:02:41.378416 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419e2f3-d003-43de-8ac7-ef41a1db7061 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:41.379034 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419e2f3-d003-43de-8ac7-ef41a1db7061 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:41.379034 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419e2f3-d003-43de-8ac7-ef41a1db7061 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:41.381248 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 711/1380] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 09:02:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:41.388208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c34d7-d4af-472d-9b50-a2ceb98f883f None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:41.388808 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c34d7-d4af-472d-9b50-a2ceb98f883f None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:41.388808 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c34d7-d4af-472d-9b50-a2ceb98f883f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:41.514692 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-391c34d7-d4af-472d-9b50-a2ceb98f883f None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:41.517383 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-391c34d7-d4af-472d-9b50-a2ceb98f883f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:41.607082 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:41.645522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 670/1381] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:41.700331 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419e2f3-d003-43de-8ac7-ef41a1db7061 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:41.701732 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-4419e2f3-d003-43de-8ac7-ef41a1db7061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:41.738565 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:41.879829 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419e2f3-d003-43de-8ac7-ef41a1db7061 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:41.998582 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:42.016755 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ac3c2-38dd-4cac-8185-b4de0ae74e7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:42.017394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ac3c2-38dd-4cac-8185-b4de0ae74e7e service nova] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:42.017662 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ac3c2-38dd-4cac-8185-b4de0ae74e7e service nova] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:42.017937 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ac3c2-38dd-4cac-8185-b4de0ae74e7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:42.019581 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-7b9ac3c2-38dd-4cac-8185-b4de0ae74e7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:42.132765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ac3c2-38dd-4cac-8185-b4de0ae74e7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:42.134550 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ac3c2-38dd-4cac-8185-b4de0ae74e7e service nova] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:42.169260 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 712/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:02:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:02:44.458321 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0eb06d-0f11-4af2-9c6f-ad55b8f71755 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:44.459126 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0eb06d-0f11-4af2-9c6f-ad55b8f71755 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:44.459126 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0eb06d-0f11-4af2-9c6f-ad55b8f71755 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:44.461318 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 671/1383] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 09:02:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:44.471816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82b61a-468e-4635-99a6-1e36380d4981 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:44.472455 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82b61a-468e-4635-99a6-1e36380d4981 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:44.472778 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82b61a-468e-4635-99a6-1e36380d4981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:44.587526 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-5e82b61a-468e-4635-99a6-1e36380d4981 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:44.588909 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-5e82b61a-468e-4635-99a6-1e36380d4981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:44.667294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:44.723721 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 713/1384] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:44.786861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0eb06d-0f11-4af2-9c6f-ad55b8f71755 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:44.789284 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-3b0eb06d-0f11-4af2-9c6f-ad55b8f71755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:45.006514 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0eb06d-0f11-4af2-9c6f-ad55b8f71755 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:45.080850 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:45.173220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a23cb-9ab9-4546-828b-991cec72cb1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:45.173924 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a23cb-9ab9-4546-828b-991cec72cb1d service nova] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:45.174266 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a23cb-9ab9-4546-828b-991cec72cb1d service nova] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:45.174548 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a23cb-9ab9-4546-828b-991cec72cb1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:45.176413 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-147a23cb-9ab9-4546-828b-991cec72cb1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:45.317995 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a23cb-9ab9-4546-828b-991cec72cb1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:45.320700 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a23cb-9ab9-4546-828b-991cec72cb1d service nova] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:45.354991 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 672/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:02:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:02:48.069099 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1323bd2-faf6-42eb-a1a7-e155c890265e None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:48.069642 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1323bd2-faf6-42eb-a1a7-e155c890265e None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:48.069642 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1323bd2-faf6-42eb-a1a7-e155c890265e None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:48.071190 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 714/1386] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 09:02:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:48.077188 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce3a7f-1f78-44a6-884e-422cdafd0133 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:48.077690 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce3a7f-1f78-44a6-884e-422cdafd0133 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:48.077690 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce3a7f-1f78-44a6-884e-422cdafd0133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:48.159059 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-77ce3a7f-1f78-44a6-884e-422cdafd0133 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:48.160391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-77ce3a7f-1f78-44a6-884e-422cdafd0133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:48.170731 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:48.286724 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 673/1387] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:48.332797 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1323bd2-faf6-42eb-a1a7-e155c890265e None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:48.334297 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-d1323bd2-faf6-42eb-a1a7-e155c890265e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:48.543014 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1323bd2-faf6-42eb-a1a7-e155c890265e None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:48.609481 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:48.686316 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7a34a-ba91-4a39-85a4-4e1c108983e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:48.687016 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7a34a-ba91-4a39-85a4-4e1c108983e2 service nova] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:48.687291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7a34a-ba91-4a39-85a4-4e1c108983e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:48.688278 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7a34a-ba91-4a39-85a4-4e1c108983e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:48.690275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-3db7a34a-ba91-4a39-85a4-4e1c108983e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:48.791802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7a34a-ba91-4a39-85a4-4e1c108983e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:48.793441 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7a34a-ba91-4a39-85a4-4e1c108983e2 service nova] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:48.813545 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 715/1388] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:02:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:02:50.105974 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aedaf7-a54f-4c23-b1ce-315bc0a845c7 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:50.106624 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aedaf7-a54f-4c23-b1ce-315bc0a845c7 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:50.106624 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aedaf7-a54f-4c23-b1ce-315bc0a845c7 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:50.107694 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 674/1389] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 09:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:50.113788 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850a125-af96-4b60-9458-b035b403b1af None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:50.114271 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850a125-af96-4b60-9458-b035b403b1af None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:50.114552 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850a125-af96-4b60-9458-b035b403b1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:50.196263 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:50.199516 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-8850a125-af96-4b60-9458-b035b403b1af None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:50.200772 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-8850a125-af96-4b60-9458-b035b403b1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:50.318231 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 716/1390] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:50.377462 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ab888-cd20-4d29-87f7-a815b620909a None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:50.377747 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ab888-cd20-4d29-87f7-a815b620909a None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:50.378027 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ab888-cd20-4d29-87f7-a815b620909a None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:50.379403 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 675/1391] 10.222.0.20 () {54 vars in 966 bytes} [Tue Aug 2 09:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:50.384737 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c5d21-939b-49a8-bc88-1544a47c0cf4 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:50.385030 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c5d21-939b-49a8-bc88-1544a47c0cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:50.385312 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c5d21-939b-49a8-bc88-1544a47c0cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:50.479042 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-3e1c5d21-939b-49a8-bc88-1544a47c0cf4 None None] MFA Rules not processed for user `bca8afe2c10f4db58716aacfd373504b`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:50.481162 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-3e1c5d21-939b-49a8-bc88-1544a47c0cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:50.588866 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:50.596326 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 717/1392] 10.222.0.20 () {58 vars in 1063 bytes} [Tue Aug 2 09:02:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:50.604424 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ab888-cd20-4d29-87f7-a815b620909a None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:50.606024 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-0a9ab888-cd20-4d29-87f7-a815b620909a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:50.720897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ab888-cd20-4d29-87f7-a815b620909a None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:50.761772 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:50.806334 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64065b9-27a4-48d3-9230-afdb22b143c2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca8afe2c10f4db58716aacfd373504b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:50.806963 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64065b9-27a4-48d3-9230-afdb22b143c2 service glance] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:50.807244 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64065b9-27a4-48d3-9230-afdb22b143c2 service glance] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:50.807517 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64065b9-27a4-48d3-9230-afdb22b143c2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:50.809215 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-c64065b9-27a4-48d3-9230-afdb22b143c2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:50.933989 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64065b9-27a4-48d3-9230-afdb22b143c2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:50.935482 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64065b9-27a4-48d3-9230-afdb22b143c2 service glance] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:50.958923 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 676/1393] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:02:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:02:51.110436 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8dff7-f297-4d72-9f29-cca250a65845 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:51.110783 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8dff7-f297-4d72-9f29-cca250a65845 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:51.111239 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8dff7-f297-4d72-9f29-cca250a65845 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:51.112500 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 718/1394] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 09:02:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:51.118472 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b873d02-346c-4336-85c2-89df6136a723 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:51.119023 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b873d02-346c-4336-85c2-89df6136a723 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:51.119023 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b873d02-346c-4336-85c2-89df6136a723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:51.209740 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-5b873d02-346c-4336-85c2-89df6136a723 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:51.211009 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-5b873d02-346c-4336-85c2-89df6136a723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:51.245661 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:51.342220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 677/1395] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:51.397150 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8dff7-f297-4d72-9f29-cca250a65845 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:51.398692 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-1dd8dff7-f297-4d72-9f29-cca250a65845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:51.563080 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8dff7-f297-4d72-9f29-cca250a65845 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:51.662552 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:51.714941 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5121844-c010-46f8-904c-c073f26823d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:51.715604 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5121844-c010-46f8-904c-c073f26823d1 service nova] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:51.715885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5121844-c010-46f8-904c-c073f26823d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:51.716181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5121844-c010-46f8-904c-c073f26823d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:51.717881 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-c5121844-c010-46f8-904c-c073f26823d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:51.834369 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5121844-c010-46f8-904c-c073f26823d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:51.836053 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5121844-c010-46f8-904c-c073f26823d1 service nova] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:51.859424 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 719/1396] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:02:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:02:52.059169 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c2f5d-5a4c-426e-8bac-ecfc232fdf94 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:52.059603 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c2f5d-5a4c-426e-8bac-ecfc232fdf94 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:52.059768 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c2f5d-5a4c-426e-8bac-ecfc232fdf94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:52.161449 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-4e9c2f5d-5a4c-426e-8bac-ecfc232fdf94 None None] MFA Rules not processed for user `eb640d92cb9b49019f42351a60efe258`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:52.162915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-4e9c2f5d-5a4c-426e-8bac-ecfc232fdf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:52.264871 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 678/1397] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Aug 2 09:02:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:52.314073 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d0d24-6ee7-4615-ae46-ed688e0860e4 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:52.314431 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d0d24-6ee7-4615-ae46-ed688e0860e4 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:52.314801 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d0d24-6ee7-4615-ae46-ed688e0860e4 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:52.316877 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 720/1398] 10.222.0.20 () {54 vars in 943 bytes} [Tue Aug 2 09:02:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:52.324045 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714e21b-f9c8-4fc5-ade7-1a5422cd0bef None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:52.324360 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714e21b-f9c8-4fc5-ade7-1a5422cd0bef None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:52.324637 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714e21b-f9c8-4fc5-ade7-1a5422cd0bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:52.341536 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:52.411096 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-a714e21b-f9c8-4fc5-ade7-1a5422cd0bef None None] MFA Rules not processed for user `58f8e572550b4ab5955d7a94f1563441`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:52.412371 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-a714e21b-f9c8-4fc5-ade7-1a5422cd0bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:52.535363 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 679/1399] 10.222.0.20 () {58 vars in 1040 bytes} [Tue Aug 2 09:02:52 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:52.545322 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d0d24-6ee7-4615-ae46-ed688e0860e4 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:52.547491 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-160d0d24-6ee7-4615-ae46-ed688e0860e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:52.640438 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:52.700894 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d0d24-6ee7-4615-ae46-ed688e0860e4 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:52.824790 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce21e39-1ad3-458c-bf6a-2fa93f54818a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f8e572550b4ab5955d7a94f1563441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:52.825357 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce21e39-1ad3-458c-bf6a-2fa93f54818a service swift] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:52.825645 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce21e39-1ad3-458c-bf6a-2fa93f54818a service swift] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:52.825931 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce21e39-1ad3-458c-bf6a-2fa93f54818a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:52.827684 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-3ce21e39-1ad3-458c-bf6a-2fa93f54818a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:52.915771 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:52.936012 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce21e39-1ad3-458c-bf6a-2fa93f54818a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:52.938370 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce21e39-1ad3-458c-bf6a-2fa93f54818a service swift] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:52.948112 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 721/1400] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Aug 2 09:02:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:02:54.160924 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4aca3-bbba-456c-8144-142d8a2ec933 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:54.161494 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4aca3-bbba-456c-8144-142d8a2ec933 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:54.161494 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4aca3-bbba-456c-8144-142d8a2ec933 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:54.162981 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 680/1401] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 09:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:54.168553 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80029c8e-00a6-4acb-95a4-6de1c6bc56ca None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:54.169088 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80029c8e-00a6-4acb-95a4-6de1c6bc56ca None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:54.169416 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80029c8e-00a6-4acb-95a4-6de1c6bc56ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:54.258390 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-80029c8e-00a6-4acb-95a4-6de1c6bc56ca None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:54.259618 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-80029c8e-00a6-4acb-95a4-6de1c6bc56ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:54.393979 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 722/1402] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:02:54.442594 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4aca3-bbba-456c-8144-142d8a2ec933 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:54.444252 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-84d4aca3-bbba-456c-8144-142d8a2ec933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:54.534612 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:54.625975 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4aca3-bbba-456c-8144-142d8a2ec933 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:54.788180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8414476-b0cb-484d-8308-cb41ef98aaba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:54.788914 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8414476-b0cb-484d-8308-cb41ef98aaba service nova] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:54.789204 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8414476-b0cb-484d-8308-cb41ef98aaba service nova] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:54.789483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8414476-b0cb-484d-8308-cb41ef98aaba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:54.793642 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-c8414476-b0cb-484d-8308-cb41ef98aaba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:54.841894 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:54.922343 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8414476-b0cb-484d-8308-cb41ef98aaba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:54.925536 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8414476-b0cb-484d-8308-cb41ef98aaba service nova] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:54.952199 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 681/1403] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:02:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:02:57.251485 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada93c71-063f-45a5-b426-111d09bfcfbd None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:57.252498 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada93c71-063f-45a5-b426-111d09bfcfbd None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:57.252498 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada93c71-063f-45a5-b426-111d09bfcfbd None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:57.260999 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 723/1404] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 09:02:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:57.261272 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ef19b-4195-42e8-9e5b-e574159bb980 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:57.261272 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ef19b-4195-42e8-9e5b-e574159bb980 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:57.261272 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ef19b-4195-42e8-9e5b-e574159bb980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:57.357742 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-d83ef19b-4195-42e8-9e5b-e574159bb980 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:57.359662 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-d83ef19b-4195-42e8-9e5b-e574159bb980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:57.495528 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 682/1405] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:02:57.542543 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada93c71-063f-45a5-b426-111d09bfcfbd None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:57.544115 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-ada93c71-063f-45a5-b426-111d09bfcfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:57.639300 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:57.746490 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada93c71-063f-45a5-b426-111d09bfcfbd None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:57.895910 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f90c49-ee73-44db-ac03-3060cb1c6d9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:57.896577 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f90c49-ee73-44db-ac03-3060cb1c6d9c service nova] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:57.896925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f90c49-ee73-44db-ac03-3060cb1c6d9c service nova] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:57.897197 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f90c49-ee73-44db-ac03-3060cb1c6d9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:57.898996 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-d0f90c49-ee73-44db-ac03-3060cb1c6d9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:57.930038 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:58.022813 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f90c49-ee73-44db-ac03-3060cb1c6d9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:58.025949 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f90c49-ee73-44db-ac03-3060cb1c6d9c service nova] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:58.056218 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 724/1406] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:02:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:03:00.342052 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f0849-f3e4-4535-a5f1-924c01729943 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:00.342640 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f0849-f3e4-4535-a5f1-924c01729943 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:00.342640 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f0849-f3e4-4535-a5f1-924c01729943 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:00.350882 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2bd5c-067c-4005-96b1-115c1c985679 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:00.350882 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2bd5c-067c-4005-96b1-115c1c985679 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:00.350882 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2bd5c-067c-4005-96b1-115c1c985679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:00.354466 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 683/1407] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 09:03:00 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:00.442704 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-6be2bd5c-067c-4005-96b1-115c1c985679 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:00.443849 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-6be2bd5c-067c-4005-96b1-115c1c985679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:00.558068 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:00.561559 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 725/1408] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:03:00.615136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f0849-f3e4-4535-a5f1-924c01729943 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:00.615565 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-b03f0849-f3e4-4535-a5f1-924c01729943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:00.627219 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:00.830656 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f0849-f3e4-4535-a5f1-924c01729943 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:00.946058 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:00.998636 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6367940-59ff-4f37-8cf4-c7203c842847 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:01.000024 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6367940-59ff-4f37-8cf4-c7203c842847 service nova] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:01.000538 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6367940-59ff-4f37-8cf4-c7203c842847 service nova] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:01.000837 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6367940-59ff-4f37-8cf4-c7203c842847 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:01.002556 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-f6367940-59ff-4f37-8cf4-c7203c842847 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:01.129627 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6367940-59ff-4f37-8cf4-c7203c842847 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:01.132040 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6367940-59ff-4f37-8cf4-c7203c842847 service nova] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:01.161971 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 684/1409] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:03:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:03:10.589231 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:11.159404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=58 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:17.604463 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962d83c-a669-4899-ae6e-94a7609f93b5 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:17.605037 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962d83c-a669-4899-ae6e-94a7609f93b5 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:17.605431 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962d83c-a669-4899-ae6e-94a7609f93b5 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:17.606889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 726/1410] 10.222.0.20 () {54 vars in 918 bytes} [Tue Aug 2 09:03:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:17.613267 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a6e2c-4735-469c-82fc-bbfb5ad75476 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:17.613754 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a6e2c-4735-469c-82fc-bbfb5ad75476 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:17.613754 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a6e2c-4735-469c-82fc-bbfb5ad75476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:17.692908 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-9c5a6e2c-4735-469c-82fc-bbfb5ad75476 None None] MFA Rules not processed for user `aa8cac76aa21415d8ab0a2524a7049d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:17.694181 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-9c5a6e2c-4735-469c-82fc-bbfb5ad75476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:17.808580 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 685/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Tue Aug 2 09:03:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:03:17.824592 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fc9d7-42e2-4435-b5d2-3f7a59bf804f None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:17.824880 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fc9d7-42e2-4435-b5d2-3f7a59bf804f None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:17.825153 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fc9d7-42e2-4435-b5d2-3f7a59bf804f None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:17.827446 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 727/1412] 10.222.0.20 () {54 vars in 918 bytes} [Tue Aug 2 09:03:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:17.832466 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3c62f-10d2-4f52-a583-58661320e07a None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:17.832757 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3c62f-10d2-4f52-a583-58661320e07a None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:17.833786 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3c62f-10d2-4f52-a583-58661320e07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:17.916728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:17.919627 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-81c3c62f-10d2-4f52-a583-58661320e07a None None] MFA Rules not processed for user `7bfcddefa71546d28078a38325c723a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:17.921103 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-81c3c62f-10d2-4f52-a583-58661320e07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:18.070246 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 686/1413] 10.222.0.20 () {58 vars in 1015 bytes} [Tue Aug 2 09:03:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:03:20.636696 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260abef2-f98a-4889-b718-bf85ee8b0f5b None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:20.637269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260abef2-f98a-4889-b718-bf85ee8b0f5b None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:20.637269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260abef2-f98a-4889-b718-bf85ee8b0f5b None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:20.638655 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 728/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 09:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:20.644566 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80babac-fa7f-46b1-b5cc-61fc1d8eaaa6 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:20.645117 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80babac-fa7f-46b1-b5cc-61fc1d8eaaa6 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:20.645117 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80babac-fa7f-46b1-b5cc-61fc1d8eaaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:20.725345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-e80babac-fa7f-46b1-b5cc-61fc1d8eaaa6 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:20.726575 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-e80babac-fa7f-46b1-b5cc-61fc1d8eaaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:20.785879 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:20.835195 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 687/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 09:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:03:20.882860 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260abef2-f98a-4889-b718-bf85ee8b0f5b None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:20.884338 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-260abef2-f98a-4889-b718-bf85ee8b0f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:21.045361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260abef2-f98a-4889-b718-bf85ee8b0f5b None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:21.132669 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:21.180251 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314327f-9153-4313-9e41-c34fd0a69879 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:21.180891 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314327f-9153-4313-9e41-c34fd0a69879 service nova] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:21.181172 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314327f-9153-4313-9e41-c34fd0a69879 service nova] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:21.181450 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314327f-9153-4313-9e41-c34fd0a69879 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:21.183185 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-b314327f-9153-4313-9e41-c34fd0a69879 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:21.282453 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314327f-9153-4313-9e41-c34fd0a69879 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:21.284110 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314327f-9153-4313-9e41-c34fd0a69879 service nova] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:21.304618 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 729/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:03:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:03:22.276530 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836465e-11f1-43c1-8421-5f51c55fafdd None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:22.276530 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836465e-11f1-43c1-8421-5f51c55fafdd None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:22.277015 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836465e-11f1-43c1-8421-5f51c55fafdd None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:22.278176 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 688/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 09:03:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:03:22.284334 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa918073-2616-486d-81e2-833811e2fb16 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:22.284824 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa918073-2616-486d-81e2-833811e2fb16 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:22.285005 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa918073-2616-486d-81e2-833811e2fb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:22.367377 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-fa918073-2616-486d-81e2-833811e2fb16 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:22.368664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-fa918073-2616-486d-81e2-833811e2fb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:22.398187 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:22.475668 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 730/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 09:03:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:03:22.637504 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836465e-11f1-43c1-8421-5f51c55fafdd None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:22.639937 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-0836465e-11f1-43c1-8421-5f51c55fafdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:22.794810 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836465e-11f1-43c1-8421-5f51c55fafdd None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:22.837692 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:22.919251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b7a23-c7be-42c1-8173-350f9ac64915 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:22.919791 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b7a23-c7be-42c1-8173-350f9ac64915 service nova] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:22.920722 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b7a23-c7be-42c1-8173-350f9ac64915 service nova] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:22.921008 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b7a23-c7be-42c1-8173-350f9ac64915 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:22.922672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-007b7a23-c7be-42c1-8173-350f9ac64915 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:23.025385 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b7a23-c7be-42c1-8173-350f9ac64915 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:23.035151 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b7a23-c7be-42c1-8173-350f9ac64915 service nova] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:23.047467 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 689/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:03:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:03:23.990484 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ecf27-433c-4157-b9d8-ad2b5e2ea522 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:23.991036 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ecf27-433c-4157-b9d8-ad2b5e2ea522 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:23.991130 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ecf27-433c-4157-b9d8-ad2b5e2ea522 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:23.992525 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 731/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 09:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:23.997769 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83cbf8-833f-46e6-be2c-5627d367b0a5 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:23.998324 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83cbf8-833f-46e6-be2c-5627d367b0a5 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:23.998574 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83cbf8-833f-46e6-be2c-5627d367b0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:24.062313 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:24.088235 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-da83cbf8-833f-46e6-be2c-5627d367b0a5 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:24.090424 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-da83cbf8-833f-46e6-be2c-5627d367b0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:24.210571 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 690/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 09:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:03:24.386606 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ecf27-433c-4157-b9d8-ad2b5e2ea522 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:24.388243 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-824ecf27-433c-4157-b9d8-ad2b5e2ea522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:24.558161 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ecf27-433c-4157-b9d8-ad2b5e2ea522 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:24.571604 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:24.678647 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16c78d-46ab-4d35-b838-2fae82108e1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:24.679273 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16c78d-46ab-4d35-b838-2fae82108e1e service nova] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:24.679556 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16c78d-46ab-4d35-b838-2fae82108e1e service nova] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:24.679824 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16c78d-46ab-4d35-b838-2fae82108e1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:24.681502 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-9f16c78d-46ab-4d35-b838-2fae82108e1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:24.789281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f16c78d-46ab-4d35-b838-2fae82108e1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:24.790918 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f16c78d-46ab-4d35-b838-2fae82108e1e service nova] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:24.811496 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 732/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:03:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:03:25.709255 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8420651-0d4a-4dbf-a0fd-210f7ab63c41 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:25.709844 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8420651-0d4a-4dbf-a0fd-210f7ab63c41 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:25.709844 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8420651-0d4a-4dbf-a0fd-210f7ab63c41 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:25.711180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 691/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 09:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:25.716745 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc78a50-6cff-4525-b75c-132c35b05ab3 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:25.717226 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc78a50-6cff-4525-b75c-132c35b05ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:25.717530 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc78a50-6cff-4525-b75c-132c35b05ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:25.738858 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:25.806991 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-abc78a50-6cff-4525-b75c-132c35b05ab3 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:25.808319 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-abc78a50-6cff-4525-b75c-132c35b05ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:25.915171 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 733/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 09:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:03:26.070165 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8420651-0d4a-4dbf-a0fd-210f7ab63c41 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:26.071927 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-c8420651-0d4a-4dbf-a0fd-210f7ab63c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:26.198194 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:26.237743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8420651-0d4a-4dbf-a0fd-210f7ab63c41 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:26.368357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac155ed-ea78-48cf-b69f-90ba5176b7dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:26.368994 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac155ed-ea78-48cf-b69f-90ba5176b7dd service nova] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:26.369282 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac155ed-ea78-48cf-b69f-90ba5176b7dd service nova] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:26.369549 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac155ed-ea78-48cf-b69f-90ba5176b7dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:26.371237 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-8ac155ed-ea78-48cf-b69f-90ba5176b7dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:26.458689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:26.474934 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac155ed-ea78-48cf-b69f-90ba5176b7dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:26.476750 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac155ed-ea78-48cf-b69f-90ba5176b7dd service nova] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:26.507774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 692/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:03:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:03:27.405043 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2fe36-027d-4733-9efa-3cb2a38d0ea1 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:27.405762 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2fe36-027d-4733-9efa-3cb2a38d0ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:27.405762 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2fe36-027d-4733-9efa-3cb2a38d0ea1 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:27.406945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 734/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 09:03:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:27.412131 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b67b42-f261-4d57-9b25-2521271c6114 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:27.412602 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b67b42-f261-4d57-9b25-2521271c6114 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:27.412725 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b67b42-f261-4d57-9b25-2521271c6114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:27.494485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-05b67b42-f261-4d57-9b25-2521271c6114 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:27.495776 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-05b67b42-f261-4d57-9b25-2521271c6114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:27.600942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 693/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 09:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:03:27.754793 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2fe36-027d-4733-9efa-3cb2a38d0ea1 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:27.756371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-68c2fe36-027d-4733-9efa-3cb2a38d0ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:27.845270 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:27.913663 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2fe36-027d-4733-9efa-3cb2a38d0ea1 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:28.047767 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd844aed-0727-467b-b885-b7915b9ca51e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:28.048436 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd844aed-0727-467b-b885-b7915b9ca51e service nova] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:28.048719 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd844aed-0727-467b-b885-b7915b9ca51e service nova] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:28.048989 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd844aed-0727-467b-b885-b7915b9ca51e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:28.050757 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-dd844aed-0727-467b-b885-b7915b9ca51e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:28.104277 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:28.147839 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd844aed-0727-467b-b885-b7915b9ca51e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:28.149523 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd844aed-0727-467b-b885-b7915b9ca51e service nova] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:28.167978 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 735/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:03:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:03:29.056837 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07e744-83f0-4837-832a-fba9e2ff52f2 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:29.057507 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07e744-83f0-4837-832a-fba9e2ff52f2 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:29.057507 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07e744-83f0-4837-832a-fba9e2ff52f2 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:29.058776 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 694/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 09:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:29.064725 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eda2cf-64b3-42a3-b2c0-527349f35512 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:29.065499 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eda2cf-64b3-42a3-b2c0-527349f35512 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:29.065499 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eda2cf-64b3-42a3-b2c0-527349f35512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:29.150610 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-c6eda2cf-64b3-42a3-b2c0-527349f35512 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:29.151876 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-c6eda2cf-64b3-42a3-b2c0-527349f35512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:29.271231 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 736/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 09:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:03:29.426657 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07e744-83f0-4837-832a-fba9e2ff52f2 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:29.428233 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-6d07e744-83f0-4837-832a-fba9e2ff52f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:29.482605 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:29.595540 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07e744-83f0-4837-832a-fba9e2ff52f2 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:29.723503 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7ff1b-d991-481f-ad7e-6419d7551fbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:29.724052 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7ff1b-d991-481f-ad7e-6419d7551fbd service nova] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:29.724365 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7ff1b-d991-481f-ad7e-6419d7551fbd service nova] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:29.724645 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7ff1b-d991-481f-ad7e-6419d7551fbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:29.726377 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-68e7ff1b-d991-481f-ad7e-6419d7551fbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:29.734823 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:29.825867 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e7ff1b-d991-481f-ad7e-6419d7551fbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:29.828296 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e7ff1b-d991-481f-ad7e-6419d7551fbd service nova] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:29.848259 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 695/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:03:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:03:30.765963 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13b563-1210-4b11-96a6-6dd23ff6c1e7 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:30.766562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13b563-1210-4b11-96a6-6dd23ff6c1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:30.766562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13b563-1210-4b11-96a6-6dd23ff6c1e7 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:30.767933 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 737/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 09:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:30.773294 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3d894-9292-4215-89d5-c163d77d6a28 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:30.773829 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3d894-9292-4215-89d5-c163d77d6a28 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:30.773829 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3d894-9292-4215-89d5-c163d77d6a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:30.853931 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-11a3d894-9292-4215-89d5-c163d77d6a28 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:30.858127 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-11a3d894-9292-4215-89d5-c163d77d6a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:30.927883 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:30.958893 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 696/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 09:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:03:31.126143 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13b563-1210-4b11-96a6-6dd23ff6c1e7 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:31.127720 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-8b13b563-1210-4b11-96a6-6dd23ff6c1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:31.147055 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:31.291859 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13b563-1210-4b11-96a6-6dd23ff6c1e7 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:31.389145 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:31.416830 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc00a7-7ddf-4c2d-9793-1d00ac2fbfbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:31.417516 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc00a7-7ddf-4c2d-9793-1d00ac2fbfbe service nova] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:31.417805 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc00a7-7ddf-4c2d-9793-1d00ac2fbfbe service nova] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:31.418125 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc00a7-7ddf-4c2d-9793-1d00ac2fbfbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:31.420441 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-0adc00a7-7ddf-4c2d-9793-1d00ac2fbfbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:31.520410 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc00a7-7ddf-4c2d-9793-1d00ac2fbfbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:31.522072 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc00a7-7ddf-4c2d-9793-1d00ac2fbfbe service nova] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:31.547412 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 738/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:03:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:03:32.579581 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1328f5-505d-4982-a0ad-78359dddf966 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:32.580119 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1328f5-505d-4982-a0ad-78359dddf966 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:32.580119 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1328f5-505d-4982-a0ad-78359dddf966 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:32.581521 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 697/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 09:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:03:32.586882 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5eab9-96e4-40c4-8d60-109bda659490 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:32.587373 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5eab9-96e4-40c4-8d60-109bda659490 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:32.587521 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5eab9-96e4-40c4-8d60-109bda659490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:32.808685 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-bce5eab9-96e4-40c4-8d60-109bda659490 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:32.809941 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-bce5eab9-96e4-40c4-8d60-109bda659490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:32.863876 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:32.929809 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 739/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 09:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:03:33.095803 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1328f5-505d-4982-a0ad-78359dddf966 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:33.098954 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-8c1328f5-505d-4982-a0ad-78359dddf966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:33.293110 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1328f5-505d-4982-a0ad-78359dddf966 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:33.364171 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:33.450093 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afc6c1-dbb8-49a8-9e9a-482a198482dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:33.451390 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afc6c1-dbb8-49a8-9e9a-482a198482dc service nova] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:33.452393 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afc6c1-dbb8-49a8-9e9a-482a198482dc service nova] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:33.452671 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afc6c1-dbb8-49a8-9e9a-482a198482dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:33.454338 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-b3afc6c1-dbb8-49a8-9e9a-482a198482dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:33.555663 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3afc6c1-dbb8-49a8-9e9a-482a198482dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:33.557239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3afc6c1-dbb8-49a8-9e9a-482a198482dc service nova] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:33.579238 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 698/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:03:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:03:34.477577 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fceeea0-23b5-495b-96ae-e7a16931fa50 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:34.478157 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fceeea0-23b5-495b-96ae-e7a16931fa50 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:34.478157 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fceeea0-23b5-495b-96ae-e7a16931fa50 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:34.479549 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 740/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 09:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:34.485724 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d84122-2d91-442b-b58a-d2b0c3c9de32 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:34.486263 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d84122-2d91-442b-b58a-d2b0c3c9de32 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:34.486368 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d84122-2d91-442b-b58a-d2b0c3c9de32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:34.569395 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-64d84122-2d91-442b-b58a-d2b0c3c9de32 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:34.570542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-64d84122-2d91-442b-b58a-d2b0c3c9de32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:34.572773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:34.677922 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 699/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 09:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:03:34.832952 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fceeea0-23b5-495b-96ae-e7a16931fa50 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:34.834417 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-3fceeea0-23b5-495b-96ae-e7a16931fa50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:34.990033 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fceeea0-23b5-495b-96ae-e7a16931fa50 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:35.016906 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:35.106339 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107ed0a-a3af-4102-a8e8-9b20dc1eea9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:35.107470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107ed0a-a3af-4102-a8e8-9b20dc1eea9a service nova] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:35.107802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107ed0a-a3af-4102-a8e8-9b20dc1eea9a service nova] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:35.108110 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107ed0a-a3af-4102-a8e8-9b20dc1eea9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:35.109825 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-9107ed0a-a3af-4102-a8e8-9b20dc1eea9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:35.207346 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107ed0a-a3af-4102-a8e8-9b20dc1eea9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:35.208989 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107ed0a-a3af-4102-a8e8-9b20dc1eea9a service nova] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:35.229102 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 741/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:03:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:03:37.196421 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dca530-211e-4761-bd44-65d386b9c1c2 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:37.197003 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dca530-211e-4761-bd44-65d386b9c1c2 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:37.197003 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dca530-211e-4761-bd44-65d386b9c1c2 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:37.198317 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 700/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 09:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:37.204007 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d9e0f-a200-4af3-9663-d3a273e053f5 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:37.204525 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d9e0f-a200-4af3-9663-d3a273e053f5 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:37.204688 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d9e0f-a200-4af3-9663-d3a273e053f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:37.247777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:37.273559 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-c24d9e0f-a200-4af3-9663-d3a273e053f5 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:37.274789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-c24d9e0f-a200-4af3-9663-d3a273e053f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:37.390739 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 742/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 09:03:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:03:37.431019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dca530-211e-4761-bd44-65d386b9c1c2 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:37.432594 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-08dca530-211e-4761-bd44-65d386b9c1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:37.545415 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dca530-211e-4761-bd44-65d386b9c1c2 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:37.579169 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:37.624125 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36280290-374e-41f0-a42c-b4efa72b4e23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:37.624792 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36280290-374e-41f0-a42c-b4efa72b4e23 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:37.625076 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36280290-374e-41f0-a42c-b4efa72b4e23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:37.625350 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36280290-374e-41f0-a42c-b4efa72b4e23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:37.626994 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-36280290-374e-41f0-a42c-b4efa72b4e23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:37.743774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36280290-374e-41f0-a42c-b4efa72b4e23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:37.745248 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36280290-374e-41f0-a42c-b4efa72b4e23 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:37.767483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 701/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:03:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:03:40.035529 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69778ad-fde5-4b16-8067-5bc6c837666a None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:40.036086 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69778ad-fde5-4b16-8067-5bc6c837666a None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:40.036086 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69778ad-fde5-4b16-8067-5bc6c837666a None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:40.037458 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 743/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 09:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:40.042843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e16e24-5ca3-4faf-be35-16702c28e054 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:40.043275 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e16e24-5ca3-4faf-be35-16702c28e054 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:40.043389 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e16e24-5ca3-4faf-be35-16702c28e054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:40.113300 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-a0e16e24-5ca3-4faf-be35-16702c28e054 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:40.114521 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-a0e16e24-5ca3-4faf-be35-16702c28e054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:40.129064 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:40.217911 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 702/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 09:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:03:40.256304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69778ad-fde5-4b16-8067-5bc6c837666a None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:40.257836 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-a69778ad-fde5-4b16-8067-5bc6c837666a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:40.371894 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69778ad-fde5-4b16-8067-5bc6c837666a None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:40.385990 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:40.452599 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266af27-5854-4d21-a225-309715d5743d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:40.453250 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266af27-5854-4d21-a225-309715d5743d service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:40.453528 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266af27-5854-4d21-a225-309715d5743d service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:40.453847 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266af27-5854-4d21-a225-309715d5743d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:40.455431 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-f266af27-5854-4d21-a225-309715d5743d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:40.572708 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266af27-5854-4d21-a225-309715d5743d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:40.574146 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266af27-5854-4d21-a225-309715d5743d service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:40.595705 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 744/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:03:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:03:43.086495 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa340727-ff68-4bc2-8ef4-60b56891cdf2 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:43.087088 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa340727-ff68-4bc2-8ef4-60b56891cdf2 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:43.087088 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa340727-ff68-4bc2-8ef4-60b56891cdf2 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:43.088437 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 703/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 09:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:43.095778 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df75b77-5fbd-444d-b92c-e3023c956118 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:43.096411 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df75b77-5fbd-444d-b92c-e3023c956118 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:43.096551 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df75b77-5fbd-444d-b92c-e3023c956118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:43.146156 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:43.165840 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-3df75b77-5fbd-444d-b92c-e3023c956118 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:43.167221 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-3df75b77-5fbd-444d-b92c-e3023c956118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:43.266621 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 745/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 09:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:03:43.312708 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa340727-ff68-4bc2-8ef4-60b56891cdf2 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:43.314267 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-aa340727-ff68-4bc2-8ef4-60b56891cdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:43.429173 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa340727-ff68-4bc2-8ef4-60b56891cdf2 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:43.470454 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:43.506206 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7dea7-a387-463b-81d1-3a24f765ef20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:43.506850 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7dea7-a387-463b-81d1-3a24f765ef20 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:43.507128 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7dea7-a387-463b-81d1-3a24f765ef20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:43.507484 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7dea7-a387-463b-81d1-3a24f765ef20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:43.509222 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-10b7dea7-a387-463b-81d1-3a24f765ef20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:43.625499 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7dea7-a387-463b-81d1-3a24f765ef20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:43.626954 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7dea7-a387-463b-81d1-3a24f765ef20 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:43.646054 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 704/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:03:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:03:45.951528 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302976a8-4063-4f86-adbe-798aa7dbf52f None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:45.952114 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302976a8-4063-4f86-adbe-798aa7dbf52f None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:45.952114 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302976a8-4063-4f86-adbe-798aa7dbf52f None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:45.953535 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 746/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 09:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:45.959075 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c63f7-d374-48ac-b168-c5f0e44822fc None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:45.959530 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c63f7-d374-48ac-b168-c5f0e44822fc None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:45.959624 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c63f7-d374-48ac-b168-c5f0e44822fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:46.030508 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-d76c63f7-d374-48ac-b168-c5f0e44822fc None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:46.031729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-d76c63f7-d374-48ac-b168-c5f0e44822fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:46.053566 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:46.133687 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 705/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 09:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:03:46.176471 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302976a8-4063-4f86-adbe-798aa7dbf52f None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:46.178706 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-302976a8-4063-4f86-adbe-798aa7dbf52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:46.308437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302976a8-4063-4f86-adbe-798aa7dbf52f None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:46.330721 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:46.398025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3b171-6c53-4bb9-9ea8-83a50b89b1c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:46.398756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3b171-6c53-4bb9-9ea8-83a50b89b1c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:46.399043 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3b171-6c53-4bb9-9ea8-83a50b89b1c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:46.399315 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3b171-6c53-4bb9-9ea8-83a50b89b1c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:46.401146 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-add3b171-6c53-4bb9-9ea8-83a50b89b1c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:46.551885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3b171-6c53-4bb9-9ea8-83a50b89b1c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:46.553156 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3b171-6c53-4bb9-9ea8-83a50b89b1c6 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:46.572475 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 747/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:03:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:03:48.996259 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1356dc-8914-46ca-bdf1-f1d84cca7738 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:48.996896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1356dc-8914-46ca-bdf1-f1d84cca7738 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:48.996896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1356dc-8914-46ca-bdf1-f1d84cca7738 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:49.000512 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 706/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 09:03:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:49.007526 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf648eb-09d6-4569-be3a-f0e9d44a3788 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:49.008030 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf648eb-09d6-4569-be3a-f0e9d44a3788 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:49.008190 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf648eb-09d6-4569-be3a-f0e9d44a3788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:49.079037 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:49.081971 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-9cf648eb-09d6-4569-be3a-f0e9d44a3788 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:49.083230 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-9cf648eb-09d6-4569-be3a-f0e9d44a3788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:49.191514 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 748/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 09:03:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:03:49.231663 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1356dc-8914-46ca-bdf1-f1d84cca7738 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:49.233537 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-7c1356dc-8914-46ca-bdf1-f1d84cca7738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:49.345830 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1356dc-8914-46ca-bdf1-f1d84cca7738 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:49.398759 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:49.431515 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e192c-5bdb-4148-b472-e1d656b43af2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:49.432143 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e192c-5bdb-4148-b472-e1d656b43af2 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:49.432453 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e192c-5bdb-4148-b472-e1d656b43af2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:49.432727 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e192c-5bdb-4148-b472-e1d656b43af2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:49.434650 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-999e192c-5bdb-4148-b472-e1d656b43af2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:49.570194 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e192c-5bdb-4148-b472-e1d656b43af2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:49.571588 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e192c-5bdb-4148-b472-e1d656b43af2 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:49.593207 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 707/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:03:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:03:51.790326 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb174c-e915-426f-8d72-084e788e4ec7 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:51.790863 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb174c-e915-426f-8d72-084e788e4ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:51.790863 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb174c-e915-426f-8d72-084e788e4ec7 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:51.792262 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 749/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 09:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:51.798369 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea14d7-093a-47e0-a535-a5a63989855a None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:51.798942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea14d7-093a-47e0-a535-a5a63989855a None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:51.798942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea14d7-093a-47e0-a535-a5a63989855a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:51.870069 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-bbea14d7-093a-47e0-a535-a5a63989855a None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:51.871292 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-bbea14d7-093a-47e0-a535-a5a63989855a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:51.905738 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:51.980317 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 708/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 09:03:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:03:52.019314 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb174c-e915-426f-8d72-084e788e4ec7 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:52.020888 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-a6cb174c-e915-426f-8d72-084e788e4ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:52.131572 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb174c-e915-426f-8d72-084e788e4ec7 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:52.163592 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:52.215906 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc479a-5c45-4040-af46-de8689c9fbc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:52.216701 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc479a-5c45-4040-af46-de8689c9fbc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:52.216992 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc479a-5c45-4040-af46-de8689c9fbc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:52.217285 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc479a-5c45-4040-af46-de8689c9fbc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:52.219001 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-1fbc479a-5c45-4040-af46-de8689c9fbc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:52.348280 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc479a-5c45-4040-af46-de8689c9fbc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:52.349752 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc479a-5c45-4040-af46-de8689c9fbc5 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:52.369772 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 750/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:03:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:03:54.501569 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21027c-2922-4f9e-9bae-4f02b2c76737 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:54.502141 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21027c-2922-4f9e-9bae-4f02b2c76737 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:54.502141 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21027c-2922-4f9e-9bae-4f02b2c76737 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:54.503465 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 709/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 09:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:54.509147 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76868d-631e-4d86-8e7f-9462bae2985c None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:54.509755 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76868d-631e-4d86-8e7f-9462bae2985c None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:54.509755 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76868d-631e-4d86-8e7f-9462bae2985c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:54.587735 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-6e76868d-631e-4d86-8e7f-9462bae2985c None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:54.588897 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-6e76868d-631e-4d86-8e7f-9462bae2985c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:54.598328 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:54.693111 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 751/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 09:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:03:54.733645 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21027c-2922-4f9e-9bae-4f02b2c76737 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:54.735202 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-ff21027c-2922-4f9e-9bae-4f02b2c76737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:54.853683 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21027c-2922-4f9e-9bae-4f02b2c76737 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:54.912462 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:54.933153 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f315d-13c9-418a-9b94-e60ae18dd88d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:54.933783 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f315d-13c9-418a-9b94-e60ae18dd88d service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:54.934688 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f315d-13c9-418a-9b94-e60ae18dd88d service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:54.934964 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f315d-13c9-418a-9b94-e60ae18dd88d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:54.936672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-622f315d-13c9-418a-9b94-e60ae18dd88d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:55.082322 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f315d-13c9-418a-9b94-e60ae18dd88d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:55.083782 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f315d-13c9-418a-9b94-e60ae18dd88d service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:55.105476 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 710/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:03:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:03:57.246346 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2542e-3b2e-43ac-962b-d2cf77240b74 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:57.247024 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2542e-3b2e-43ac-962b-d2cf77240b74 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:57.247024 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2542e-3b2e-43ac-962b-d2cf77240b74 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:57.248375 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 752/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 09:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:57.254027 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f70d7-814d-43a2-a0d9-36d86931aaf0 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:57.254474 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f70d7-814d-43a2-a0d9-36d86931aaf0 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:57.254646 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f70d7-814d-43a2-a0d9-36d86931aaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:57.325569 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-e16f70d7-814d-43a2-a0d9-36d86931aaf0 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:57.326809 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-e16f70d7-814d-43a2-a0d9-36d86931aaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:57.370469 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:57.433710 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 711/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 09:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:03:57.472533 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2542e-3b2e-43ac-962b-d2cf77240b74 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:57.474091 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-23a2542e-3b2e-43ac-962b-d2cf77240b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:57.588000 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2542e-3b2e-43ac-962b-d2cf77240b74 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:57.628670 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:57.670962 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c43820-db97-479f-b6c4-f83c4e4e87b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:57.671600 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c43820-db97-479f-b6c4-f83c4e4e87b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:57.671881 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c43820-db97-479f-b6c4-f83c4e4e87b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:57.672181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c43820-db97-479f-b6c4-f83c4e4e87b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:57.673874 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-56c43820-db97-479f-b6c4-f83c4e4e87b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:57.795095 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c43820-db97-479f-b6c4-f83c4e4e87b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:57.796580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c43820-db97-479f-b6c4-f83c4e4e87b4 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:57.815584 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 753/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:03:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:03:59.977685 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcd83d-7389-44d7-860a-483aee1104d9 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:59.978314 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcd83d-7389-44d7-860a-483aee1104d9 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:59.978314 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcd83d-7389-44d7-860a-483aee1104d9 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:59.979608 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 712/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 09:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:03:59.987298 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055adf4-9eb6-4cfd-8270-da078f8ca6c4 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:59.987862 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055adf4-9eb6-4cfd-8270-da078f8ca6c4 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:59.987862 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055adf4-9eb6-4cfd-8270-da078f8ca6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:00.068603 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-8055adf4-9eb6-4cfd-8270-da078f8ca6c4 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:00.069852 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-8055adf4-9eb6-4cfd-8270-da078f8ca6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:00.088953 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:00.173765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 754/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 09:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:00.212070 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edcd83d-7389-44d7-860a-483aee1104d9 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:00.213629 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-5edcd83d-7389-44d7-860a-483aee1104d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:00.338575 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edcd83d-7389-44d7-860a-483aee1104d9 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:00.415455 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:00.423922 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416bf52-bc88-4d78-8f53-f89560deea22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:00.430040 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416bf52-bc88-4d78-8f53-f89560deea22 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:00.430040 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416bf52-bc88-4d78-8f53-f89560deea22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:00.430040 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416bf52-bc88-4d78-8f53-f89560deea22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:00.430040 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-4416bf52-bc88-4d78-8f53-f89560deea22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:00.545698 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416bf52-bc88-4d78-8f53-f89560deea22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:00.547380 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416bf52-bc88-4d78-8f53-f89560deea22 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:00.566462 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 713/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:04:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:04:02.645929 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd6ca6-0feb-46d4-8d41-5331c452b558 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:02.646534 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd6ca6-0feb-46d4-8d41-5331c452b558 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:02.646534 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd6ca6-0feb-46d4-8d41-5331c452b558 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:02.647835 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 755/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 09:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:02.654006 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42833f3-9334-413d-b0e7-8a885414a54c None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:02.654502 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42833f3-9334-413d-b0e7-8a885414a54c None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:02.654619 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42833f3-9334-413d-b0e7-8a885414a54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:02.723827 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-b42833f3-9334-413d-b0e7-8a885414a54c None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:02.725081 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-b42833f3-9334-413d-b0e7-8a885414a54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:02.782668 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:02.836452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 714/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 09:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:02.875687 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd6ca6-0feb-46d4-8d41-5331c452b558 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:02.877288 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-00dd6ca6-0feb-46d4-8d41-5331c452b558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:02.991752 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd6ca6-0feb-46d4-8d41-5331c452b558 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:03.042711 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:03.071047 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f475abd-b244-49d3-8c5c-d354633cbe8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:03.071683 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f475abd-b244-49d3-8c5c-d354633cbe8e service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:03.071968 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f475abd-b244-49d3-8c5c-d354633cbe8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:03.072274 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f475abd-b244-49d3-8c5c-d354633cbe8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:03.073942 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-2f475abd-b244-49d3-8c5c-d354633cbe8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:03.190992 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f475abd-b244-49d3-8c5c-d354633cbe8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:03.192472 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f475abd-b244-49d3-8c5c-d354633cbe8e service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:03.211951 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 756/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:04:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:04:12.834553 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=22 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:13.209497 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=66 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:23.645385 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797da5f-90bb-4ee5-84d4-5843280e8d29 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:23.645953 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797da5f-90bb-4ee5-84d4-5843280e8d29 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:23.645953 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797da5f-90bb-4ee5-84d4-5843280e8d29 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:23.647340 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 715/1471] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 09:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:23.653973 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15116edd-1441-479d-a3b2-88a737ae50a2 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:23.654486 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15116edd-1441-479d-a3b2-88a737ae50a2 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:23.654593 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15116edd-1441-479d-a3b2-88a737ae50a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:23.724356 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-15116edd-1441-479d-a3b2-88a737ae50a2 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:23.725582 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-15116edd-1441-479d-a3b2-88a737ae50a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:23.824702 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 757/1472] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:04:23.913524 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006df4e2-1425-4568-b1a5-6dc703ecca05 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:23.913900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006df4e2-1425-4568-b1a5-6dc703ecca05 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:23.914091 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006df4e2-1425-4568-b1a5-6dc703ecca05 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:23.915439 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 716/1473] 10.222.0.20 () {54 vars in 966 bytes} [Tue Aug 2 09:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:23.920614 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3ed4d-aeb6-4ded-8521-6f7c23eba5fa None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:23.920899 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3ed4d-aeb6-4ded-8521-6f7c23eba5fa None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:23.921179 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3ed4d-aeb6-4ded-8521-6f7c23eba5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:24.000552 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-65e3ed4d-aeb6-4ded-8521-6f7c23eba5fa None None] MFA Rules not processed for user `bca8afe2c10f4db58716aacfd373504b`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:24.001769 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-65e3ed4d-aeb6-4ded-8521-6f7c23eba5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:24.022925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:24.080741 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 758/1474] 10.222.0.20 () {58 vars in 1063 bytes} [Tue Aug 2 09:04:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:24.088312 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006df4e2-1425-4568-b1a5-6dc703ecca05 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:24.090020 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-006df4e2-1425-4568-b1a5-6dc703ecca05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:24.207173 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006df4e2-1425-4568-b1a5-6dc703ecca05 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:24.288986 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b4393-411c-46f7-9ee5-3e9818a74d7e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca8afe2c10f4db58716aacfd373504b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:24.289618 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b4393-411c-46f7-9ee5-3e9818a74d7e service glance] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:24.289899 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b4393-411c-46f7-9ee5-3e9818a74d7e service glance] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:24.290163 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b4393-411c-46f7-9ee5-3e9818a74d7e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:24.291800 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-e54b4393-411c-46f7-9ee5-3e9818a74d7e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:24.352999 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:24.414084 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b4393-411c-46f7-9ee5-3e9818a74d7e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:24.415595 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b4393-411c-46f7-9ee5-3e9818a74d7e service glance] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:24.438501 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 717/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:04:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:04:26.598380 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6a7c8-731b-47f7-a5a9-771c7689a713 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:26.598931 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6a7c8-731b-47f7-a5a9-771c7689a713 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:26.598931 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6a7c8-731b-47f7-a5a9-771c7689a713 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:26.600326 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 759/1476] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 09:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:26.606334 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f84158-cad9-4074-8a5a-7b33c93c8076 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:26.606795 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f84158-cad9-4074-8a5a-7b33c93c8076 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:26.606906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f84158-cad9-4074-8a5a-7b33c93c8076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:26.676948 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-c0f84158-cad9-4074-8a5a-7b33c93c8076 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:26.678170 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-c0f84158-cad9-4074-8a5a-7b33c93c8076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:26.783782 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 718/1477] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:26.807649 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6a7c8-731b-47f7-a5a9-771c7689a713 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:26.809485 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-27d6a7c8-731b-47f7-a5a9-771c7689a713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:26.948104 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6a7c8-731b-47f7-a5a9-771c7689a713 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:26.999360 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:27.046576 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723089a-bee3-4ad3-b130-28c97d73e801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:27.047204 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723089a-bee3-4ad3-b130-28c97d73e801 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:27.047488 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723089a-bee3-4ad3-b130-28c97d73e801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:27.047760 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723089a-bee3-4ad3-b130-28c97d73e801 admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:27.048500 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723089a-bee3-4ad3-b130-28c97d73e801 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:27.050254 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: WARNING py.warnings [None req-4723089a-bee3-4ad3-b130-28c97d73e801 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:04:27.050254 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: warnings.warn(msg) Aug 02 09:04:27.050254 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: Aug 02 09:04:27.051406 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723089a-bee3-4ad3-b130-28c97d73e801 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:27.071741 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 760/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Aug 2 09:04:26 2022] GET /identity/v3/projects => generated 2553 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:04:29.206765 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fa967-b95b-4a83-bdb2-78e31c66b8eb None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:29.207307 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fa967-b95b-4a83-bdb2-78e31c66b8eb None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:29.207307 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fa967-b95b-4a83-bdb2-78e31c66b8eb None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:29.208713 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 719/1479] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 09:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:29.214343 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe0146-3e3f-405e-961d-978b86672510 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:29.215081 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe0146-3e3f-405e-961d-978b86672510 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:29.215081 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe0146-3e3f-405e-961d-978b86672510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:29.287217 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-8dbe0146-3e3f-405e-961d-978b86672510 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:29.288490 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-8dbe0146-3e3f-405e-961d-978b86672510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:29.395039 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 761/1480] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:29.439967 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5fa967-b95b-4a83-bdb2-78e31c66b8eb None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:29.441519 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-6d5fa967-b95b-4a83-bdb2-78e31c66b8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:29.451749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:29.599085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5fa967-b95b-4a83-bdb2-78e31c66b8eb None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:29.685160 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:29.720428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f5305-b342-40a3-b6e8-b3ba5f4bb244 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:29.721277 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f5305-b342-40a3-b6e8-b3ba5f4bb244 service nova] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:29.721598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f5305-b342-40a3-b6e8-b3ba5f4bb244 service nova] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:29.721883 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f5305-b342-40a3-b6e8-b3ba5f4bb244 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:29.724188 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-3e2f5305-b342-40a3-b6e8-b3ba5f4bb244 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:29.817758 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f5305-b342-40a3-b6e8-b3ba5f4bb244 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:29.819611 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f5305-b342-40a3-b6e8-b3ba5f4bb244 service nova] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:29.837974 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 720/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:04:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:04:32.076911 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30e5e0-e389-42a3-bcf9-3d73096e0a29 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:32.078201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30e5e0-e389-42a3-bcf9-3d73096e0a29 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:32.078201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30e5e0-e389-42a3-bcf9-3d73096e0a29 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:32.078865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 762/1482] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 09:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:32.084670 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e81a2-d8c1-425b-b82b-f6bccd25ad44 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:32.085213 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e81a2-d8c1-425b-b82b-f6bccd25ad44 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:32.085213 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e81a2-d8c1-425b-b82b-f6bccd25ad44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:32.155287 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-2e1e81a2-d8c1-425b-b82b-f6bccd25ad44 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:32.156560 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-2e1e81a2-d8c1-425b-b82b-f6bccd25ad44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:32.206407 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:32.258956 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 721/1483] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:32.297165 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30e5e0-e389-42a3-bcf9-3d73096e0a29 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:32.299215 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-af30e5e0-e389-42a3-bcf9-3d73096e0a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:32.326776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:32.415264 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30e5e0-e389-42a3-bcf9-3d73096e0a29 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:32.501393 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ccd02b-07a9-437a-9e21-96cf7ad2be88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:32.502025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ccd02b-07a9-437a-9e21-96cf7ad2be88 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:32.502306 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ccd02b-07a9-437a-9e21-96cf7ad2be88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:32.502615 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ccd02b-07a9-437a-9e21-96cf7ad2be88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:32.504477 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-54ccd02b-07a9-437a-9e21-96cf7ad2be88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:32.622757 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:32.666020 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ccd02b-07a9-437a-9e21-96cf7ad2be88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:32.668414 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ccd02b-07a9-437a-9e21-96cf7ad2be88 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:32.696603 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 763/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:04:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:04:35.017078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b851833-330a-4cd4-b391-10aceed4215c None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:35.017599 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b851833-330a-4cd4-b391-10aceed4215c None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:35.017599 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b851833-330a-4cd4-b391-10aceed4215c None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:35.018896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 722/1485] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 09:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:35.024383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c51f3f-98ad-4e27-999a-e6a84c2b89a5 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:35.024863 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c51f3f-98ad-4e27-999a-e6a84c2b89a5 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:35.024968 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c51f3f-98ad-4e27-999a-e6a84c2b89a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:35.096674 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-81c51f3f-98ad-4e27-999a-e6a84c2b89a5 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:35.097910 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-81c51f3f-98ad-4e27-999a-e6a84c2b89a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:35.199981 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 764/1486] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:35.239253 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b851833-330a-4cd4-b391-10aceed4215c None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:35.240832 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-1b851833-330a-4cd4-b391-10aceed4215c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:35.359734 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b851833-330a-4cd4-b391-10aceed4215c None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:35.440766 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:35.442850 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a44da-1d72-4ea9-a2fd-8030296900ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:35.443484 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a44da-1d72-4ea9-a2fd-8030296900ec service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:35.443765 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a44da-1d72-4ea9-a2fd-8030296900ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:35.444042 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a44da-1d72-4ea9-a2fd-8030296900ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:35.445907 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-aa8a44da-1d72-4ea9-a2fd-8030296900ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:35.567095 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a44da-1d72-4ea9-a2fd-8030296900ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:35.568479 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a44da-1d72-4ea9-a2fd-8030296900ec service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:35.587559 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 723/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:04:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:04:37.741638 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c1d04-cc27-43a3-a0f3-b1a899a59f2c None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:37.742201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c1d04-cc27-43a3-a0f3-b1a899a59f2c None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:37.742201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c1d04-cc27-43a3-a0f3-b1a899a59f2c None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:37.743609 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 765/1488] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 09:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:37.749868 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d8937-6286-4834-a359-c6c8c1838e3c None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:37.750380 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d8937-6286-4834-a359-c6c8c1838e3c None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:37.750481 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d8937-6286-4834-a359-c6c8c1838e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:37.818155 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-6b1d8937-6286-4834-a359-c6c8c1838e3c None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:37.819359 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-6b1d8937-6286-4834-a359-c6c8c1838e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:37.877374 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:37.925197 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 724/1489] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:04:37.967495 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c1d04-cc27-43a3-a0f3-b1a899a59f2c None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:37.969625 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-f39c1d04-cc27-43a3-a0f3-b1a899a59f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:38.009211 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:38.091214 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c1d04-cc27-43a3-a0f3-b1a899a59f2c None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:38.169292 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227539b6-dde4-42f0-905f-cab207a7ca9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:38.169840 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227539b6-dde4-42f0-905f-cab207a7ca9e service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:38.170125 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227539b6-dde4-42f0-905f-cab207a7ca9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:38.170405 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227539b6-dde4-42f0-905f-cab207a7ca9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:38.172071 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-227539b6-dde4-42f0-905f-cab207a7ca9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:38.258590 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:38.290528 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227539b6-dde4-42f0-905f-cab207a7ca9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:38.292581 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227539b6-dde4-42f0-905f-cab207a7ca9e service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:38.312121 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 766/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:04:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:04:40.895724 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6400b43-c0a9-4d23-b430-c836deb76fdf None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:40.896397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6400b43-c0a9-4d23-b430-c836deb76fdf None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:40.896397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6400b43-c0a9-4d23-b430-c836deb76fdf None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:40.897667 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 725/1491] 10.222.0.20 () {54 vars in 926 bytes} [Tue Aug 2 09:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:40.903948 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85abf8-59e7-4ad9-a879-bafadb77571b None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:40.904490 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85abf8-59e7-4ad9-a879-bafadb77571b None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:40.904599 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85abf8-59e7-4ad9-a879-bafadb77571b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:40.979614 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-3c85abf8-59e7-4ad9-a879-bafadb77571b None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:40.980889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-3c85abf8-59e7-4ad9-a879-bafadb77571b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:41.083839 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 767/1492] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:04:41.124118 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6400b43-c0a9-4d23-b430-c836deb76fdf None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:41.125703 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-f6400b43-c0a9-4d23-b430-c836deb76fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:41.237776 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6400b43-c0a9-4d23-b430-c836deb76fdf None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:41.317840 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd2cb4-199f-4745-9a98-8a486b42d5e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:41.318467 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd2cb4-199f-4745-9a98-8a486b42d5e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:41.318748 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd2cb4-199f-4745-9a98-8a486b42d5e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:41.319070 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd2cb4-199f-4745-9a98-8a486b42d5e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:41.320746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-53dd2cb4-199f-4745-9a98-8a486b42d5e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:41.331073 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:41.446217 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd2cb4-199f-4745-9a98-8a486b42d5e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:41.448268 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd2cb4-199f-4745-9a98-8a486b42d5e1 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:41.467386 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 726/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:04:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:04:51.081972 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=82 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:51.465042 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=50 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:21.878767 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1fc27-a653-4ed3-bb2b-673e2b57d71b None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:21.879470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1fc27-a653-4ed3-bb2b-673e2b57d71b None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:21.879470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1fc27-a653-4ed3-bb2b-673e2b57d71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:21.967330 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-0cf1fc27-a653-4ed3-bb2b-673e2b57d71b None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:06:21.968498 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-0cf1fc27-a653-4ed3-bb2b-673e2b57d71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:22.075540 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 768/1494] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:06:22.084132 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d24eb-b4b0-45a7-9139-0663f7b11c7c None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:22.084696 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d24eb-b4b0-45a7-9139-0663f7b11c7c None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:22.084696 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d24eb-b4b0-45a7-9139-0663f7b11c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:22.105129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-fb7d24eb-b4b0-45a7-9139-0663f7b11c7c None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:06:22.106337 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-fb7d24eb-b4b0-45a7-9139-0663f7b11c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:22.115658 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 727/1495] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:06:22.120455 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1fc27-a653-4ed3-bb2b-673e2b57d71b None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:22.131035 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1fc27-a653-4ed3-bb2b-673e2b57d71b None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:22.135725 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4847c32c-0470-4c09-92af-25d77ca190fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:22.136384 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847c32c-0470-4c09-92af-25d77ca190fe admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:22.136668 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847c32c-0470-4c09-92af-25d77ca190fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:22.137004 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847c32c-0470-4c09-92af-25d77ca190fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:22.137704 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4847c32c-0470-4c09-92af-25d77ca190fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:22.138010 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4847c32c-0470-4c09-92af-25d77ca190fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:22.139024 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: WARNING py.warnings [None req-4847c32c-0470-4c09-92af-25d77ca190fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:06:22.139024 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: warnings.warn(msg) Aug 02 09:06:22.139024 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: Aug 02 09:06:22.139917 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4847c32c-0470-4c09-92af-25d77ca190fe admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:22.152920 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 769/1496] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:06:22.162253 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d24eb-b4b0-45a7-9139-0663f7b11c7c None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:22.172383 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d24eb-b4b0-45a7-9139-0663f7b11c7c None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:22.177216 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9ea75-8785-4fa3-b753-7240c4eb1091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:22.177835 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9ea75-8785-4fa3-b753-7240c4eb1091 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:22.178117 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9ea75-8785-4fa3-b753-7240c4eb1091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:22.178389 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9ea75-8785-4fa3-b753-7240c4eb1091 admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:22.179054 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff9ea75-8785-4fa3-b753-7240c4eb1091 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:22.180901 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: WARNING py.warnings [None req-bff9ea75-8785-4fa3-b753-7240c4eb1091 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:06:22.180901 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: warnings.warn(msg) Aug 02 09:06:22.180901 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: Aug 02 09:06:22.182085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff9ea75-8785-4fa3-b753-7240c4eb1091 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:22.300369 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 728/1497] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:06:22 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:06:22.304925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4847c32c-0470-4c09-92af-25d77ca190fe admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:22.315105 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4847c32c-0470-4c09-92af-25d77ca190fe admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:22.372931 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:22.380816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534a2e5-3d68-443b-ae60-c4ea2db4f0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:22.381456 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534a2e5-3d68-443b-ae60-c4ea2db4f0ea admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:22.381736 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534a2e5-3d68-443b-ae60-c4ea2db4f0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:22.382012 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534a2e5-3d68-443b-ae60-c4ea2db4f0ea admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:22.382703 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534a2e5-3d68-443b-ae60-c4ea2db4f0ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:22.383728 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: WARNING py.warnings [None req-e534a2e5-3d68-443b-ae60-c4ea2db4f0ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:06:22.383728 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: warnings.warn(msg) Aug 02 09:06:22.383728 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: Aug 02 09:06:22.384971 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534a2e5-3d68-443b-ae60-c4ea2db4f0ea admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:22.448133 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 770/1498] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:06:22 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:06:22.452453 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9ea75-8785-4fa3-b753-7240c4eb1091 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:22.463702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9ea75-8785-4fa3-b753-7240c4eb1091 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:22.468726 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2848ef6-541b-4d0c-9b5f-cea38ee6e119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:22.469376 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2848ef6-541b-4d0c-9b5f-cea38ee6e119 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:22.469676 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2848ef6-541b-4d0c-9b5f-cea38ee6e119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:22.469932 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2848ef6-541b-4d0c-9b5f-cea38ee6e119 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:22.470627 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2848ef6-541b-4d0c-9b5f-cea38ee6e119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:22.471641 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: WARNING py.warnings [None req-a2848ef6-541b-4d0c-9b5f-cea38ee6e119 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:06:22.471641 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: warnings.warn(msg) Aug 02 09:06:22.471641 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: Aug 02 09:06:22.472552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2848ef6-541b-4d0c-9b5f-cea38ee6e119 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:22.486400 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 729/1499] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:06:22.490553 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534a2e5-3d68-443b-ae60-c4ea2db4f0ea admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:22.500607 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534a2e5-3d68-443b-ae60-c4ea2db4f0ea admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:22.505983 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24ea11-3c0d-472c-98a6-c0aee8493852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:22.506597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24ea11-3c0d-472c-98a6-c0aee8493852 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:22.506880 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24ea11-3c0d-472c-98a6-c0aee8493852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:22.507157 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24ea11-3c0d-472c-98a6-c0aee8493852 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:22.507859 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d24ea11-3c0d-472c-98a6-c0aee8493852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:22.508915 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: WARNING py.warnings [None req-1d24ea11-3c0d-472c-98a6-c0aee8493852 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:06:22.508915 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: warnings.warn(msg) Aug 02 09:06:22.508915 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: Aug 02 09:06:22.509794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d24ea11-3c0d-472c-98a6-c0aee8493852 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:22.524648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 771/1500] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:06:22.528951 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2848ef6-541b-4d0c-9b5f-cea38ee6e119 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:22.539342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2848ef6-541b-4d0c-9b5f-cea38ee6e119 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:22.543973 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246b479-fae8-4266-835b-c19895553115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:22.544692 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246b479-fae8-4266-835b-c19895553115 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:22.544972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246b479-fae8-4266-835b-c19895553115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:22.545253 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246b479-fae8-4266-835b-c19895553115 admin admin] PATH_INFO: `/v3/projects/c7bfec91f6ff4293a28e7df59b678ffa/users/4eab11fe84fc4c17b12e6dcd7576070e/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:22.561012 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246b479-fae8-4266-835b-c19895553115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7bfec91f6ff4293a28e7df59b678ffa, user_id=4eab11fe84fc4c17b12e6dcd7576070e, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:22.562049 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: WARNING py.warnings [None req-0246b479-fae8-4266-835b-c19895553115 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:06:22.562049 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: warnings.warn(msg) Aug 02 09:06:22.562049 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: Aug 02 09:06:22.564018 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246b479-fae8-4266-835b-c19895553115 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:22.653630 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 730/1501] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:06:22 2022] PUT /identity/v3/projects/c7bfec91f6ff4293a28e7df59b678ffa/users/4eab11fe84fc4c17b12e6dcd7576070e/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:06:22.673497 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776462a-c9a5-48eb-9f00-2539d6d7502c None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:22.673788 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776462a-c9a5-48eb-9f00-2539d6d7502c None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:22.674072 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776462a-c9a5-48eb-9f00-2539d6d7502c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:22.703415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-d776462a-c9a5-48eb-9f00-2539d6d7502c None None] MFA Rules not processed for user `4eab11fe84fc4c17b12e6dcd7576070e`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:06:22.704675 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-d776462a-c9a5-48eb-9f00-2539d6d7502c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:22.770860 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 772/1502] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:06:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:06:22.784298 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8dbf17-afba-4cf2-862d-5b323307475c None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:22.784523 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8dbf17-afba-4cf2-862d-5b323307475c None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:22.784815 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8dbf17-afba-4cf2-862d-5b323307475c None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:22.786397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 731/1503] 10.222.0.20 () {54 vars in 964 bytes} [Tue Aug 2 09:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:06:22.791597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d7e24-c793-496a-9b29-49b7eaa1c242 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:22.791890 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d7e24-c793-496a-9b29-49b7eaa1c242 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:22.792182 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d7e24-c793-496a-9b29-49b7eaa1c242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:22.857703 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-c31d7e24-c793-496a-9b29-49b7eaa1c242 None None] MFA Rules not processed for user `ada53ed554844560843ab84198ac373c`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:06:22.859139 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-c31d7e24-c793-496a-9b29-49b7eaa1c242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:22.938603 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 773/1504] 10.222.0.20 () {58 vars in 1061 bytes} [Tue Aug 2 09:06:22 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:06:22.947100 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8dbf17-afba-4cf2-862d-5b323307475c None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:22.957855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8dbf17-afba-4cf2-862d-5b323307475c None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:22.961545 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81bf74-9463-4998-ac86-31927ffc2a62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:22.962162 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81bf74-9463-4998-ac86-31927ffc2a62 service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:22.962442 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81bf74-9463-4998-ac86-31927ffc2a62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:22.962720 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81bf74-9463-4998-ac86-31927ffc2a62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:22.971941 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81bf74-9463-4998-ac86-31927ffc2a62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:22.973447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81bf74-9463-4998-ac86-31927ffc2a62 service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:22.983220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 732/1505] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:06:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:06:23.029947 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e7df8-22d6-4d80-af08-d22bef1f18ac None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:23.030316 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e7df8-22d6-4d80-af08-d22bef1f18ac None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:23.030755 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e7df8-22d6-4d80-af08-d22bef1f18ac None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:23.034903 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 774/1506] 10.222.0.20 () {52 vars in 830 bytes} [Tue Aug 2 09:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:06:23.035978 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81bf74-9463-4998-ac86-31927ffc2a62 service cinder] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:23.102396 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81bf74-9463-4998-ac86-31927ffc2a62 service cinder] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:23.107492 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2f815-298b-45c2-b9ad-4fd09c617a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:23.108141 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2f815-298b-45c2-b9ad-4fd09c617a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:23.108442 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2f815-298b-45c2-b9ad-4fd09c617a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:23.108736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2f815-298b-45c2-b9ad-4fd09c617a96 admin admin] PATH_INFO: `/v3/users/4eab11fe84fc4c17b12e6dcd7576070e` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:23.109911 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2f815-298b-45c2-b9ad-4fd09c617a96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eab11fe84fc4c17b12e6dcd7576070e)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:23.110968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: WARNING py.warnings [None req-4aa2f815-298b-45c2-b9ad-4fd09c617a96 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:06:23.110968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: warnings.warn(msg) Aug 02 09:06:23.110968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: Aug 02 09:06:23.112220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2f815-298b-45c2-b9ad-4fd09c617a96 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:23.320987 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4aa2f815-298b-45c2-b9ad-4fd09c617a96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eab11fe84fc4c17b12e6dcd7576070e'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:06:23.338501 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4aa2f815-298b-45c2-b9ad-4fd09c617a96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eab11fe84fc4c17b12e6dcd7576070e'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:06:23.339351 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4aa2f815-298b-45c2-b9ad-4fd09c617a96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eab11fe84fc4c17b12e6dcd7576070e'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:06:23.413588 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4aa2f815-298b-45c2-b9ad-4fd09c617a96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eab11fe84fc4c17b12e6dcd7576070e'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:06:23.436146 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:23.438887 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4aa2f815-298b-45c2-b9ad-4fd09c617a96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eab11fe84fc4c17b12e6dcd7576070e'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:06:23.445781 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 733/1507] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:06:23 2022] DELETE /identity/v3/users/4eab11fe84fc4c17b12e6dcd7576070e => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:06:23.450428 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2824206-2b87-4483-9acb-de9a70e16914 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:23.450759 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2824206-2b87-4483-9acb-de9a70e16914 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:23.451036 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2824206-2b87-4483-9acb-de9a70e16914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:23.471240 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-f2824206-2b87-4483-9acb-de9a70e16914 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:06:23.472487 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-f2824206-2b87-4483-9acb-de9a70e16914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:23.482940 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:23.533744 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 775/1508] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:06:23.544411 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2f815-298b-45c2-b9ad-4fd09c617a96 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:23.545874 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-4aa2f815-298b-45c2-b9ad-4fd09c617a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:23.627720 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2f815-298b-45c2-b9ad-4fd09c617a96 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:23.631620 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd11bf-4df8-46f6-9f03-8867bf3469c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:23.632281 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd11bf-4df8-46f6-9f03-8867bf3469c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:23.632568 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd11bf-4df8-46f6-9f03-8867bf3469c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:23.632846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd11bf-4df8-46f6-9f03-8867bf3469c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:23.642315 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd11bf-4df8-46f6-9f03-8867bf3469c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:23.643757 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd11bf-4df8-46f6-9f03-8867bf3469c5 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:23.653965 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 734/1509] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:06:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:06:24.095284 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2824206-2b87-4483-9acb-de9a70e16914 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:24.098348 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-f2824206-2b87-4483-9acb-de9a70e16914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:24.109472 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2824206-2b87-4483-9acb-de9a70e16914 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:24.115260 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7c8ca-c1dd-499b-bd16-127c45326d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:24.116009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7c8ca-c1dd-499b-bd16-127c45326d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:24.116388 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7c8ca-c1dd-499b-bd16-127c45326d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:24.116741 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7c8ca-c1dd-499b-bd16-127c45326d0b admin admin] PATH_INFO: `/v3/projects/c7bfec91f6ff4293a28e7df59b678ffa` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:24.117989 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a7c8ca-c1dd-499b-bd16-127c45326d0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7bfec91f6ff4293a28e7df59b678ffa)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:24.119254 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: WARNING py.warnings [None req-42a7c8ca-c1dd-499b-bd16-127c45326d0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:06:24.119254 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: warnings.warn(msg) Aug 02 09:06:24.119254 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: Aug 02 09:06:24.120702 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a7c8ca-c1dd-499b-bd16-127c45326d0b admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:24.242834 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-42a7c8ca-c1dd-499b-bd16-127c45326d0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7bfec91f6ff4293a28e7df59b678ffa', 'request_id': 'req-42a7c8ca-c1dd-499b-bd16-127c45326d0b'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:06:24.304306 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-42a7c8ca-c1dd-499b-bd16-127c45326d0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7bfec91f6ff4293a28e7df59b678ffa', 'request_id': 'req-42a7c8ca-c1dd-499b-bd16-127c45326d0b'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:06:24.311154 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-42a7c8ca-c1dd-499b-bd16-127c45326d0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7bfec91f6ff4293a28e7df59b678ffa', 'request_id': 'req-42a7c8ca-c1dd-499b-bd16-127c45326d0b'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:06:24.332278 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-42a7c8ca-c1dd-499b-bd16-127c45326d0b admin admin] The token cache is being invalidate because project c7bfec91f6ff4293a28e7df59b678ffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:06:24.332602 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-42a7c8ca-c1dd-499b-bd16-127c45326d0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:06:24.333530 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-42a7c8ca-c1dd-499b-bd16-127c45326d0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:06:24.335156 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 776/1510] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:06:24 2022] DELETE /identity/v3/projects/c7bfec91f6ff4293a28e7df59b678ffa => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:06:33.658864 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:34.328918 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:06.706599 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28bee99-e636-45c7-a080-7cc16aea7fba None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:06.707287 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28bee99-e636-45c7-a080-7cc16aea7fba None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:06.707287 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28bee99-e636-45c7-a080-7cc16aea7fba None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:06.708800 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 735/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 09:08:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:08:06.716061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2c555-99c5-4cbc-8e5a-a68a40f554ac None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:06.716653 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2c555-99c5-4cbc-8e5a-a68a40f554ac None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:06.716653 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2c555-99c5-4cbc-8e5a-a68a40f554ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:06.739640 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-9fa2c555-99c5-4cbc-8e5a-a68a40f554ac None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:08:06.740920 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-9fa2c555-99c5-4cbc-8e5a-a68a40f554ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:08:06.806690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 777/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 09:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:08:06.965447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28bee99-e636-45c7-a080-7cc16aea7fba None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:08:06.967169 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-d28bee99-e636-45c7-a080-7cc16aea7fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:08:07.077333 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28bee99-e636-45c7-a080-7cc16aea7fba None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:08:07.082826 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49691056-111f-4090-8514-a269f68f6d0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:08:07.083452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49691056-111f-4090-8514-a269f68f6d0e service nova] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:07.083735 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49691056-111f-4090-8514-a269f68f6d0e service nova] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:07.084010 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49691056-111f-4090-8514-a269f68f6d0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:07.093149 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49691056-111f-4090-8514-a269f68f6d0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:08:07.094748 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49691056-111f-4090-8514-a269f68f6d0e service nova] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:08:07.105342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 736/1513] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:08:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:08:07.912191 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb115a4c-1d1f-47eb-b754-dda9dd2ec95a None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:07.912767 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb115a4c-1d1f-47eb-b754-dda9dd2ec95a None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:07.912767 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb115a4c-1d1f-47eb-b754-dda9dd2ec95a None None] PATH_INFO: `/v3` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:07.914159 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 778/1514] 10.222.0.75 () {54 vars in 925 bytes} [Tue Aug 2 09:08:07 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:08:07.921024 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750306c6-75fd-4c5c-bbda-928cbd75a606 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:07.923480 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750306c6-75fd-4c5c-bbda-928cbd75a606 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:07.923480 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750306c6-75fd-4c5c-bbda-928cbd75a606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:07.978358 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-750306c6-75fd-4c5c-bbda-928cbd75a606 None None] MFA Rules not processed for user `aa8cac76aa21415d8ab0a2524a7049d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:08:07.979510 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-750306c6-75fd-4c5c-bbda-928cbd75a606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:08:08.000757 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923abc8-fb8f-4ea9-8b09-58e9d68c9a76 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:08.001043 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923abc8-fb8f-4ea9-8b09-58e9d68c9a76 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:08.001400 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923abc8-fb8f-4ea9-8b09-58e9d68c9a76 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:08.002759 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 779/1515] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 09:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:08:08.007692 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f34913-4975-42c9-8f5c-8e10fabb6b4c None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:08.008573 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f34913-4975-42c9-8f5c-8e10fabb6b4c None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:08.008852 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f34913-4975-42c9-8f5c-8e10fabb6b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:08.028501 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-02f34913-4975-42c9-8f5c-8e10fabb6b4c None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:08:08.029728 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-02f34913-4975-42c9-8f5c-8e10fabb6b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:08:08.038026 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 780/1516] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 09:08:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:08:08.053830 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 737/1517] 10.222.0.75 () {58 vars in 1015 bytes} [Tue Aug 2 09:08:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:08:08.204215 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f34913-4975-42c9-8f5c-8e10fabb6b4c None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:08:08.217686 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f34913-4975-42c9-8f5c-8e10fabb6b4c None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:08:08.223313 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073edda-b957-4e8c-9bce-3baf843eddc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:08:08.223942 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073edda-b957-4e8c-9bce-3baf843eddc7 service nova] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:08.224258 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073edda-b957-4e8c-9bce-3baf843eddc7 service nova] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:08.224549 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073edda-b957-4e8c-9bce-3baf843eddc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:08.233352 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073edda-b957-4e8c-9bce-3baf843eddc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:08:08.234866 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073edda-b957-4e8c-9bce-3baf843eddc7 service nova] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:08:08.244734 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 781/1518] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:08:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:08:17.902976 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff6822-4fa8-408e-a187-9601cc451db3 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:17.903501 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff6822-4fa8-408e-a187-9601cc451db3 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:17.903501 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff6822-4fa8-408e-a187-9601cc451db3 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:17.905013 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 738/1519] 10.222.0.20 () {54 vars in 961 bytes} [Tue Aug 2 09:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:08:17.910296 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791a661-76ee-4f6f-b186-b7adcfb2beec None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:17.910806 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791a661-76ee-4f6f-b186-b7adcfb2beec None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:17.910910 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791a661-76ee-4f6f-b186-b7adcfb2beec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:17.932918 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-b791a661-76ee-4f6f-b186-b7adcfb2beec None None] MFA Rules not processed for user `aa8cac76aa21415d8ab0a2524a7049d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:08:17.934133 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-b791a661-76ee-4f6f-b186-b7adcfb2beec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:08:17.942853 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 782/1520] 10.222.0.20 () {58 vars in 1058 bytes} [Tue Aug 2 09:08:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:08:17.950756 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff6822-4fa8-408e-a187-9601cc451db3 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:08:17.965092 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff6822-4fa8-408e-a187-9601cc451db3 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:08:17.970205 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d59c4-4935-408a-a99e-332c1b63c9ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cac76aa21415d8ab0a2524a7049d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:08:17.977604 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d59c4-4935-408a-a99e-332c1b63c9ab service placement] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:17.977604 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d59c4-4935-408a-a99e-332c1b63c9ab service placement] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:17.977604 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d59c4-4935-408a-a99e-332c1b63c9ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:17.980869 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d59c4-4935-408a-a99e-332c1b63c9ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:08:17.982472 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d59c4-4935-408a-a99e-332c1b63c9ab service placement] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:08:17.993179 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 739/1521] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:08:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:08:19.466381 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20639f3f-e79a-4fa9-9888-c44fb60b305c None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:19.466936 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20639f3f-e79a-4fa9-9888-c44fb60b305c None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:19.466936 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20639f3f-e79a-4fa9-9888-c44fb60b305c None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:19.468391 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 783/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 09:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:08:19.473415 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb670a-1daf-4029-b312-5853abc05703 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:19.473860 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb670a-1daf-4029-b312-5853abc05703 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:19.478784 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb670a-1daf-4029-b312-5853abc05703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:19.495187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-27cb670a-1daf-4029-b312-5853abc05703 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:08:19.496455 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-27cb670a-1daf-4029-b312-5853abc05703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:08:19.504548 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 740/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 09:08:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:08:19.667264 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20639f3f-e79a-4fa9-9888-c44fb60b305c None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:08:19.682592 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20639f3f-e79a-4fa9-9888-c44fb60b305c None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:08:19.688276 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69dcbba-b6ec-41e5-9547-7b6baf7a0551 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:08:19.688902 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69dcbba-b6ec-41e5-9547-7b6baf7a0551 service nova] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:19.689188 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69dcbba-b6ec-41e5-9547-7b6baf7a0551 service nova] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:19.689469 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69dcbba-b6ec-41e5-9547-7b6baf7a0551 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:19.698554 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69dcbba-b6ec-41e5-9547-7b6baf7a0551 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:08:19.700094 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69dcbba-b6ec-41e5-9547-7b6baf7a0551 service nova] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:08:19.710083 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 784/1524] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:08:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:08:20.566336 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6880d1-e8fb-44e4-8d39-dd7d51631943 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:20.566852 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6880d1-e8fb-44e4-8d39-dd7d51631943 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:20.566961 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6880d1-e8fb-44e4-8d39-dd7d51631943 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:20.568285 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 741/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 09:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:08:20.573782 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cff71-5a2e-43e0-abe1-22fcd2c92d01 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:20.574240 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cff71-5a2e-43e0-abe1-22fcd2c92d01 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:20.574340 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cff71-5a2e-43e0-abe1-22fcd2c92d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:20.594517 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-9f4cff71-5a2e-43e0-abe1-22fcd2c92d01 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:08:20.595634 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-9f4cff71-5a2e-43e0-abe1-22fcd2c92d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:08:20.603706 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 785/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 09:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:08:20.757897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6880d1-e8fb-44e4-8d39-dd7d51631943 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:08:20.766029 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:20.772675 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6880d1-e8fb-44e4-8d39-dd7d51631943 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:08:20.778004 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442809b-2a05-4dfc-ae12-403cf27a0f6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:08:20.778634 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442809b-2a05-4dfc-ae12-403cf27a0f6c service nova] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:20.778912 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442809b-2a05-4dfc-ae12-403cf27a0f6c service nova] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:20.779181 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442809b-2a05-4dfc-ae12-403cf27a0f6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:20.787991 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442809b-2a05-4dfc-ae12-403cf27a0f6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:08:20.791893 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442809b-2a05-4dfc-ae12-403cf27a0f6c service nova] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:08:20.803652 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 742/1527] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:08:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:08:24.803922 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e141efe-68f0-4432-94a7-4e8cdd27e096 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:24.804509 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e141efe-68f0-4432-94a7-4e8cdd27e096 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:24.804509 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e141efe-68f0-4432-94a7-4e8cdd27e096 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:24.806667 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 786/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 09:08:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:08:24.812184 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917adee-1315-427f-bc30-4881277195c8 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:24.812665 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917adee-1315-427f-bc30-4881277195c8 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:24.812778 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917adee-1315-427f-bc30-4881277195c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:24.833392 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-f917adee-1315-427f-bc30-4881277195c8 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:08:24.838009 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-f917adee-1315-427f-bc30-4881277195c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:08:24.845129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 743/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 09:08:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:08:24.928068 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e141efe-68f0-4432-94a7-4e8cdd27e096 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:08:24.930435 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-0e141efe-68f0-4432-94a7-4e8cdd27e096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:08:24.989479 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e141efe-68f0-4432-94a7-4e8cdd27e096 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:08:24.993608 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1044d-ef40-4577-b317-0f29913848d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:08:24.994290 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1044d-ef40-4577-b317-0f29913848d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:24.994541 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1044d-ef40-4577-b317-0f29913848d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:24.994807 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1044d-ef40-4577-b317-0f29913848d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:25.004241 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1044d-ef40-4577-b317-0f29913848d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:08:25.005690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1044d-ef40-4577-b317-0f29913848d3 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:08:25.016147 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 787/1530] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:08:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:08:27.033730 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616e4ad-c3a3-4652-9ede-f035f3e00127 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:27.034317 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616e4ad-c3a3-4652-9ede-f035f3e00127 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:27.034317 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616e4ad-c3a3-4652-9ede-f035f3e00127 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:27.035669 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 744/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 09:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:08:27.041871 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd850c-51ef-4c03-ae34-348bf9e2f4ba None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:27.042346 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd850c-51ef-4c03-ae34-348bf9e2f4ba None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:27.042469 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd850c-51ef-4c03-ae34-348bf9e2f4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:27.062270 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-8ecd850c-51ef-4c03-ae34-348bf9e2f4ba None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:08:27.063485 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-8ecd850c-51ef-4c03-ae34-348bf9e2f4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:08:27.072033 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 788/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 09:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:08:27.108743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616e4ad-c3a3-4652-9ede-f035f3e00127 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:08:27.120098 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616e4ad-c3a3-4652-9ede-f035f3e00127 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:08:27.123708 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2372c-4a35-411d-a4ea-26899c0dc65b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:08:27.124342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2372c-4a35-411d-a4ea-26899c0dc65b service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:27.124627 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2372c-4a35-411d-a4ea-26899c0dc65b service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:27.124895 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2372c-4a35-411d-a4ea-26899c0dc65b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:27.134902 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2372c-4a35-411d-a4ea-26899c0dc65b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:08:27.136333 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2372c-4a35-411d-a4ea-26899c0dc65b service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:08:27.146328 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 745/1533] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:08:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:08:30.753124 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17bc58-eecd-4a92-96e8-3bbbfcdaacf2 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:30.753804 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17bc58-eecd-4a92-96e8-3bbbfcdaacf2 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:30.753804 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17bc58-eecd-4a92-96e8-3bbbfcdaacf2 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:30.755086 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 789/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 09:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:08:30.760381 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2ea63-5a85-4d77-8ce6-4722152aa972 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:30.760866 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2ea63-5a85-4d77-8ce6-4722152aa972 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:30.761002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2ea63-5a85-4d77-8ce6-4722152aa972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:30.780624 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-29a2ea63-5a85-4d77-8ce6-4722152aa972 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:08:30.781811 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-29a2ea63-5a85-4d77-8ce6-4722152aa972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:08:30.790177 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 746/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 09:08:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:08:31.106931 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17bc58-eecd-4a92-96e8-3bbbfcdaacf2 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:08:31.108685 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-dd17bc58-eecd-4a92-96e8-3bbbfcdaacf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:08:31.169368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17bc58-eecd-4a92-96e8-3bbbfcdaacf2 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:08:31.173032 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49745ae1-c6c9-4d52-8571-33d5c6c0cf6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:08:31.173667 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49745ae1-c6c9-4d52-8571-33d5c6c0cf6c service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:31.173950 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49745ae1-c6c9-4d52-8571-33d5c6c0cf6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:31.174229 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49745ae1-c6c9-4d52-8571-33d5c6c0cf6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:31.183070 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:31.186989 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49745ae1-c6c9-4d52-8571-33d5c6c0cf6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:08:31.188607 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49745ae1-c6c9-4d52-8571-33d5c6c0cf6c service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:08:31.198371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 790/1536] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:08:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:08:33.306717 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dad486-8378-4b7f-aa12-34dd20265188 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:33.307321 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dad486-8378-4b7f-aa12-34dd20265188 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:33.307321 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dad486-8378-4b7f-aa12-34dd20265188 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:33.308676 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 747/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 09:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:08:33.313980 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddba2f-fe3f-410d-baa6-b978ab8c32a6 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:33.314555 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddba2f-fe3f-410d-baa6-b978ab8c32a6 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:33.314555 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddba2f-fe3f-410d-baa6-b978ab8c32a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:33.337049 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-dbddba2f-fe3f-410d-baa6-b978ab8c32a6 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:08:33.338270 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-dbddba2f-fe3f-410d-baa6-b978ab8c32a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:08:33.346319 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 791/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 09:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:08:33.656482 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dad486-8378-4b7f-aa12-34dd20265188 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:08:33.658139 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-40dad486-8378-4b7f-aa12-34dd20265188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:08:33.671600 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dad486-8378-4b7f-aa12-34dd20265188 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:08:33.675189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77ccf4-5f47-4806-874b-1c8c3b7762bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:08:33.675809 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77ccf4-5f47-4806-874b-1c8c3b7762bb service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:08:33.676089 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77ccf4-5f47-4806-874b-1c8c3b7762bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:08:33.676390 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77ccf4-5f47-4806-874b-1c8c3b7762bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:08:33.686937 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77ccf4-5f47-4806-874b-1c8c3b7762bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:08:33.688399 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77ccf4-5f47-4806-874b-1c8c3b7762bb service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:08:33.698678 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 748/1539] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:08:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:08:43.331346 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=6 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:43.693652 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=23 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:09.748538 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b72ae-bd6f-42ef-abeb-6776cfbc544c None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:09.749500 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b72ae-bd6f-42ef-abeb-6776cfbc544c None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:09.749500 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b72ae-bd6f-42ef-abeb-6776cfbc544c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:09.813536 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-8d2b72ae-bd6f-42ef-abeb-6776cfbc544c None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:09.815537 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-8d2b72ae-bd6f-42ef-abeb-6776cfbc544c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:09.841333 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 792/1540] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:10:09.860762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4c281-d3e8-49e6-bc04-59aeeb9a0a1b None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:09.863758 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4c281-d3e8-49e6-bc04-59aeeb9a0a1b None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:09.864609 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4c281-d3e8-49e6-bc04-59aeeb9a0a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:09.934680 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-15a4c281-d3e8-49e6-bc04-59aeeb9a0a1b None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:09.937321 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8d410-044e-437c-9877-06b09ebac6a9 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:09.937929 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8d410-044e-437c-9877-06b09ebac6a9 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:09.938416 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8d410-044e-437c-9877-06b09ebac6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:09.940526 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-15a4c281-d3e8-49e6-bc04-59aeeb9a0a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:09.972293 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 749/1541] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:09.973752 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4c281-d3e8-49e6-bc04-59aeeb9a0a1b None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:09.982040 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-83a8d410-044e-437c-9877-06b09ebac6a9 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:09.983716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-83a8d410-044e-437c-9877-06b09ebac6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:09.997828 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4c281-d3e8-49e6-bc04-59aeeb9a0a1b None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:10.014621 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 793/1542] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:10:10.015703 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad88b8-754a-4439-8e91-2c3eabaa37df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:10.016928 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad88b8-754a-4439-8e91-2c3eabaa37df admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:10.017495 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad88b8-754a-4439-8e91-2c3eabaa37df admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:10.018025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad88b8-754a-4439-8e91-2c3eabaa37df admin admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:10.019149 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad88b8-754a-4439-8e91-2c3eabaa37df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:10:10.019708 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad88b8-754a-4439-8e91-2c3eabaa37df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:10.021240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: WARNING py.warnings [None req-d6ad88b8-754a-4439-8e91-2c3eabaa37df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:10:10.021240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: warnings.warn(msg) Aug 02 09:10:10.021240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: Aug 02 09:10:10.022952 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad88b8-754a-4439-8e91-2c3eabaa37df admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:10.037907 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0513e-d56f-4794-9b28-991f20700ff3 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:10.038652 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0513e-d56f-4794-9b28-991f20700ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:10.039172 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0513e-d56f-4794-9b28-991f20700ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:10.046140 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 750/1543] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:10:10.070822 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-4bb0513e-d56f-4794-9b28-991f20700ff3 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:10.072599 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-4bb0513e-d56f-4794-9b28-991f20700ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:10.081956 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad88b8-754a-4439-8e91-2c3eabaa37df admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:10.096115 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad88b8-754a-4439-8e91-2c3eabaa37df admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:10.101278 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 794/1544] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 02 09:10:10.107252 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b72c78-d1f4-477d-9213-84d371710682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:10.108399 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b72c78-d1f4-477d-9213-84d371710682 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:10.108948 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b72c78-d1f4-477d-9213-84d371710682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:10.109444 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b72c78-d1f4-477d-9213-84d371710682 admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:10.110401 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b72c78-d1f4-477d-9213-84d371710682 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:10.112812 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b72c78-d1f4-477d-9213-84d371710682 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:10.117787 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0513e-d56f-4794-9b28-991f20700ff3 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:10.132564 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0513e-d56f-4794-9b28-991f20700ff3 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:10.145807 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2d2e2-db0e-4df2-8427-a2eceaa6db31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:10.147781 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2d2e2-db0e-4df2-8427-a2eceaa6db31 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:10.151099 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2d2e2-db0e-4df2-8427-a2eceaa6db31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:10.151712 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2d2e2-db0e-4df2-8427-a2eceaa6db31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:10.152890 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2d2e2-db0e-4df2-8427-a2eceaa6db31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:10:10.153512 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2d2e2-db0e-4df2-8427-a2eceaa6db31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:10.155851 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2d2e2-db0e-4df2-8427-a2eceaa6db31 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:10.173205 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 795/1545] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:10:10.183159 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2d2e2-db0e-4df2-8427-a2eceaa6db31 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:10.197040 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2d2e2-db0e-4df2-8427-a2eceaa6db31 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:10.204635 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135f0f0-3be4-4bd9-98a0-f8f987f98edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:10.206042 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135f0f0-3be4-4bd9-98a0-f8f987f98edb admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:10.206620 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135f0f0-3be4-4bd9-98a0-f8f987f98edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:10.207152 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135f0f0-3be4-4bd9-98a0-f8f987f98edb admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:10.208094 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135f0f0-3be4-4bd9-98a0-f8f987f98edb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:10.210137 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: WARNING py.warnings [None req-c135f0f0-3be4-4bd9-98a0-f8f987f98edb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:10:10.210137 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: warnings.warn(msg) Aug 02 09:10:10.210137 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: Aug 02 09:10:10.211848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135f0f0-3be4-4bd9-98a0-f8f987f98edb admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:10.308966 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 751/1546] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:10:10 2022] POST /identity/v3/projects => generated 373 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:10.310369 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e6b36-a9e3-421f-bdd7-90c6d0896225 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:10.310781 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e6b36-a9e3-421f-bdd7-90c6d0896225 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:10.311058 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e6b36-a9e3-421f-bdd7-90c6d0896225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:10.333258 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 796/1547] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:10:10 2022] POST /identity/v3/projects => generated 379 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:10.344204 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7849c25-a46e-41d3-b08b-1d410301769a None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:10.345212 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7849c25-a46e-41d3-b08b-1d410301769a None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:10.345821 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7849c25-a46e-41d3-b08b-1d410301769a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:10.363000 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-d21e6b36-a9e3-421f-bdd7-90c6d0896225 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:10.364884 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-d21e6b36-a9e3-421f-bdd7-90c6d0896225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:10.388662 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-b7849c25-a46e-41d3-b08b-1d410301769a None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:10.390719 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-b7849c25-a46e-41d3-b08b-1d410301769a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:10.545383 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 752/1548] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:10.551063 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e6b36-a9e3-421f-bdd7-90c6d0896225 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:10.561971 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 797/1549] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:10.562883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7849c25-a46e-41d3-b08b-1d410301769a None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:10.575164 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e6b36-a9e3-421f-bdd7-90c6d0896225 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:10.582543 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7849c25-a46e-41d3-b08b-1d410301769a None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:10.587796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0561b-70dc-41d3-a12a-604691c222d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:10.588885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d520603-c0e1-44c0-93b6-8855abc306ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:10.589818 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0561b-70dc-41d3-a12a-604691c222d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:10.590028 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d520603-c0e1-44c0-93b6-8855abc306ed admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:10.590304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d520603-c0e1-44c0-93b6-8855abc306ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:10.590627 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d520603-c0e1-44c0-93b6-8855abc306ed admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:10.591217 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0561b-70dc-41d3-a12a-604691c222d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:10.591506 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d520603-c0e1-44c0-93b6-8855abc306ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:10.592206 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0561b-70dc-41d3-a12a-604691c222d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:10.593660 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d520603-c0e1-44c0-93b6-8855abc306ed admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:10.594467 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0561b-70dc-41d3-a12a-604691c222d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:10.597571 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: WARNING py.warnings [None req-89a0561b-70dc-41d3-a12a-604691c222d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:10:10.597571 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: warnings.warn(msg) Aug 02 09:10:10.597571 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: Aug 02 09:10:10.601459 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0561b-70dc-41d3-a12a-604691c222d0 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:10.668008 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 798/1550] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:10:10 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:10.669975 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be513977-6068-4f3c-9e4c-a8eef242b765 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:10.670264 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be513977-6068-4f3c-9e4c-a8eef242b765 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:10.670583 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be513977-6068-4f3c-9e4c-a8eef242b765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:10.695236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-be513977-6068-4f3c-9e4c-a8eef242b765 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:10.697072 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-be513977-6068-4f3c-9e4c-a8eef242b765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:10.712062 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 799/1551] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:10.715997 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd9e89-4b4f-4755-b2c0-3f4e2ed63ca2 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:10.715997 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd9e89-4b4f-4755-b2c0-3f4e2ed63ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:10.715997 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd9e89-4b4f-4755-b2c0-3f4e2ed63ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:10.716421 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 753/1552] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:10:10 2022] POST /identity/v3/users => generated 287 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:10.716421 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f403af8-13be-4e55-8b92-1ba6a8829142 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:10.716421 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f403af8-13be-4e55-8b92-1ba6a8829142 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:10.716421 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f403af8-13be-4e55-8b92-1ba6a8829142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:10.739941 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-4edd9e89-4b4f-4755-b2c0-3f4e2ed63ca2 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:10.742567 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-4edd9e89-4b4f-4755-b2c0-3f4e2ed63ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:10.745179 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-5f403af8-13be-4e55-8b92-1ba6a8829142 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:10.746595 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-5f403af8-13be-4e55-8b92-1ba6a8829142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:10.753559 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 800/1553] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:10.763565 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d77ad-ba48-49d8-b9cb-191aef7605fb None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:10.763849 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d77ad-ba48-49d8-b9cb-191aef7605fb None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:10.764142 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d77ad-ba48-49d8-b9cb-191aef7605fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:10.765236 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 754/1554] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:10.770372 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96720e-8fbe-4231-a88f-b13d55c222de None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:10.770751 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96720e-8fbe-4231-a88f-b13d55c222de None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:10.770940 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96720e-8fbe-4231-a88f-b13d55c222de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:10.788966 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-be8d77ad-ba48-49d8-b9cb-191aef7605fb None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:10.790436 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-be8d77ad-ba48-49d8-b9cb-191aef7605fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:10.804488 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 801/1555] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:10.804488 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d77ad-ba48-49d8-b9cb-191aef7605fb None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:10.809224 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-cc96720e-8fbe-4231-a88f-b13d55c222de None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:10.811558 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-cc96720e-8fbe-4231-a88f-b13d55c222de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:10.816070 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d77ad-ba48-49d8-b9cb-191aef7605fb None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:10.822615 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87a5e1-a8dd-4405-9ea3-a328eed123ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:10.823277 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87a5e1-a8dd-4405-9ea3-a328eed123ce admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:10.823725 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87a5e1-a8dd-4405-9ea3-a328eed123ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:10.824144 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87a5e1-a8dd-4405-9ea3-a328eed123ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:10.824799 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87a5e1-a8dd-4405-9ea3-a328eed123ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:10.825665 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 755/1556] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:10.827024 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87a5e1-a8dd-4405-9ea3-a328eed123ce admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:10.835083 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b5500-02b6-45ad-907f-30196a15746c None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:10.836154 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b5500-02b6-45ad-907f-30196a15746c None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:10.836750 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b5500-02b6-45ad-907f-30196a15746c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:10.840155 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 802/1557] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:10:10.841361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87a5e1-a8dd-4405-9ea3-a328eed123ce admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:10.853529 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87a5e1-a8dd-4405-9ea3-a328eed123ce admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:10.868249 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-370b5500-02b6-45ad-907f-30196a15746c None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:10.869560 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70b326-bb1a-42bd-85ff-dfb0260e4fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:10.870354 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-370b5500-02b6-45ad-907f-30196a15746c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:10.870657 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70b326-bb1a-42bd-85ff-dfb0260e4fef admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:10.871131 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70b326-bb1a-42bd-85ff-dfb0260e4fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:10.871590 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70b326-bb1a-42bd-85ff-dfb0260e4fef admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:10.872571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70b326-bb1a-42bd-85ff-dfb0260e4fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:10.874974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70b326-bb1a-42bd-85ff-dfb0260e4fef admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:10.889212 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 803/1558] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:10:10.890736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 756/1559] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:10.898970 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83a31a-7268-49b2-beab-0aca2752510d None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:10.898970 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83a31a-7268-49b2-beab-0aca2752510d None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:10.898970 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83a31a-7268-49b2-beab-0aca2752510d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:10.899677 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fc829-e3ac-4aab-8c4d-30655ad97f06 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:10.900260 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fc829-e3ac-4aab-8c4d-30655ad97f06 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:10.900613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fc829-e3ac-4aab-8c4d-30655ad97f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:10.927256 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-252fc829-e3ac-4aab-8c4d-30655ad97f06 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:10.929450 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-252fc829-e3ac-4aab-8c4d-30655ad97f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:10.929818 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-9e83a31a-7268-49b2-beab-0aca2752510d None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:10.931347 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-9e83a31a-7268-49b2-beab-0aca2752510d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:10.941065 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 804/1560] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:10.942074 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fc829-e3ac-4aab-8c4d-30655ad97f06 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:10.947210 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 757/1561] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:10.949938 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83a31a-7268-49b2-beab-0aca2752510d None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:10.957623 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fc829-e3ac-4aab-8c4d-30655ad97f06 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:10.963744 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e810d8-893c-4595-a16e-70a3227c1861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:10.964889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e810d8-893c-4595-a16e-70a3227c1861 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:10.965287 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e810d8-893c-4595-a16e-70a3227c1861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:10.965710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e810d8-893c-4595-a16e-70a3227c1861 admin admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:10.966944 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e810d8-893c-4595-a16e-70a3227c1861 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:10:10.967452 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e810d8-893c-4595-a16e-70a3227c1861 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:10.968850 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83a31a-7268-49b2-beab-0aca2752510d None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:10.970730 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e810d8-893c-4595-a16e-70a3227c1861 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:10.983232 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2dde1-0c79-46d4-bc0a-1be1918cc2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:10.984089 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2dde1-0c79-46d4-bc0a-1be1918cc2ef admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:10.984568 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2dde1-0c79-46d4-bc0a-1be1918cc2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:10.984937 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2dde1-0c79-46d4-bc0a-1be1918cc2ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:10.985857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2dde1-0c79-46d4-bc0a-1be1918cc2ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:10:10.986262 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2dde1-0c79-46d4-bc0a-1be1918cc2ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:10.988338 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2dde1-0c79-46d4-bc0a-1be1918cc2ef admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:10.989192 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 805/1562] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:10:10.991376 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d96364-34e8-495d-8df1-80cac98b0793 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:10.991770 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d96364-34e8-495d-8df1-80cac98b0793 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:10.992068 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d96364-34e8-495d-8df1-80cac98b0793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:11.010877 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 758/1563] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:10:11.016227 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2dde1-0c79-46d4-bc0a-1be1918cc2ef admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:11.016949 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-53d96364-34e8-495d-8df1-80cac98b0793 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:11.018400 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-53d96364-34e8-495d-8df1-80cac98b0793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:11.030000 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 806/1564] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:11.030995 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2dde1-0c79-46d4-bc0a-1be1918cc2ef admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:11.031230 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d96364-34e8-495d-8df1-80cac98b0793 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:11.039342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a356f-702e-4354-9347-c57b934bf21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:11.041651 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a356f-702e-4354-9347-c57b934bf21b admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:11.042208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a356f-702e-4354-9347-c57b934bf21b admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:11.042795 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a356f-702e-4354-9347-c57b934bf21b admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:11.043811 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d96364-34e8-495d-8df1-80cac98b0793 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:11.044317 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a356f-702e-4354-9347-c57b934bf21b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:11.046683 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a356f-702e-4354-9347-c57b934bf21b admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:11.050273 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32c7a8-e31f-4037-9f33-1d283e841cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:11.051277 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32c7a8-e31f-4037-9f33-1d283e841cec admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:11.051741 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32c7a8-e31f-4037-9f33-1d283e841cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:11.052257 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32c7a8-e31f-4037-9f33-1d283e841cec admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:11.054093 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32c7a8-e31f-4037-9f33-1d283e841cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:11.057363 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32c7a8-e31f-4037-9f33-1d283e841cec admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:11.062703 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 759/1565] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:10:11.064367 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ce5d3-a305-4d08-9e46-2b33c9efa9b1 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:11.064658 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ce5d3-a305-4d08-9e46-2b33c9efa9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:11.064941 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ce5d3-a305-4d08-9e46-2b33c9efa9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:11.081403 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 807/1566] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:10:11.081403 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32c7a8-e31f-4037-9f33-1d283e841cec admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:11.090073 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-514ce5d3-a305-4d08-9e46-2b33c9efa9b1 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:11.091332 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-514ce5d3-a305-4d08-9e46-2b33c9efa9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:11.105717 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 760/1567] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:11.105717 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ce5d3-a305-4d08-9e46-2b33c9efa9b1 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:11.106095 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32c7a8-e31f-4037-9f33-1d283e841cec admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:11.114573 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff1262-fe8d-43e1-a4dc-3df7752572a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:11.116110 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff1262-fe8d-43e1-a4dc-3df7752572a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:11.117006 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff1262-fe8d-43e1-a4dc-3df7752572a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:11.117252 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff1262-fe8d-43e1-a4dc-3df7752572a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:11.118414 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff1262-fe8d-43e1-a4dc-3df7752572a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:10:11.118658 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ce5d3-a305-4d08-9e46-2b33c9efa9b1 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:11.118895 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff1262-fe8d-43e1-a4dc-3df7752572a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:11.122376 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff1262-fe8d-43e1-a4dc-3df7752572a9 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:11.124573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2684dbd-747e-493b-b51b-c5dc581a43db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:11.125586 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2684dbd-747e-493b-b51b-c5dc581a43db admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:11.125976 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2684dbd-747e-493b-b51b-c5dc581a43db admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:11.126371 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2684dbd-747e-493b-b51b-c5dc581a43db admin admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:11.128500 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:11.128715 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2684dbd-747e-493b-b51b-c5dc581a43db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:10:11.128715 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2684dbd-747e-493b-b51b-c5dc581a43db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:11.130514 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2684dbd-747e-493b-b51b-c5dc581a43db admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:11.141849 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 808/1568] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:10:11.143196 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff1262-fe8d-43e1-a4dc-3df7752572a9 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:11.154253 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff1262-fe8d-43e1-a4dc-3df7752572a9 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:11.155768 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 761/1569] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:10:11.161510 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd77b9-9342-42f5-a7a2-4f0a9d924721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:11.163336 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd77b9-9342-42f5-a7a2-4f0a9d924721 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:11.163982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd77b9-9342-42f5-a7a2-4f0a9d924721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:11.164631 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd77b9-9342-42f5-a7a2-4f0a9d924721 admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:11.165288 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2684dbd-747e-493b-b51b-c5dc581a43db admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:11.166146 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd77b9-9342-42f5-a7a2-4f0a9d924721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:11.169828 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd77b9-9342-42f5-a7a2-4f0a9d924721 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:11.180210 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2684dbd-747e-493b-b51b-c5dc581a43db admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:11.187762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b57dd0-50cf-49cc-a151-aebfbb3fc6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:11.188469 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b57dd0-50cf-49cc-a151-aebfbb3fc6be admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:11.188975 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b57dd0-50cf-49cc-a151-aebfbb3fc6be admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:11.189147 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b57dd0-50cf-49cc-a151-aebfbb3fc6be admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:11.189810 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b57dd0-50cf-49cc-a151-aebfbb3fc6be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:11.191857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b57dd0-50cf-49cc-a151-aebfbb3fc6be admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:11.308059 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 809/1570] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:10:11 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:11.309919 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd77b9-9342-42f5-a7a2-4f0a9d924721 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:11.318424 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 762/1571] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:10:11 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:11.320057 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b57dd0-50cf-49cc-a151-aebfbb3fc6be admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:11.335344 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:11.386868 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd77b9-9342-42f5-a7a2-4f0a9d924721 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:11.403326 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b57dd0-50cf-49cc-a151-aebfbb3fc6be admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:11.409833 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90246de5-75b8-4871-a3dd-25352e255284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:11.410750 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90246de5-75b8-4871-a3dd-25352e255284 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:11.411492 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90246de5-75b8-4871-a3dd-25352e255284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:11.412084 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90246de5-75b8-4871-a3dd-25352e255284 admin admin] PATH_INFO: `/v3/projects/53df83f23dcf439aae2c867c57df57e0/users/ed8d0b552b03417c9db1f5fc2bef05b2/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:11.432477 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90246de5-75b8-4871-a3dd-25352e255284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53df83f23dcf439aae2c867c57df57e0, user_id=ed8d0b552b03417c9db1f5fc2bef05b2, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:11.435532 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90246de5-75b8-4871-a3dd-25352e255284 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:11.476346 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa08f1f-17c8-4740-949b-faa4992de22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:11.477213 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa08f1f-17c8-4740-949b-faa4992de22f admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:11.477600 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa08f1f-17c8-4740-949b-faa4992de22f admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:11.477966 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa08f1f-17c8-4740-949b-faa4992de22f admin admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:11.478937 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa08f1f-17c8-4740-949b-faa4992de22f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:10:11.479348 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa08f1f-17c8-4740-949b-faa4992de22f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:11.481677 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa08f1f-17c8-4740-949b-faa4992de22f admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:11.502951 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 810/1572] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:10:11.504437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa08f1f-17c8-4740-949b-faa4992de22f admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:11.520062 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa08f1f-17c8-4740-949b-faa4992de22f admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:11.526580 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 763/1573] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:10:11 2022] PUT /identity/v3/projects/53df83f23dcf439aae2c867c57df57e0/users/ed8d0b552b03417c9db1f5fc2bef05b2/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:11.527588 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90246de5-75b8-4871-a3dd-25352e255284 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:11.607693 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a2c40-9d78-4fb4-8f1c-bda481390d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:11.608736 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a2c40-9d78-4fb4-8f1c-bda481390d96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:11.609084 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a2c40-9d78-4fb4-8f1c-bda481390d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:11.609430 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a2c40-9d78-4fb4-8f1c-bda481390d96 admin admin] PATH_INFO: `/v3/projects/6aebbff5d44f4f1ab016e1ca9dbd669d/users/c3a3bc94306141bbbf647b8a5ea484be/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:11.625871 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90246de5-75b8-4871-a3dd-25352e255284 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:11.631566 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1ccb4-af25-4819-bc67-cead6b17bc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:11.632258 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1ccb4-af25-4819-bc67-cead6b17bc8d admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:11.632547 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1ccb4-af25-4819-bc67-cead6b17bc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:11.632822 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1ccb4-af25-4819-bc67-cead6b17bc8d admin admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:11.633540 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1ccb4-af25-4819-bc67-cead6b17bc8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:10:11.633845 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1ccb4-af25-4819-bc67-cead6b17bc8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:11.633992 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a2c40-9d78-4fb4-8f1c-bda481390d96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aebbff5d44f4f1ab016e1ca9dbd669d, user_id=c3a3bc94306141bbbf647b8a5ea484be, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:11.635465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: WARNING py.warnings [None req-cb3a2c40-9d78-4fb4-8f1c-bda481390d96 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:10:11.635465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: warnings.warn(msg) Aug 02 09:10:11.635465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: Aug 02 09:10:11.635860 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1ccb4-af25-4819-bc67-cead6b17bc8d admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:11.638833 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a2c40-9d78-4fb4-8f1c-bda481390d96 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:11.650961 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 764/1574] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:10:11.651829 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1ccb4-af25-4819-bc67-cead6b17bc8d admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:11.668445 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1ccb4-af25-4819-bc67-cead6b17bc8d admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:11.675924 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9c130-8d4b-4e51-9452-4b92d897ef0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:11.676975 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9c130-8d4b-4e51-9452-4b92d897ef0a admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:11.677418 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9c130-8d4b-4e51-9452-4b92d897ef0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:11.678543 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9c130-8d4b-4e51-9452-4b92d897ef0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:11.679659 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9c130-8d4b-4e51-9452-4b92d897ef0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:11.682185 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9c130-8d4b-4e51-9452-4b92d897ef0a admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:11.767083 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:11.773250 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 811/1575] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:10:11 2022] PUT /identity/v3/projects/6aebbff5d44f4f1ab016e1ca9dbd669d/users/c3a3bc94306141bbbf647b8a5ea484be/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:11.774170 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a2c40-9d78-4fb4-8f1c-bda481390d96 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:11.805828 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 765/1576] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:10:11 2022] POST /identity/v3/projects => generated 405 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:11.806779 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9c130-8d4b-4e51-9452-4b92d897ef0a admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:11.848080 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a2c40-9d78-4fb4-8f1c-bda481390d96 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:11.883480 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9c130-8d4b-4e51-9452-4b92d897ef0a admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:11.888907 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e21128-bba6-4437-adf2-2170b16c7691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:11.889559 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e21128-bba6-4437-adf2-2170b16c7691 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:11.889847 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e21128-bba6-4437-adf2-2170b16c7691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:11.890121 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e21128-bba6-4437-adf2-2170b16c7691 admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:11.890857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e21128-bba6-4437-adf2-2170b16c7691 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:11.892912 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e21128-bba6-4437-adf2-2170b16c7691 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:11.905475 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:11.924896 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa0052-31c0-4a07-97f3-ca69abc4d199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:11.925564 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa0052-31c0-4a07-97f3-ca69abc4d199 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:11.925864 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa0052-31c0-4a07-97f3-ca69abc4d199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:11.926141 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa0052-31c0-4a07-97f3-ca69abc4d199 admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:11.926827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa0052-31c0-4a07-97f3-ca69abc4d199 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:11.928878 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa0052-31c0-4a07-97f3-ca69abc4d199 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:12.022374 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 766/1577] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:10:11 2022] POST /identity/v3/users => generated 292 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:12.023430 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e21128-bba6-4437-adf2-2170b16c7691 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:12.034002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e21128-bba6-4437-adf2-2170b16c7691 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:12.040036 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2ea79-82aa-4a77-9d4a-3f4f8704ec5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:12.040875 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2ea79-82aa-4a77-9d4a-3f4f8704ec5d admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:12.041196 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2ea79-82aa-4a77-9d4a-3f4f8704ec5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:12.041489 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2ea79-82aa-4a77-9d4a-3f4f8704ec5d admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:12.042263 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2ea79-82aa-4a77-9d4a-3f4f8704ec5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:12.044406 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2ea79-82aa-4a77-9d4a-3f4f8704ec5d admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:12.056098 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 812/1578] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:10:11 2022] POST /identity/v3/projects => generated 363 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:12.060615 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa0052-31c0-4a07-97f3-ca69abc4d199 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:12.138354 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa0052-31c0-4a07-97f3-ca69abc4d199 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:12.143603 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a567d0-1968-4835-9a38-019e9c06b70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:12.144508 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a567d0-1968-4835-9a38-019e9c06b70e admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:12.145117 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a567d0-1968-4835-9a38-019e9c06b70e admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:12.145285 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a567d0-1968-4835-9a38-019e9c06b70e admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:12.145942 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a567d0-1968-4835-9a38-019e9c06b70e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:12.147996 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a567d0-1968-4835-9a38-019e9c06b70e admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:12.170777 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 767/1579] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:10:12 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:12.172246 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7448ed1-6473-4d81-b313-bf8257298215 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:12.172610 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7448ed1-6473-4d81-b313-bf8257298215 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:12.172952 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7448ed1-6473-4d81-b313-bf8257298215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:12.197149 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-b7448ed1-6473-4d81-b313-bf8257298215 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:12.198425 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-b7448ed1-6473-4d81-b313-bf8257298215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:12.207786 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 768/1580] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:12.208708 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7448ed1-6473-4d81-b313-bf8257298215 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:12.219624 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7448ed1-6473-4d81-b313-bf8257298215 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:12.224657 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a693c-4801-4cfc-8393-e5236590c404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:12.225582 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a693c-4801-4cfc-8393-e5236590c404 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:12.225725 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a693c-4801-4cfc-8393-e5236590c404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:12.225962 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a693c-4801-4cfc-8393-e5236590c404 admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:12.226698 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a693c-4801-4cfc-8393-e5236590c404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:12.228718 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a693c-4801-4cfc-8393-e5236590c404 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:12.288862 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 813/1581] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:10:12 2022] POST /identity/v3/projects => generated 393 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:12.292786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef8291-c163-4239-b654-2c0646205a3a None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:12.292786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef8291-c163-4239-b654-2c0646205a3a None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:12.292786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef8291-c163-4239-b654-2c0646205a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:12.323795 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-e4ef8291-c163-4239-b654-2c0646205a3a None None] MFA Rules not processed for user `c3a3bc94306141bbbf647b8a5ea484be`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:12.325130 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-e4ef8291-c163-4239-b654-2c0646205a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:12.329869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:12.418004 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 814/1582] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:12.418270 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef8291-c163-4239-b654-2c0646205a3a None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:12.429101 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 769/1583] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:10:12 2022] POST /identity/v3/projects => generated 389 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:12.436246 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a693c-4801-4cfc-8393-e5236590c404 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:12.511637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef8291-c163-4239-b654-2c0646205a3a None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:12.550465 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a693c-4801-4cfc-8393-e5236590c404 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:12.558266 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b637594-c15f-42c1-8aea-df11aa09a2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:12.559537 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b637594-c15f-42c1-8aea-df11aa09a2fc admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:12.559992 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b637594-c15f-42c1-8aea-df11aa09a2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:12.560391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b637594-c15f-42c1-8aea-df11aa09a2fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:12.561245 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b637594-c15f-42c1-8aea-df11aa09a2fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:12.563375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b637594-c15f-42c1-8aea-df11aa09a2fc admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:12.582693 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 770/1584] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:10:12.582693 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b637594-c15f-42c1-8aea-df11aa09a2fc admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:12.592500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b637594-c15f-42c1-8aea-df11aa09a2fc admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:12.598301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e773d4-c685-4ca1-921e-10a08b6ac541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:12.599045 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e773d4-c685-4ca1-921e-10a08b6ac541 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:12.599903 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e773d4-c685-4ca1-921e-10a08b6ac541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:12.601218 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e773d4-c685-4ca1-921e-10a08b6ac541 admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:12.602008 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e773d4-c685-4ca1-921e-10a08b6ac541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:12.602259 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be0d9d-98b3-4aab-9d17-7c9172ee3501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:12.603589 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be0d9d-98b3-4aab-9d17-7c9172ee3501 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:12.604083 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be0d9d-98b3-4aab-9d17-7c9172ee3501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:12.604507 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e773d4-c685-4ca1-921e-10a08b6ac541 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:12.604623 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be0d9d-98b3-4aab-9d17-7c9172ee3501 admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:12.605910 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be0d9d-98b3-4aab-9d17-7c9172ee3501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:12.609780 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be0d9d-98b3-4aab-9d17-7c9172ee3501 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:12.781257 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 771/1585] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:10:12 2022] POST /identity/v3/users => generated 282 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:12.782771 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e773d4-c685-4ca1-921e-10a08b6ac541 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:12.796606 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e773d4-c685-4ca1-921e-10a08b6ac541 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:12.801804 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636296ef-6698-45a2-a43e-3b4cda919d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:12.802439 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636296ef-6698-45a2-a43e-3b4cda919d9c admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:12.803302 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636296ef-6698-45a2-a43e-3b4cda919d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:12.803757 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636296ef-6698-45a2-a43e-3b4cda919d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:12.804800 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636296ef-6698-45a2-a43e-3b4cda919d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:12.806685 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636296ef-6698-45a2-a43e-3b4cda919d9c admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:12.818556 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 772/1586] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:10:12.819693 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636296ef-6698-45a2-a43e-3b4cda919d9c admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:12.831829 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 815/1587] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:10:12 2022] POST /identity/v3/users => generated 303 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:12.833378 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be0d9d-98b3-4aab-9d17-7c9172ee3501 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:12.852556 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be0d9d-98b3-4aab-9d17-7c9172ee3501 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:12.860575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16bc44-4d4e-48dc-a5b9-e46d641552c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:12.861569 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16bc44-4d4e-48dc-a5b9-e46d641552c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:12.863797 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16bc44-4d4e-48dc-a5b9-e46d641552c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:12.863797 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16bc44-4d4e-48dc-a5b9-e46d641552c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:12.863797 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd16bc44-4d4e-48dc-a5b9-e46d641552c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:12.868752 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd16bc44-4d4e-48dc-a5b9-e46d641552c5 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:12.903515 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636296ef-6698-45a2-a43e-3b4cda919d9c admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:12.911158 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11c9e0-3a42-4b48-b1b6-feb702eae6e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:12.912375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11c9e0-3a42-4b48-b1b6-feb702eae6e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:12.912880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11c9e0-3a42-4b48-b1b6-feb702eae6e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:12.913354 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11c9e0-3a42-4b48-b1b6-feb702eae6e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:12.934999 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11c9e0-3a42-4b48-b1b6-feb702eae6e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:12.938294 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11c9e0-3a42-4b48-b1b6-feb702eae6e1 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:12.959606 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 773/1588] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:10:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:10:12.964917 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 816/1589] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:10:12 2022] POST /identity/v3/users => generated 297 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:12.965279 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11c9e0-3a42-4b48-b1b6-feb702eae6e1 service neutron] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:12.972408 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16bc44-4d4e-48dc-a5b9-e46d641552c5 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:12.980500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11c9e0-3a42-4b48-b1b6-feb702eae6e1 service neutron] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:12.984655 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16bc44-4d4e-48dc-a5b9-e46d641552c5 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:12.989349 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d492ff4-e6bb-4f0b-a427-9b3b2fc388e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:12.991725 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d492ff4-e6bb-4f0b-a427-9b3b2fc388e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:12.992343 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d492ff4-e6bb-4f0b-a427-9b3b2fc388e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:12.998594 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d492ff4-e6bb-4f0b-a427-9b3b2fc388e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:12.998816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234786ca-cd66-4f33-a11b-93811bcb29a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:12.999000 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d492ff4-e6bb-4f0b-a427-9b3b2fc388e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:12.999187 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234786ca-cd66-4f33-a11b-93811bcb29a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:12.999187 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234786ca-cd66-4f33-a11b-93811bcb29a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:12.999187 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234786ca-cd66-4f33-a11b-93811bcb29a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:12.999187 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234786ca-cd66-4f33-a11b-93811bcb29a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:12.999667 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d492ff4-e6bb-4f0b-a427-9b3b2fc388e4 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:13.000867 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234786ca-cd66-4f33-a11b-93811bcb29a9 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:13.028273 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:INSERT=9,keystone:SELECT=91 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:13.131516 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 774/1590] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:10:12 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:13.132286 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 817/1591] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:10:12 2022] POST /identity/v3/users => generated 295 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:13.133251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d492ff4-e6bb-4f0b-a427-9b3b2fc388e4 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:13.139330 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234786ca-cd66-4f33-a11b-93811bcb29a9 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:13.159085 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234786ca-cd66-4f33-a11b-93811bcb29a9 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:13.168777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:13.239175 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d492ff4-e6bb-4f0b-a427-9b3b2fc388e4 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:13.245534 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e53aad-0ab7-4be3-8267-3d80697e2645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:13.246564 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e53aad-0ab7-4be3-8267-3d80697e2645 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:13.247191 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e53aad-0ab7-4be3-8267-3d80697e2645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:13.247534 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e53aad-0ab7-4be3-8267-3d80697e2645 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:13.248480 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e53aad-0ab7-4be3-8267-3d80697e2645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:13.250563 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e53aad-0ab7-4be3-8267-3d80697e2645 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:13.260810 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1186c-fa9d-4de1-be67-c5ef09625925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:13.261911 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1186c-fa9d-4de1-be67-c5ef09625925 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:13.262418 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1186c-fa9d-4de1-be67-c5ef09625925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:13.262904 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1186c-fa9d-4de1-be67-c5ef09625925 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:13.263925 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 775/1592] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:10:13.264147 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1186c-fa9d-4de1-be67-c5ef09625925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:13.264901 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e53aad-0ab7-4be3-8267-3d80697e2645 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:13.267343 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1186c-fa9d-4de1-be67-c5ef09625925 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:13.276993 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e53aad-0ab7-4be3-8267-3d80697e2645 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:13.289794 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0a4e3-03bd-4369-a786-f74260ce3622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:13.289794 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0a4e3-03bd-4369-a786-f74260ce3622 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:13.289794 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0a4e3-03bd-4369-a786-f74260ce3622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:13.289794 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0a4e3-03bd-4369-a786-f74260ce3622 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:13.290824 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0a4e3-03bd-4369-a786-f74260ce3622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:13.291001 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 818/1593] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:10:13.292636 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1186c-fa9d-4de1-be67-c5ef09625925 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:13.294591 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0a4e3-03bd-4369-a786-f74260ce3622 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:13.310080 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 776/1594] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:10:13.311056 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0a4e3-03bd-4369-a786-f74260ce3622 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:13.312857 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1186c-fa9d-4de1-be67-c5ef09625925 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:13.323258 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec0365-56b5-4d99-9a79-2b6f9a74a52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:13.324113 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec0365-56b5-4d99-9a79-2b6f9a74a52e admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:13.324683 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec0365-56b5-4d99-9a79-2b6f9a74a52e admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:13.325216 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec0365-56b5-4d99-9a79-2b6f9a74a52e admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:13.326558 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec0365-56b5-4d99-9a79-2b6f9a74a52e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:13.329626 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0a4e3-03bd-4369-a786-f74260ce3622 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:13.329945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec0365-56b5-4d99-9a79-2b6f9a74a52e admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:13.340560 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f445f-eced-4f13-ba63-6a9acf5c7f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:13.340560 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f445f-eced-4f13-ba63-6a9acf5c7f23 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:13.340560 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f445f-eced-4f13-ba63-6a9acf5c7f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:13.340560 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f445f-eced-4f13-ba63-6a9acf5c7f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:13.341095 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f445f-eced-4f13-ba63-6a9acf5c7f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:13.342477 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f445f-eced-4f13-ba63-6a9acf5c7f23 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:13.359779 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 819/1595] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:10:13.360047 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 777/1596] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:10:13.360047 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f445f-eced-4f13-ba63-6a9acf5c7f23 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:13.360691 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec0365-56b5-4d99-9a79-2b6f9a74a52e admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:13.373437 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f445f-eced-4f13-ba63-6a9acf5c7f23 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:13.382754 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6e174-37be-42a4-a04e-74c9ff683e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:13.384589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6e174-37be-42a4-a04e-74c9ff683e2b admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:13.385837 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6e174-37be-42a4-a04e-74c9ff683e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:13.386645 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6e174-37be-42a4-a04e-74c9ff683e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:13.387661 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec0365-56b5-4d99-9a79-2b6f9a74a52e admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:13.388546 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6e174-37be-42a4-a04e-74c9ff683e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:13.391946 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6e174-37be-42a4-a04e-74c9ff683e2b admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:13.397399 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396bfa5-a93b-4977-b920-cacb6701dfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:13.398387 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396bfa5-a93b-4977-b920-cacb6701dfe1 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:13.398867 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396bfa5-a93b-4977-b920-cacb6701dfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:13.399409 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396bfa5-a93b-4977-b920-cacb6701dfe1 admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:13.400702 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396bfa5-a93b-4977-b920-cacb6701dfe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:13.406133 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396bfa5-a93b-4977-b920-cacb6701dfe1 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:13.414088 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 778/1597] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:10:13.414088 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6e174-37be-42a4-a04e-74c9ff683e2b admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:13.427272 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6e174-37be-42a4-a04e-74c9ff683e2b admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:13.434577 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ec9f2-5e5b-4131-ad36-a767722311b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:13.438899 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ec9f2-5e5b-4131-ad36-a767722311b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:13.438899 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ec9f2-5e5b-4131-ad36-a767722311b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:13.438899 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ec9f2-5e5b-4131-ad36-a767722311b5 admin admin] PATH_INFO: `/v3/projects/6face5ff38704f6fb2b2c17eeeaea1b8/users/5fc3c9af90504357b9f09ca0ebeb4bcc/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:13.455325 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ec9f2-5e5b-4131-ad36-a767722311b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6face5ff38704f6fb2b2c17eeeaea1b8, user_id=5fc3c9af90504357b9f09ca0ebeb4bcc, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:13.458235 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ec9f2-5e5b-4131-ad36-a767722311b5 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:13.509528 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 820/1598] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:10:13 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:13.511478 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396bfa5-a93b-4977-b920-cacb6701dfe1 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:13.527134 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396bfa5-a93b-4977-b920-cacb6701dfe1 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:13.539008 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 779/1599] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:10:13 2022] PUT /identity/v3/projects/6face5ff38704f6fb2b2c17eeeaea1b8/users/5fc3c9af90504357b9f09ca0ebeb4bcc/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:13.540115 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ec9f2-5e5b-4131-ad36-a767722311b5 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:13.642737 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179523e-20ed-4206-ae18-eef999a67063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:13.643639 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179523e-20ed-4206-ae18-eef999a67063 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:13.644145 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179523e-20ed-4206-ae18-eef999a67063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:13.645359 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179523e-20ed-4206-ae18-eef999a67063 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:13.646083 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f179523e-20ed-4206-ae18-eef999a67063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:13.650131 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f179523e-20ed-4206-ae18-eef999a67063 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:13.651647 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ec9f2-5e5b-4131-ad36-a767722311b5 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:13.660451 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ea682-cdee-4651-a7f4-0bd79c6dfef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:13.663279 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ea682-cdee-4651-a7f4-0bd79c6dfef9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:13.663834 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ea682-cdee-4651-a7f4-0bd79c6dfef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:13.664298 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ea682-cdee-4651-a7f4-0bd79c6dfef9 admin admin] PATH_INFO: `/v3/projects/b6fc6b07497a48eeb263b3a9b8aa7499/users/ad3a9141e9284bb5a096fb04d3e9d581/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:13.671840 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 821/1600] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:10:13.673191 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179523e-20ed-4206-ae18-eef999a67063 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:13.691528 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179523e-20ed-4206-ae18-eef999a67063 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:13.694666 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ea682-cdee-4651-a7f4-0bd79c6dfef9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6fc6b07497a48eeb263b3a9b8aa7499, user_id=ad3a9141e9284bb5a096fb04d3e9d581, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:13.701005 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ea682-cdee-4651-a7f4-0bd79c6dfef9 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:13.708057 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1e273-27a4-468b-826f-f8ca686bc40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:13.710271 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1e273-27a4-468b-826f-f8ca686bc40a admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:13.710699 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1e273-27a4-468b-826f-f8ca686bc40a admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:13.711160 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1e273-27a4-468b-826f-f8ca686bc40a admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:13.712461 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a1e273-27a4-468b-826f-f8ca686bc40a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:13.716357 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a1e273-27a4-468b-826f-f8ca686bc40a admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:13.734596 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 822/1601] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:10:13.745620 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1e273-27a4-468b-826f-f8ca686bc40a admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:13.750757 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1e273-27a4-468b-826f-f8ca686bc40a admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:13.756645 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12c4b6-cd7d-449d-962e-9ae409479145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:13.757348 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12c4b6-cd7d-449d-962e-9ae409479145 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:13.757629 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12c4b6-cd7d-449d-962e-9ae409479145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:13.757903 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12c4b6-cd7d-449d-962e-9ae409479145 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:13.758640 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b12c4b6-cd7d-449d-962e-9ae409479145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:13.760612 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b12c4b6-cd7d-449d-962e-9ae409479145 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:13.774792 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 823/1602] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:10:13.775760 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12c4b6-cd7d-449d-962e-9ae409479145 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:13.796840 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12c4b6-cd7d-449d-962e-9ae409479145 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:13.802398 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 780/1603] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:10:13 2022] PUT /identity/v3/projects/b6fc6b07497a48eeb263b3a9b8aa7499/users/ad3a9141e9284bb5a096fb04d3e9d581/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:13.802398 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ea682-cdee-4651-a7f4-0bd79c6dfef9 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:13.838147 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:13.914818 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:13.930303 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ea682-cdee-4651-a7f4-0bd79c6dfef9 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:13.933812 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea923a45-f533-44d3-bc89-8b2aeda1c012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:13.934866 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea923a45-f533-44d3-bc89-8b2aeda1c012 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:13.935400 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea923a45-f533-44d3-bc89-8b2aeda1c012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:13.935771 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea923a45-f533-44d3-bc89-8b2aeda1c012 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:13.937041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea923a45-f533-44d3-bc89-8b2aeda1c012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:13.938066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16579066-3ae8-4b63-9eb2-096abd475104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:13.939052 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16579066-3ae8-4b63-9eb2-096abd475104 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:13.939587 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16579066-3ae8-4b63-9eb2-096abd475104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:13.939982 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16579066-3ae8-4b63-9eb2-096abd475104 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:13.940288 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea923a45-f533-44d3-bc89-8b2aeda1c012 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:13.941145 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16579066-3ae8-4b63-9eb2-096abd475104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:13.944837 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16579066-3ae8-4b63-9eb2-096abd475104 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:13.959210 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 824/1604] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:10:13.961479 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63afd39-7761-4269-b032-b3ed6ef7171b None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:13.968094 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63afd39-7761-4269-b032-b3ed6ef7171b None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:13.968094 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63afd39-7761-4269-b032-b3ed6ef7171b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:13.968425 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 781/1605] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:10:13.968425 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16579066-3ae8-4b63-9eb2-096abd475104 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:13.982362 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16579066-3ae8-4b63-9eb2-096abd475104 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:13.991185 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e67a9-edde-451b-885e-70662ee2161c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:13.992033 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e67a9-edde-451b-885e-70662ee2161c admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:13.992395 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e67a9-edde-451b-885e-70662ee2161c admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:13.992663 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e67a9-edde-451b-885e-70662ee2161c admin admin] PATH_INFO: `/v3/projects/bab2c49640f74c1b9d89ea3e0d13fef8/users/cf14201629d84d8a8cc942ee0d1c6a8e/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:14.004262 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-f63afd39-7761-4269-b032-b3ed6ef7171b None None] MFA Rules not processed for user `5fc3c9af90504357b9f09ca0ebeb4bcc`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:14.006946 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-f63afd39-7761-4269-b032-b3ed6ef7171b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:14.016368 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e67a9-edde-451b-885e-70662ee2161c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bab2c49640f74c1b9d89ea3e0d13fef8, user_id=cf14201629d84d8a8cc942ee0d1c6a8e, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:14.023559 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e67a9-edde-451b-885e-70662ee2161c admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:14.139894 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 782/1606] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:10:13 2022] PUT /identity/v3/projects/bab2c49640f74c1b9d89ea3e0d13fef8/users/cf14201629d84d8a8cc942ee0d1c6a8e/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:14.142557 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e67a9-edde-451b-885e-70662ee2161c admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:14.177229 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 825/1607] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:14.185855 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63afd39-7761-4269-b032-b3ed6ef7171b None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:14.212526 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63afd39-7761-4269-b032-b3ed6ef7171b None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:14.296189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e67a9-edde-451b-885e-70662ee2161c admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:14.304453 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a1e94-6a16-4a7b-84f1-4b03483173a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:14.305398 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a1e94-6a16-4a7b-84f1-4b03483173a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:14.305920 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a1e94-6a16-4a7b-84f1-4b03483173a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:14.306329 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a1e94-6a16-4a7b-84f1-4b03483173a2 admin admin] PATH_INFO: `/v3/projects/42708d8a3f8e4e1a944ca3a90bba8c60/users/1bbae5bbacb447bfa4a65fc40b1be1ed/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:14.327441 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a1e94-6a16-4a7b-84f1-4b03483173a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42708d8a3f8e4e1a944ca3a90bba8c60, user_id=1bbae5bbacb447bfa4a65fc40b1be1ed, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:14.335024 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a1e94-6a16-4a7b-84f1-4b03483173a2 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:14.337202 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf83bb0-5eae-4b5b-a80f-269ef651af48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:14.337918 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf83bb0-5eae-4b5b-a80f-269ef651af48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:14.338255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf83bb0-5eae-4b5b-a80f-269ef651af48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:14.338599 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf83bb0-5eae-4b5b-a80f-269ef651af48 admin admin] PATH_INFO: `/v3/projects/5b01727cea94442bb62b56e7a4ae57a0/users/1eda94767d1547fa82f6407a4c7de1d8/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:14.359455 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf83bb0-5eae-4b5b-a80f-269ef651af48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b01727cea94442bb62b56e7a4ae57a0, user_id=1eda94767d1547fa82f6407a4c7de1d8, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:14.363014 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf83bb0-5eae-4b5b-a80f-269ef651af48 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:14.421858 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 783/1608] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:10:14 2022] PUT /identity/v3/projects/42708d8a3f8e4e1a944ca3a90bba8c60/users/1bbae5bbacb447bfa4a65fc40b1be1ed/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:14.423341 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd47563-c4b4-48c4-8f3b-fb07ad060fe1 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:14.423628 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd47563-c4b4-48c4-8f3b-fb07ad060fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:14.423903 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd47563-c4b4-48c4-8f3b-fb07ad060fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:14.455999 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 826/1609] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:10:14 2022] PUT /identity/v3/projects/5b01727cea94442bb62b56e7a4ae57a0/users/1eda94767d1547fa82f6407a4c7de1d8/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:14.457291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf83bb0-5eae-4b5b-a80f-269ef651af48 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:14.469857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-ddd47563-c4b4-48c4-8f3b-fb07ad060fe1 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:14.471539 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-ddd47563-c4b4-48c4-8f3b-fb07ad060fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:14.579949 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:14.586142 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf83bb0-5eae-4b5b-a80f-269ef651af48 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:14.591887 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e0f92-eef3-46bf-b993-295ba3c3cf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:14.592933 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e0f92-eef3-46bf-b993-295ba3c3cf23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:14.593352 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e0f92-eef3-46bf-b993-295ba3c3cf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:14.593732 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e0f92-eef3-46bf-b993-295ba3c3cf23 admin admin] PATH_INFO: `/v3/projects/06061d6914ac4b86841d45162ceeb89f/users/4a1a40ef55434cd48a2dc4385880fe0b/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:14.596750 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 784/1610] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:14.598282 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd47563-c4b4-48c4-8f3b-fb07ad060fe1 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:14.614875 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd47563-c4b4-48c4-8f3b-fb07ad060fe1 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:14.621363 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e0f92-eef3-46bf-b993-295ba3c3cf23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06061d6914ac4b86841d45162ceeb89f, user_id=4a1a40ef55434cd48a2dc4385880fe0b, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:14.621658 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d865a-78fb-4328-b37d-6da180c82e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:14.622527 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d865a-78fb-4328-b37d-6da180c82e27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:14.622830 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d865a-78fb-4328-b37d-6da180c82e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:14.623042 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d865a-78fb-4328-b37d-6da180c82e27 admin admin] PATH_INFO: `/v3/projects/908db5b092354c188989905463a2c592/users/7c49c642e5294ca2944d9ffbd36a015b/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:14.625408 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e0f92-eef3-46bf-b993-295ba3c3cf23 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:14.638562 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:14.643442 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d865a-78fb-4328-b37d-6da180c82e27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=908db5b092354c188989905463a2c592, user_id=7c49c642e5294ca2944d9ffbd36a015b, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:14.646264 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d865a-78fb-4328-b37d-6da180c82e27 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:14.781233 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 827/1611] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:10:14 2022] PUT /identity/v3/projects/06061d6914ac4b86841d45162ceeb89f/users/4a1a40ef55434cd48a2dc4385880fe0b/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:14.785642 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e139cf-643a-44c5-a2cc-b1c96e7f1e6a None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:14.785642 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e139cf-643a-44c5-a2cc-b1c96e7f1e6a None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:14.785642 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e139cf-643a-44c5-a2cc-b1c96e7f1e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:14.822852 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 785/1612] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:10:14 2022] PUT /identity/v3/projects/908db5b092354c188989905463a2c592/users/7c49c642e5294ca2944d9ffbd36a015b/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:14.826003 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f2781-d8c6-4bd0-88ed-ec0dcec70b29 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:14.827737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f2781-d8c6-4bd0-88ed-ec0dcec70b29 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:14.828449 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f2781-d8c6-4bd0-88ed-ec0dcec70b29 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:14.838743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 786/1613] 10.222.0.20 () {54 vars in 962 bytes} [Tue Aug 2 09:10:14 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:10:14.841160 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea092123-744a-4345-99c9-d7e775a53bc2 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:14.841655 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea092123-744a-4345-99c9-d7e775a53bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:14.842229 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea092123-744a-4345-99c9-d7e775a53bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:14.842403 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-09e139cf-643a-44c5-a2cc-b1c96e7f1e6a None None] MFA Rules not processed for user `cf14201629d84d8a8cc942ee0d1c6a8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:14.843906 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-09e139cf-643a-44c5-a2cc-b1c96e7f1e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:14.886526 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-ea092123-744a-4345-99c9-d7e775a53bc2 None None] MFA Rules not processed for user `1bbae5bbacb447bfa4a65fc40b1be1ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:14.887917 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-ea092123-744a-4345-99c9-d7e775a53bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:14.985817 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 828/1614] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:14.986647 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 787/1615] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:14 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:14.987564 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea092123-744a-4345-99c9-d7e775a53bc2 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:14.989318 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-ea092123-744a-4345-99c9-d7e775a53bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:14.994693 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67304d08-9620-4913-9a8d-0ffc88339753 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:14.995189 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67304d08-9620-4913-9a8d-0ffc88339753 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:14.995665 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67304d08-9620-4913-9a8d-0ffc88339753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:15.029023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-67304d08-9620-4913-9a8d-0ffc88339753 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:15.030772 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-67304d08-9620-4913-9a8d-0ffc88339753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:15.088539 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea092123-744a-4345-99c9-d7e775a53bc2 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:15.097123 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8a812-5d9c-41a2-83a6-44dd9763e6e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:15.097123 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8a812-5d9c-41a2-83a6-44dd9763e6e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:15.097123 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8a812-5d9c-41a2-83a6-44dd9763e6e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:15.097783 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8a812-5d9c-41a2-83a6-44dd9763e6e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:15.182635 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 829/1616] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:15.185340 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3026a5-5adc-49e8-b11a-d97949967d1c None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:15.185725 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3026a5-5adc-49e8-b11a-d97949967d1c None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:15.186183 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3026a5-5adc-49e8-b11a-d97949967d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:15.221622 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-3b3026a5-5adc-49e8-b11a-d97949967d1c None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:15.222254 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-3b3026a5-5adc-49e8-b11a-d97949967d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:15.241186 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 830/1617] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:15.242902 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3026a5-5adc-49e8-b11a-d97949967d1c None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:15.252694 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8a812-5d9c-41a2-83a6-44dd9763e6e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:15.256966 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8a812-5d9c-41a2-83a6-44dd9763e6e1 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:15.262863 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3026a5-5adc-49e8-b11a-d97949967d1c None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:15.275086 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde72a4-5c25-46b5-8032-69218a53b010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:15.275086 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde72a4-5c25-46b5-8032-69218a53b010 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:15.275086 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde72a4-5c25-46b5-8032-69218a53b010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:15.275086 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde72a4-5c25-46b5-8032-69218a53b010 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:15.276601 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde72a4-5c25-46b5-8032-69218a53b010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:15.279283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 788/1618] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:10:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:10:15.279570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde72a4-5c25-46b5-8032-69218a53b010 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:15.281657 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239fd90-4097-4cd3-9bdd-b85304dc4cfd None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:15.282324 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239fd90-4097-4cd3-9bdd-b85304dc4cfd None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:15.286382 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239fd90-4097-4cd3-9bdd-b85304dc4cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:15.301883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 831/1619] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:10:15.303967 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde72a4-5c25-46b5-8032-69218a53b010 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:15.324750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde72a4-5c25-46b5-8032-69218a53b010 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:15.334923 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6126632-8386-4346-b935-dffb6bd94fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:15.336448 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6126632-8386-4346-b935-dffb6bd94fcb admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:15.336775 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6126632-8386-4346-b935-dffb6bd94fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:15.337869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6126632-8386-4346-b935-dffb6bd94fcb admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:15.338801 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6126632-8386-4346-b935-dffb6bd94fcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:15.341221 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6126632-8386-4346-b935-dffb6bd94fcb admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:15.376266 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-e239fd90-4097-4cd3-9bdd-b85304dc4cfd None None] MFA Rules not processed for user `7bfcddefa71546d28078a38325c723a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:15.378650 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-e239fd90-4097-4cd3-9bdd-b85304dc4cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:15.400624 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:15.525362 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 832/1620] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:10:15 2022] POST /identity/v3/projects => generated 405 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:15.526700 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6126632-8386-4346-b935-dffb6bd94fcb admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:15.552381 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 789/1621] 10.222.0.20 () {58 vars in 1059 bytes} [Tue Aug 2 09:10:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:15.554688 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239fd90-4097-4cd3-9bdd-b85304dc4cfd None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:15.579792 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239fd90-4097-4cd3-9bdd-b85304dc4cfd None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:15.639174 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:15.675363 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bdccff-db65-4251-be73-f851134be97a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:15.676016 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdccff-db65-4251-be73-f851134be97a service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:15.676342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdccff-db65-4251-be73-f851134be97a service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:15.676626 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdccff-db65-4251-be73-f851134be97a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:15.696266 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6126632-8386-4346-b935-dffb6bd94fcb admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:15.701547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1703b-37ba-4e84-a46e-a53360d1592d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:15.702204 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1703b-37ba-4e84-a46e-a53360d1592d admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:15.702489 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1703b-37ba-4e84-a46e-a53360d1592d admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:15.702771 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1703b-37ba-4e84-a46e-a53360d1592d admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:15.703496 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1703b-37ba-4e84-a46e-a53360d1592d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:15.705818 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1703b-37ba-4e84-a46e-a53360d1592d admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:15.785370 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bdccff-db65-4251-be73-f851134be97a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:15.787387 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bdccff-db65-4251-be73-f851134be97a service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:15.809497 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 790/1622] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:10:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:10:15.814020 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bdccff-db65-4251-be73-f851134be97a service neutron] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:15.847351 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bdccff-db65-4251-be73-f851134be97a service neutron] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:15.855539 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c98234-a303-4159-85cb-b2692f61944e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:15.857664 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c98234-a303-4159-85cb-b2692f61944e service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:15.857664 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c98234-a303-4159-85cb-b2692f61944e service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:15.858338 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c98234-a303-4159-85cb-b2692f61944e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:15.876731 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 833/1623] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:10:15 2022] POST /identity/v3/projects => generated 365 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:15.879769 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1703b-37ba-4e84-a46e-a53360d1592d admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:15.882536 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c98234-a303-4159-85cb-b2692f61944e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:15.891161 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c98234-a303-4159-85cb-b2692f61944e service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:15.913880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 791/1624] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:10:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:10:15.915512 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c98234-a303-4159-85cb-b2692f61944e service neutron] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:15.935177 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c98234-a303-4159-85cb-b2692f61944e service neutron] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:16.031232 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:16.064812 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce21be-a8fc-47bb-b12b-c81345c6b4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:16.067033 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce21be-a8fc-47bb-b12b-c81345c6b4ce admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:16.068938 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce21be-a8fc-47bb-b12b-c81345c6b4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:16.069573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce21be-a8fc-47bb-b12b-c81345c6b4ce admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:16.070840 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce21be-a8fc-47bb-b12b-c81345c6b4ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:16.075064 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce21be-a8fc-47bb-b12b-c81345c6b4ce admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:16.077133 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1703b-37ba-4e84-a46e-a53360d1592d admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:16.089052 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6921850-f14a-4f70-949c-651213090131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:16.090480 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6921850-f14a-4f70-949c-651213090131 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:16.091182 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6921850-f14a-4f70-949c-651213090131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:16.091746 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6921850-f14a-4f70-949c-651213090131 admin admin] PATH_INFO: `/v3/projects/908db5b092354c188989905463a2c592/users/7c49c642e5294ca2944d9ffbd36a015b/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:16.098868 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6921850-f14a-4f70-949c-651213090131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=908db5b092354c188989905463a2c592, user_id=7c49c642e5294ca2944d9ffbd36a015b, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:16.102419 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6921850-f14a-4f70-949c-651213090131 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:16.120544 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 834/1625] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:10:15 2022] PUT /identity/v3/projects/908db5b092354c188989905463a2c592/users/7c49c642e5294ca2944d9ffbd36a015b/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:16.121597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6921850-f14a-4f70-949c-651213090131 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:16.219990 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 792/1626] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:10:15 2022] POST /identity/v3/users => generated 309 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:16.221910 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce21be-a8fc-47bb-b12b-c81345c6b4ce admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:16.243141 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6921850-f14a-4f70-949c-651213090131 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:16.245318 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce21be-a8fc-47bb-b12b-c81345c6b4ce admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:16.253843 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd758e-7e98-4dd0-bbbb-d5840156ff20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:16.255313 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd758e-7e98-4dd0-bbbb-d5840156ff20 service nova] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:16.256262 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd758e-7e98-4dd0-bbbb-d5840156ff20 service nova] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:16.256562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd758e-7e98-4dd0-bbbb-d5840156ff20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:16.387757 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:16.418396 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd758e-7e98-4dd0-bbbb-d5840156ff20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:16.421434 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd758e-7e98-4dd0-bbbb-d5840156ff20 service nova] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:16.422383 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e442912-92ad-401e-822c-e4b0f5e4fdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:16.426389 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e442912-92ad-401e-822c-e4b0f5e4fdee admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:16.431966 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e442912-92ad-401e-822c-e4b0f5e4fdee admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:16.432651 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e442912-92ad-401e-822c-e4b0f5e4fdee admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:16.434913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e442912-92ad-401e-822c-e4b0f5e4fdee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:16.445370 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e442912-92ad-401e-822c-e4b0f5e4fdee admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:16.492576 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 835/1627] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:10:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:10:16.494214 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa9f4f-c984-42cf-b52b-91df25d440cc None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:16.500176 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa9f4f-c984-42cf-b52b-91df25d440cc None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:16.500868 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa9f4f-c984-42cf-b52b-91df25d440cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:16.593918 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-4caa9f4f-c984-42cf-b52b-91df25d440cc None None] MFA Rules not processed for user `7c49c642e5294ca2944d9ffbd36a015b`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:16.597578 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-4caa9f4f-c984-42cf-b52b-91df25d440cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:16.791320 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 793/1628] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:10:16 2022] POST /identity/v3/users => generated 289 bytes in 517 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:16.791320 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e442912-92ad-401e-822c-e4b0f5e4fdee admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:16.791320 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e442912-92ad-401e-822c-e4b0f5e4fdee admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:16.801258 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d457f9d-fa3f-412a-a002-ccf2121b3f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:16.805470 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d457f9d-fa3f-412a-a002-ccf2121b3f41 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:16.807132 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d457f9d-fa3f-412a-a002-ccf2121b3f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:16.807785 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d457f9d-fa3f-412a-a002-ccf2121b3f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:16.814856 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d457f9d-fa3f-412a-a002-ccf2121b3f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:16.830449 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d457f9d-fa3f-412a-a002-ccf2121b3f41 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:16.858089 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 836/1629] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:16.859902 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa9f4f-c984-42cf-b52b-91df25d440cc None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:16.879976 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa9f4f-c984-42cf-b52b-91df25d440cc None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:16.893543 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 794/1630] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:10:16.896767 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d457f9d-fa3f-412a-a002-ccf2121b3f41 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:16.898359 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8a77c-e316-454c-b43e-1bcaf5c79f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:16.899571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8a77c-e316-454c-b43e-1bcaf5c79f95 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:16.900103 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8a77c-e316-454c-b43e-1bcaf5c79f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:16.900853 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8a77c-e316-454c-b43e-1bcaf5c79f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:16.902056 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d8a77c-e316-454c-b43e-1bcaf5c79f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:16.904976 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d8a77c-e316-454c-b43e-1bcaf5c79f95 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:16.926505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 837/1631] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:10:16.928433 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8a77c-e316-454c-b43e-1bcaf5c79f95 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:16.966681 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8a77c-e316-454c-b43e-1bcaf5c79f95 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:16.977188 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8582e92-1299-487f-bc35-28666a718a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:16.978355 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8582e92-1299-487f-bc35-28666a718a13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:16.978858 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8582e92-1299-487f-bc35-28666a718a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:16.979483 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8582e92-1299-487f-bc35-28666a718a13 admin admin] PATH_INFO: `/v3/projects/a3fe8e1bf2454bfaa2fdf2b33aebf643/users/90386ae5c3814cfd948f0e133e1e6c18/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:17.016204 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8582e92-1299-487f-bc35-28666a718a13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3fe8e1bf2454bfaa2fdf2b33aebf643, user_id=90386ae5c3814cfd948f0e133e1e6c18, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:17.023601 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8582e92-1299-487f-bc35-28666a718a13 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:17.077757 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d457f9d-fa3f-412a-a002-ccf2121b3f41 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:17.088116 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e3762-c24e-4341-95d0-3dbed1b845da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:17.099968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e3762-c24e-4341-95d0-3dbed1b845da service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:17.099968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e3762-c24e-4341-95d0-3dbed1b845da service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:17.099968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e3762-c24e-4341-95d0-3dbed1b845da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:17.118847 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e3762-c24e-4341-95d0-3dbed1b845da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:17.122087 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e3762-c24e-4341-95d0-3dbed1b845da service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:17.138201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 838/1632] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:10:16 2022] PUT /identity/v3/projects/a3fe8e1bf2454bfaa2fdf2b33aebf643/users/90386ae5c3814cfd948f0e133e1e6c18/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:17.139372 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8582e92-1299-487f-bc35-28666a718a13 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:17.147960 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 795/1633] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:10:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:10:17.150616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb1974-4b62-4e4e-8b00-124753afdc06 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:17.151538 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb1974-4b62-4e4e-8b00-124753afdc06 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:17.152008 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb1974-4b62-4e4e-8b00-124753afdc06 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:17.155773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 796/1634] 10.222.0.20 () {54 vars in 912 bytes} [Tue Aug 2 09:10:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:10:17.157400 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb1974-4b62-4e4e-8b00-124753afdc06 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:17.285963 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8582e92-1299-487f-bc35-28666a718a13 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:17.294710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e4368-c32d-4cea-9af3-1574a7dd0a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:17.295618 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e4368-c32d-4cea-9af3-1574a7dd0a56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:17.296012 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e4368-c32d-4cea-9af3-1574a7dd0a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:17.296397 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e4368-c32d-4cea-9af3-1574a7dd0a56 admin admin] PATH_INFO: `/v3/projects/64ef58668b8b476bb54c258dbe5ff5f3/users/77c8c0bf347b4027a1fc277474eae00f/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:17.343867 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e4368-c32d-4cea-9af3-1574a7dd0a56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64ef58668b8b476bb54c258dbe5ff5f3, user_id=77c8c0bf347b4027a1fc277474eae00f, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:17.352807 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e4368-c32d-4cea-9af3-1574a7dd0a56 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:17.385911 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:17.398542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb1974-4b62-4e4e-8b00-124753afdc06 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:17.410002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42d715-e757-4fa8-86f3-6e05fcacaf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:17.412941 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42d715-e757-4fa8-86f3-6e05fcacaf1c admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:17.413333 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42d715-e757-4fa8-86f3-6e05fcacaf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:17.414697 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42d715-e757-4fa8-86f3-6e05fcacaf1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:17.416098 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42d715-e757-4fa8-86f3-6e05fcacaf1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:17.420355 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42d715-e757-4fa8-86f3-6e05fcacaf1c admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:17.728040 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 797/1635] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:10:17.730157 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 839/1636] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:10:17 2022] PUT /identity/v3/projects/64ef58668b8b476bb54c258dbe5ff5f3/users/77c8c0bf347b4027a1fc277474eae00f/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:17.730729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530df934-42f5-41d0-8038-302aee96211f None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:17.731031 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e4368-c32d-4cea-9af3-1574a7dd0a56 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:17.731681 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530df934-42f5-41d0-8038-302aee96211f None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:17.731681 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530df934-42f5-41d0-8038-302aee96211f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:17.732095 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:17.735840 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-530df934-42f5-41d0-8038-302aee96211f None None] MFA Rules not processed for user `7bfcddefa71546d28078a38325c723a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:17.735840 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-530df934-42f5-41d0-8038-302aee96211f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:17.736361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e4368-c32d-4cea-9af3-1574a7dd0a56 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:17.736361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd4531-9e4d-4d7b-9e07-b124c0cb901f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:17.736361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd4531-9e4d-4d7b-9e07-b124c0cb901f admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:17.736361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd4531-9e4d-4d7b-9e07-b124c0cb901f admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:17.737153 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd4531-9e4d-4d7b-9e07-b124c0cb901f admin admin] PATH_INFO: `/v3/projects/a3fe8e1bf2454bfaa2fdf2b33aebf643/users/90386ae5c3814cfd948f0e133e1e6c18/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:17.737153 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd4531-9e4d-4d7b-9e07-b124c0cb901f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3fe8e1bf2454bfaa2fdf2b33aebf643, user_id=90386ae5c3814cfd948f0e133e1e6c18, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:17.737153 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd4531-9e4d-4d7b-9e07-b124c0cb901f admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:17.737153 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 840/1637] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:10:17 2022] PUT /identity/v3/projects/a3fe8e1bf2454bfaa2fdf2b33aebf643/users/90386ae5c3814cfd948f0e133e1e6c18/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:17.737153 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd4531-9e4d-4d7b-9e07-b124c0cb901f admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:17.790517 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 798/1638] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Aug 2 09:10:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:17.792315 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530df934-42f5-41d0-8038-302aee96211f None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:17.875642 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd4531-9e4d-4d7b-9e07-b124c0cb901f admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:17.894867 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a0dd1-8b73-4c54-a65e-4a04a98bd8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:17.895790 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a0dd1-8b73-4c54-a65e-4a04a98bd8cc admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:17.897073 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a0dd1-8b73-4c54-a65e-4a04a98bd8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:17.897555 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a0dd1-8b73-4c54-a65e-4a04a98bd8cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:17.899295 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a0dd1-8b73-4c54-a65e-4a04a98bd8cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:17.901421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a0dd1-8b73-4c54-a65e-4a04a98bd8cc admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:17.915924 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 841/1639] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:10:17.917749 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bce2e-c611-4b72-bac8-0af95ac978f1 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:17.921741 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bce2e-c611-4b72-bac8-0af95ac978f1 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:17.921741 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bce2e-c611-4b72-bac8-0af95ac978f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:17.947422 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530df934-42f5-41d0-8038-302aee96211f None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:17.998420 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-838bce2e-c611-4b72-bac8-0af95ac978f1 None None] MFA Rules not processed for user `90386ae5c3814cfd948f0e133e1e6c18`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:18.000580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-838bce2e-c611-4b72-bac8-0af95ac978f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:18.046865 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54811311-a71b-4d36-bdc5-35e2e398266d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:18.047571 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54811311-a71b-4d36-bdc5-35e2e398266d service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:18.047853 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54811311-a71b-4d36-bdc5-35e2e398266d service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:18.048122 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54811311-a71b-4d36-bdc5-35e2e398266d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:18.178948 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54811311-a71b-4d36-bdc5-35e2e398266d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:18.182096 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54811311-a71b-4d36-bdc5-35e2e398266d service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:18.201915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 799/1640] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:10:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:10:18.203923 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54811311-a71b-4d36-bdc5-35e2e398266d service cinder] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:18.213742 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:18.235142 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 842/1641] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:17 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:18.235142 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bce2e-c611-4b72-bac8-0af95ac978f1 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:18.239810 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54811311-a71b-4d36-bdc5-35e2e398266d service cinder] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:18.247634 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bce2e-c611-4b72-bac8-0af95ac978f1 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:18.253858 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323f3b5-71ef-4554-baab-76934f5a0a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:18.254576 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323f3b5-71ef-4554-baab-76934f5a0a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:18.256335 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323f3b5-71ef-4554-baab-76934f5a0a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:18.256335 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323f3b5-71ef-4554-baab-76934f5a0a03 admin admin] PATH_INFO: `/v3/projects/64ef58668b8b476bb54c258dbe5ff5f3/users/77c8c0bf347b4027a1fc277474eae00f/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:18.259854 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323f3b5-71ef-4554-baab-76934f5a0a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64ef58668b8b476bb54c258dbe5ff5f3, user_id=77c8c0bf347b4027a1fc277474eae00f, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:18.261804 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb868f9f-3eee-4bd9-96df-93307504162b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:18.265014 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb868f9f-3eee-4bd9-96df-93307504162b service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:18.266408 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb868f9f-3eee-4bd9-96df-93307504162b service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:18.272083 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb868f9f-3eee-4bd9-96df-93307504162b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:18.280017 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323f3b5-71ef-4554-baab-76934f5a0a03 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:18.328214 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 843/1642] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:10:18 2022] PUT /identity/v3/projects/64ef58668b8b476bb54c258dbe5ff5f3/users/77c8c0bf347b4027a1fc277474eae00f/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:18.331726 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32427a8a-58cc-40b2-86f5-f197cd9ff275 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:18.332015 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32427a8a-58cc-40b2-86f5-f197cd9ff275 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:18.332334 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32427a8a-58cc-40b2-86f5-f197cd9ff275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:18.439318 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-32427a8a-58cc-40b2-86f5-f197cd9ff275 None None] MFA Rules not processed for user `77c8c0bf347b4027a1fc277474eae00f`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:18.450091 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-32427a8a-58cc-40b2-86f5-f197cd9ff275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:18.561074 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb868f9f-3eee-4bd9-96df-93307504162b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:18.564064 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb868f9f-3eee-4bd9-96df-93307504162b service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:18.612250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 800/1643] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:10:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:10:18.640369 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:18.667562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 844/1644] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:19.460774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb868f9f-3eee-4bd9-96df-93307504162b service cinder] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:19.486661 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb868f9f-3eee-4bd9-96df-93307504162b service cinder] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:19.607730 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f64c2e-2d0f-4bbb-a923-f610db8164df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:19.608999 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f64c2e-2d0f-4bbb-a923-f610db8164df service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:19.609496 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f64c2e-2d0f-4bbb-a923-f610db8164df service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:19.609999 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f64c2e-2d0f-4bbb-a923-f610db8164df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:19.809588 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f64c2e-2d0f-4bbb-a923-f610db8164df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:19.816071 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f64c2e-2d0f-4bbb-a923-f610db8164df service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:19.862099 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 801/1645] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:10:19 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:10:19.986733 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32427a8a-58cc-40b2-86f5-f197cd9ff275 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:20.008806 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32427a8a-58cc-40b2-86f5-f197cd9ff275 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:20.015656 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca574b0-ff4d-42f2-baf7-19cdcb7f6d4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:20.016606 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca574b0-ff4d-42f2-baf7-19cdcb7f6d4f service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:20.017518 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca574b0-ff4d-42f2-baf7-19cdcb7f6d4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:20.017518 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca574b0-ff4d-42f2-baf7-19cdcb7f6d4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:20.032575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca574b0-ff4d-42f2-baf7-19cdcb7f6d4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:20.034364 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca574b0-ff4d-42f2-baf7-19cdcb7f6d4f service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:20.056580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 845/1646] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:10:19 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:10:21.254859 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f64c2e-2d0f-4bbb-a923-f610db8164df service cinder] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:21.409565 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:21.524644 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f64c2e-2d0f-4bbb-a923-f610db8164df service cinder] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:21.535900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4150c-270c-4736-a644-62e84332c0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:21.540850 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4150c-270c-4736-a644-62e84332c0da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:21.541267 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4150c-270c-4736-a644-62e84332c0da admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:21.542857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4150c-270c-4736-a644-62e84332c0da admin admin] PATH_INFO: `/v3/users/1bbae5bbacb447bfa4a65fc40b1be1ed` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:21.570389 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4150c-270c-4736-a644-62e84332c0da admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bbae5bbacb447bfa4a65fc40b1be1ed)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:21.579560 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4150c-270c-4736-a644-62e84332c0da admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:21.640204 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3e199-410c-4169-b497-2fc68423a9d6 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:21.640993 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3e199-410c-4169-b497-2fc68423a9d6 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:21.641400 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3e199-410c-4169-b497-2fc68423a9d6 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:21.644451 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 846/1647] 10.222.0.20 () {54 vars in 962 bytes} [Tue Aug 2 09:10:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:10:21.685704 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449076f-b397-4341-9b0c-30ea1e529ad0 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:21.686129 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449076f-b397-4341-9b0c-30ea1e529ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:21.689479 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449076f-b397-4341-9b0c-30ea1e529ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:21.752460 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-2449076f-b397-4341-9b0c-30ea1e529ad0 None None] MFA Rules not processed for user `7bfcddefa71546d28078a38325c723a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:21.759284 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-2449076f-b397-4341-9b0c-30ea1e529ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:21.932781 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-d4b4150c-270c-4736-a644-62e84332c0da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bbae5bbacb447bfa4a65fc40b1be1ed'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:21.965030 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-d4b4150c-270c-4736-a644-62e84332c0da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bbae5bbacb447bfa4a65fc40b1be1ed'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:21.968274 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-d4b4150c-270c-4736-a644-62e84332c0da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bbae5bbacb447bfa4a65fc40b1be1ed'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:22.103572 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-d4b4150c-270c-4736-a644-62e84332c0da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bbae5bbacb447bfa4a65fc40b1be1ed'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:22.109031 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 847/1648] 10.222.0.20 () {58 vars in 1059 bytes} [Tue Aug 2 09:10:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:10:22.119719 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c36b7-6e19-446e-8b7f-0566f324148a None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:22.120029 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c36b7-6e19-446e-8b7f-0566f324148a None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:22.120459 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c36b7-6e19-446e-8b7f-0566f324148a None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:22.124722 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 848/1649] 10.222.0.20 () {54 vars in 912 bytes} [Tue Aug 2 09:10:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:10:22.156840 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c2d54-434e-4f0e-b0c9-17ca3d209d3b None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:22.157172 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c2d54-434e-4f0e-b0c9-17ca3d209d3b None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:22.157312 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c2d54-434e-4f0e-b0c9-17ca3d209d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:22.160369 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-d4b4150c-270c-4736-a644-62e84332c0da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bbae5bbacb447bfa4a65fc40b1be1ed'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:22.187760 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 802/1650] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:10:21 2022] DELETE /identity/v3/users/1bbae5bbacb447bfa4a65fc40b1be1ed => generated 0 bytes in 929 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:22.196531 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfb6a9-fcd5-4c8e-9e42-729100ec6690 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:22.196531 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfb6a9-fcd5-4c8e-9e42-729100ec6690 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:22.196531 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfb6a9-fcd5-4c8e-9e42-729100ec6690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:22.265315 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-005c2d54-434e-4f0e-b0c9-17ca3d209d3b None None] MFA Rules not processed for user `7bfcddefa71546d28078a38325c723a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:22.271815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-005c2d54-434e-4f0e-b0c9-17ca3d209d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:22.284989 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-4abfb6a9-fcd5-4c8e-9e42-729100ec6690 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:22.297445 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-4abfb6a9-fcd5-4c8e-9e42-729100ec6690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:22.547530 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 849/1651] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Aug 2 09:10:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:22.574721 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c2d54-434e-4f0e-b0c9-17ca3d209d3b None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:22.576615 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-005c2d54-434e-4f0e-b0c9-17ca3d209d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:22.625867 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:22.661482 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 803/1652] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:22.734261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c2d54-434e-4f0e-b0c9-17ca3d209d3b None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:22.748522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a541f16-7676-4b0d-813d-2a9b88e2288f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:22.748522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a541f16-7676-4b0d-813d-2a9b88e2288f service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:22.748522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a541f16-7676-4b0d-813d-2a9b88e2288f service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:22.748522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a541f16-7676-4b0d-813d-2a9b88e2288f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:22.749001 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfb6a9-fcd5-4c8e-9e42-729100ec6690 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:22.750475 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-4abfb6a9-fcd5-4c8e-9e42-729100ec6690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:22.773914 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a541f16-7676-4b0d-813d-2a9b88e2288f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:22.775652 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a541f16-7676-4b0d-813d-2a9b88e2288f service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:22.810879 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 850/1653] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:10:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:10:23.048716 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:23.063428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfb6a9-fcd5-4c8e-9e42-729100ec6690 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:23.064296 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a541f16-7676-4b0d-813d-2a9b88e2288f service cinder] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:23.066951 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-7a541f16-7676-4b0d-813d-2a9b88e2288f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:23.071412 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233113b4-f245-4b60-8e4e-e0fbcdfedebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:23.072116 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233113b4-f245-4b60-8e4e-e0fbcdfedebe service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:23.072436 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233113b4-f245-4b60-8e4e-e0fbcdfedebe service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:23.072793 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233113b4-f245-4b60-8e4e-e0fbcdfedebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:23.088301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233113b4-f245-4b60-8e4e-e0fbcdfedebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:23.090369 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233113b4-f245-4b60-8e4e-e0fbcdfedebe service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:23.113298 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 804/1654] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:10:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:10:23.131819 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a541f16-7676-4b0d-813d-2a9b88e2288f service cinder] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:23.154368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce32839-377f-4710-af73-770c0cbc3800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:23.155395 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce32839-377f-4710-af73-770c0cbc3800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:23.155825 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce32839-377f-4710-af73-770c0cbc3800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:23.156338 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce32839-377f-4710-af73-770c0cbc3800 admin admin] PATH_INFO: `/v3/users/cf14201629d84d8a8cc942ee0d1c6a8e` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:23.158350 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce32839-377f-4710-af73-770c0cbc3800 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf14201629d84d8a8cc942ee0d1c6a8e)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:23.164918 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: WARNING py.warnings [None req-bce32839-377f-4710-af73-770c0cbc3800 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:10:23.164918 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: warnings.warn(msg) Aug 02 09:10:23.164918 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: Aug 02 09:10:23.166654 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce32839-377f-4710-af73-770c0cbc3800 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:23.533188 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-bce32839-377f-4710-af73-770c0cbc3800 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf14201629d84d8a8cc942ee0d1c6a8e'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:23.728537 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-bce32839-377f-4710-af73-770c0cbc3800 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf14201629d84d8a8cc942ee0d1c6a8e'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:23.770458 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-bce32839-377f-4710-af73-770c0cbc3800 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf14201629d84d8a8cc942ee0d1c6a8e'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:23.772026 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-bce32839-377f-4710-af73-770c0cbc3800 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf14201629d84d8a8cc942ee0d1c6a8e'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:23.772969 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-bce32839-377f-4710-af73-770c0cbc3800 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf14201629d84d8a8cc942ee0d1c6a8e'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:23.861177 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2389e-b965-41fc-b14d-3c0b53592638 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:23.861915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2389e-b965-41fc-b14d-3c0b53592638 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:23.861915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2389e-b965-41fc-b14d-3c0b53592638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:23.866562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 851/1655] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:10:23 2022] DELETE /identity/v3/users/cf14201629d84d8a8cc942ee0d1c6a8e => generated 0 bytes in 793 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:23.919014 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-b9f2389e-b965-41fc-b14d-3c0b53592638 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:23.926952 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-b9f2389e-b965-41fc-b14d-3c0b53592638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:24.150880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 805/1656] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:24.402698 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce32839-377f-4710-af73-770c0cbc3800 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:24.406783 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-bce32839-377f-4710-af73-770c0cbc3800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:24.792013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce32839-377f-4710-af73-770c0cbc3800 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:24.823306 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7da54d-042a-4b21-ab81-332eca139a63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:24.824835 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7da54d-042a-4b21-ab81-332eca139a63 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:24.828057 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7da54d-042a-4b21-ab81-332eca139a63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:24.828871 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7da54d-042a-4b21-ab81-332eca139a63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:24.884279 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7da54d-042a-4b21-ab81-332eca139a63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:24.895279 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7da54d-042a-4b21-ab81-332eca139a63 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:24.980978 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 852/1657] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:10:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:10:25.635678 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2389e-b965-41fc-b14d-3c0b53592638 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:25.639964 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-b9f2389e-b965-41fc-b14d-3c0b53592638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:25.699318 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2389e-b965-41fc-b14d-3c0b53592638 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:25.713659 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61a7c8-1704-4674-8cb1-660fbfca6264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:25.715692 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61a7c8-1704-4674-8cb1-660fbfca6264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:25.716320 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61a7c8-1704-4674-8cb1-660fbfca6264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:25.716918 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61a7c8-1704-4674-8cb1-660fbfca6264 admin admin] PATH_INFO: `/v3/projects/42708d8a3f8e4e1a944ca3a90bba8c60` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:25.719198 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61a7c8-1704-4674-8cb1-660fbfca6264 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42708d8a3f8e4e1a944ca3a90bba8c60)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:25.721531 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: WARNING py.warnings [None req-0f61a7c8-1704-4674-8cb1-660fbfca6264 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:10:25.721531 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: warnings.warn(msg) Aug 02 09:10:25.721531 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: Aug 02 09:10:25.726079 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61a7c8-1704-4674-8cb1-660fbfca6264 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:26.055025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-0f61a7c8-1704-4674-8cb1-660fbfca6264 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42708d8a3f8e4e1a944ca3a90bba8c60', 'request_id': 'req-0f61a7c8-1704-4674-8cb1-660fbfca6264'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:26.089139 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-0f61a7c8-1704-4674-8cb1-660fbfca6264 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42708d8a3f8e4e1a944ca3a90bba8c60', 'request_id': 'req-0f61a7c8-1704-4674-8cb1-660fbfca6264'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:26.146187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-0f61a7c8-1704-4674-8cb1-660fbfca6264 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42708d8a3f8e4e1a944ca3a90bba8c60', 'request_id': 'req-0f61a7c8-1704-4674-8cb1-660fbfca6264'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:26.318616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-0f61a7c8-1704-4674-8cb1-660fbfca6264 admin admin] The token cache is being invalidate because project 42708d8a3f8e4e1a944ca3a90bba8c60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:10:26.318616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-0f61a7c8-1704-4674-8cb1-660fbfca6264 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:26.318616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-0f61a7c8-1704-4674-8cb1-660fbfca6264 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:26.319974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7da54d-042a-4b21-ab81-332eca139a63 service neutron] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:26.320705 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 806/1658] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:10:25 2022] DELETE /identity/v3/projects/42708d8a3f8e4e1a944ca3a90bba8c60 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:26.361990 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7da54d-042a-4b21-ab81-332eca139a63 service neutron] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:26.480673 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:26.529942 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f98dc1-ee01-4f41-abbc-ce140dd3e312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:26.533132 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f98dc1-ee01-4f41-abbc-ce140dd3e312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:26.533616 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f98dc1-ee01-4f41-abbc-ce140dd3e312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:26.534014 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f98dc1-ee01-4f41-abbc-ce140dd3e312 admin admin] PATH_INFO: `/v3/users/90386ae5c3814cfd948f0e133e1e6c18` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:26.537834 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f98dc1-ee01-4f41-abbc-ce140dd3e312 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90386ae5c3814cfd948f0e133e1e6c18)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:26.540842 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f98dc1-ee01-4f41-abbc-ce140dd3e312 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:26.843394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-64f98dc1-ee01-4f41-abbc-ce140dd3e312 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90386ae5c3814cfd948f0e133e1e6c18'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:27.011732 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-64f98dc1-ee01-4f41-abbc-ce140dd3e312 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90386ae5c3814cfd948f0e133e1e6c18'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:27.045450 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-64f98dc1-ee01-4f41-abbc-ce140dd3e312 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90386ae5c3814cfd948f0e133e1e6c18'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:27.048368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-64f98dc1-ee01-4f41-abbc-ce140dd3e312 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90386ae5c3814cfd948f0e133e1e6c18'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:27.055823 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-64f98dc1-ee01-4f41-abbc-ce140dd3e312 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90386ae5c3814cfd948f0e133e1e6c18'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:27.141032 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 853/1659] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:10:26 2022] DELETE /identity/v3/users/90386ae5c3814cfd948f0e133e1e6c18 => generated 0 bytes in 814 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:10:27.759929 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61a7c8-1704-4674-8cb1-660fbfca6264 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:27.762174 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-0f61a7c8-1704-4674-8cb1-660fbfca6264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:27.797412 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61a7c8-1704-4674-8cb1-660fbfca6264 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:28.006473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455acc6b-5ec6-45b6-a042-d1eaa7606845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:28.008101 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455acc6b-5ec6-45b6-a042-d1eaa7606845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:28.008538 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455acc6b-5ec6-45b6-a042-d1eaa7606845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:28.008920 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455acc6b-5ec6-45b6-a042-d1eaa7606845 admin admin] PATH_INFO: `/v3/projects/bab2c49640f74c1b9d89ea3e0d13fef8` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:28.010768 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455acc6b-5ec6-45b6-a042-d1eaa7606845 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bab2c49640f74c1b9d89ea3e0d13fef8)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:28.013578 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455acc6b-5ec6-45b6-a042-d1eaa7606845 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:28.062815 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:28.217031 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-455acc6b-5ec6-45b6-a042-d1eaa7606845 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bab2c49640f74c1b9d89ea3e0d13fef8', 'request_id': 'req-455acc6b-5ec6-45b6-a042-d1eaa7606845'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:28.233774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-455acc6b-5ec6-45b6-a042-d1eaa7606845 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bab2c49640f74c1b9d89ea3e0d13fef8', 'request_id': 'req-455acc6b-5ec6-45b6-a042-d1eaa7606845'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:28.254836 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-455acc6b-5ec6-45b6-a042-d1eaa7606845 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bab2c49640f74c1b9d89ea3e0d13fef8', 'request_id': 'req-455acc6b-5ec6-45b6-a042-d1eaa7606845'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:28.332594 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-455acc6b-5ec6-45b6-a042-d1eaa7606845 admin admin] The token cache is being invalidate because project bab2c49640f74c1b9d89ea3e0d13fef8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:10:28.332961 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-455acc6b-5ec6-45b6-a042-d1eaa7606845 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:28.335941 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-455acc6b-5ec6-45b6-a042-d1eaa7606845 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:28.342441 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 807/1660] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:10:27 2022] DELETE /identity/v3/projects/bab2c49640f74c1b9d89ea3e0d13fef8 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:10:28.346992 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f98dc1-ee01-4f41-abbc-ce140dd3e312 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:28.349623 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-64f98dc1-ee01-4f41-abbc-ce140dd3e312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:28.393574 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f98dc1-ee01-4f41-abbc-ce140dd3e312 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:28.407387 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f724f68-d479-49b3-be25-3c0a4f44c51e None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:28.407913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f724f68-d479-49b3-be25-3c0a4f44c51e None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:28.408347 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f724f68-d479-49b3-be25-3c0a4f44c51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:28.540351 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-0f724f68-d479-49b3-be25-3c0a4f44c51e None None] MFA Rules not processed for user `ed8d0b552b03417c9db1f5fc2bef05b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:28.542393 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-0f724f68-d479-49b3-be25-3c0a4f44c51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:28.671711 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1223e-05b6-440d-905d-4e486ca4bb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:28.673428 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1223e-05b6-440d-905d-4e486ca4bb68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:28.674057 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1223e-05b6-440d-905d-4e486ca4bb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:28.676605 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1223e-05b6-440d-905d-4e486ca4bb68 admin admin] PATH_INFO: `/v3/users/77c8c0bf347b4027a1fc277474eae00f` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:28.681644 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1223e-05b6-440d-905d-4e486ca4bb68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77c8c0bf347b4027a1fc277474eae00f)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:28.685502 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1223e-05b6-440d-905d-4e486ca4bb68 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:28.791879 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 808/1661] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:10:28.793501 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c986ee-4f1a-4150-98d8-e4cf06fa8f42 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:28.797222 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c986ee-4f1a-4150-98d8-e4cf06fa8f42 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:28.797222 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c986ee-4f1a-4150-98d8-e4cf06fa8f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:28.868975 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-b2c986ee-4f1a-4150-98d8-e4cf06fa8f42 None None] MFA Rules not processed for user `ed8d0b552b03417c9db1f5fc2bef05b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:28.883437 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-b2c986ee-4f1a-4150-98d8-e4cf06fa8f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:28.931855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 809/1662] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:28.954129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c986ee-4f1a-4150-98d8-e4cf06fa8f42 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:28.957248 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-b2c986ee-4f1a-4150-98d8-e4cf06fa8f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:29.015992 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d5b1223e-05b6-440d-905d-4e486ca4bb68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77c8c0bf347b4027a1fc277474eae00f'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:29.134002 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d5b1223e-05b6-440d-905d-4e486ca4bb68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77c8c0bf347b4027a1fc277474eae00f'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:29.139095 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:29.157001 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d5b1223e-05b6-440d-905d-4e486ca4bb68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77c8c0bf347b4027a1fc277474eae00f'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:29.159164 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d5b1223e-05b6-440d-905d-4e486ca4bb68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77c8c0bf347b4027a1fc277474eae00f'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:29.163679 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d5b1223e-05b6-440d-905d-4e486ca4bb68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77c8c0bf347b4027a1fc277474eae00f'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:29.244996 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 854/1663] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:10:28 2022] DELETE /identity/v3/users/77c8c0bf347b4027a1fc277474eae00f => generated 0 bytes in 898 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:29.276647 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c986ee-4f1a-4150-98d8-e4cf06fa8f42 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:29.349463 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1223e-05b6-440d-905d-4e486ca4bb68 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:29.354040 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-d5b1223e-05b6-440d-905d-4e486ca4bb68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:29.374066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:29.466394 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82767f-a19b-48b1-a411-c14b2d3aa316 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:29.467534 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82767f-a19b-48b1-a411-c14b2d3aa316 service nova] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:29.467842 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82767f-a19b-48b1-a411-c14b2d3aa316 service nova] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:29.469259 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82767f-a19b-48b1-a411-c14b2d3aa316 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:29.472309 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-1e82767f-a19b-48b1-a411-c14b2d3aa316 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:29.604200 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1223e-05b6-440d-905d-4e486ca4bb68 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:29.621431 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82767f-a19b-48b1-a411-c14b2d3aa316 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:29.625195 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82767f-a19b-48b1-a411-c14b2d3aa316 service nova] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:29.626114 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509d863-2774-425a-85f2-937f0d1f02fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:29.626997 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509d863-2774-425a-85f2-937f0d1f02fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:29.629479 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509d863-2774-425a-85f2-937f0d1f02fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:29.629956 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509d863-2774-425a-85f2-937f0d1f02fc admin admin] PATH_INFO: `/v3/projects/a3fe8e1bf2454bfaa2fdf2b33aebf643` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:29.634821 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509d863-2774-425a-85f2-937f0d1f02fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3fe8e1bf2454bfaa2fdf2b33aebf643)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:29.637477 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509d863-2774-425a-85f2-937f0d1f02fc admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:29.663637 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 810/1664] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:10:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 710 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:10:29.807464 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-7509d863-2774-425a-85f2-937f0d1f02fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3fe8e1bf2454bfaa2fdf2b33aebf643', 'request_id': 'req-7509d863-2774-425a-85f2-937f0d1f02fc'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:29.886134 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-7509d863-2774-425a-85f2-937f0d1f02fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3fe8e1bf2454bfaa2fdf2b33aebf643', 'request_id': 'req-7509d863-2774-425a-85f2-937f0d1f02fc'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:29.894454 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-7509d863-2774-425a-85f2-937f0d1f02fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3fe8e1bf2454bfaa2fdf2b33aebf643', 'request_id': 'req-7509d863-2774-425a-85f2-937f0d1f02fc'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:29.930404 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-7509d863-2774-425a-85f2-937f0d1f02fc admin admin] The token cache is being invalidate because project a3fe8e1bf2454bfaa2fdf2b33aebf643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:10:29.930404 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-7509d863-2774-425a-85f2-937f0d1f02fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:29.931041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-7509d863-2774-425a-85f2-937f0d1f02fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:29.934857 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 855/1665] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:10:29 2022] DELETE /identity/v3/projects/a3fe8e1bf2454bfaa2fdf2b33aebf643 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:10:29.941348 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f373383-f4ea-42d3-a0c7-057392ad418c None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:29.942150 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f373383-f4ea-42d3-a0c7-057392ad418c None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:29.942709 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f373383-f4ea-42d3-a0c7-057392ad418c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:30.019891 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-6f373383-f4ea-42d3-a0c7-057392ad418c None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:30.022289 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-6f373383-f4ea-42d3-a0c7-057392ad418c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:30.266837 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 811/1666] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:30.292799 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb775e-4a98-4a06-bd5d-ed5367bfe060 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:30.294710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb775e-4a98-4a06-bd5d-ed5367bfe060 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:30.296680 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb775e-4a98-4a06-bd5d-ed5367bfe060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:30.353263 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-5ecb775e-4a98-4a06-bd5d-ed5367bfe060 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:30.355514 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-5ecb775e-4a98-4a06-bd5d-ed5367bfe060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:30.377555 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 856/1667] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:30.377926 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f373383-f4ea-42d3-a0c7-057392ad418c None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:30.417374 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f373383-f4ea-42d3-a0c7-057392ad418c None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:30.427987 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d395f-5fae-4f25-a2c0-32b196cb275f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:30.428862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d395f-5fae-4f25-a2c0-32b196cb275f admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:30.429212 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d395f-5fae-4f25-a2c0-32b196cb275f admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:30.429487 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d395f-5fae-4f25-a2c0-32b196cb275f admin admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:30.430274 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d395f-5fae-4f25-a2c0-32b196cb275f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:10:30.430582 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d395f-5fae-4f25-a2c0-32b196cb275f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:30.432347 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d395f-5fae-4f25-a2c0-32b196cb275f admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:30.467108 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 812/1668] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:10:30.474514 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb775e-4a98-4a06-bd5d-ed5367bfe060 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:30.507575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb775e-4a98-4a06-bd5d-ed5367bfe060 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:30.516641 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec237fe-9185-4c41-b405-e193e14de377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:30.517361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec237fe-9185-4c41-b405-e193e14de377 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:30.517679 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec237fe-9185-4c41-b405-e193e14de377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:30.517969 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec237fe-9185-4c41-b405-e193e14de377 admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:30.518903 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec237fe-9185-4c41-b405-e193e14de377 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:30.523086 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec237fe-9185-4c41-b405-e193e14de377 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:30.738499 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 857/1669] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:10:30 2022] POST /identity/v3/projects => generated 365 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:30.744125 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d395f-5fae-4f25-a2c0-32b196cb275f admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:30.763923 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d395f-5fae-4f25-a2c0-32b196cb275f admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:30.890278 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:30.903299 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec237fe-9185-4c41-b405-e193e14de377 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:30.905410 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-5ec237fe-9185-4c41-b405-e193e14de377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:30.914564 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806be8e7-cb67-4640-bff6-a97c9ca9d10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:30.917140 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806be8e7-cb67-4640-bff6-a97c9ca9d10b admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:30.918158 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806be8e7-cb67-4640-bff6-a97c9ca9d10b admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:30.919497 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806be8e7-cb67-4640-bff6-a97c9ca9d10b admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:30.920877 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806be8e7-cb67-4640-bff6-a97c9ca9d10b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:30.928988 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806be8e7-cb67-4640-bff6-a97c9ca9d10b admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:30.935415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec237fe-9185-4c41-b405-e193e14de377 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:30.944877 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6288d81-c27e-4754-abb5-26a6b7611c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:30.945782 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6288d81-c27e-4754-abb5-26a6b7611c2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:30.946037 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6288d81-c27e-4754-abb5-26a6b7611c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:30.946322 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6288d81-c27e-4754-abb5-26a6b7611c2e admin admin] PATH_INFO: `/v3/projects/64ef58668b8b476bb54c258dbe5ff5f3` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:30.956067 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6288d81-c27e-4754-abb5-26a6b7611c2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=64ef58668b8b476bb54c258dbe5ff5f3)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:30.958331 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6288d81-c27e-4754-abb5-26a6b7611c2e admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:31.064773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 813/1670] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:10:30 2022] POST /identity/v3/users => generated 283 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:31.071473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806be8e7-cb67-4640-bff6-a97c9ca9d10b admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:31.102541 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806be8e7-cb67-4640-bff6-a97c9ca9d10b admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:31.118282 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596018c-e179-4a03-8367-5ed152d51d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:31.118948 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596018c-e179-4a03-8367-5ed152d51d80 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:31.119234 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596018c-e179-4a03-8367-5ed152d51d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:31.121419 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596018c-e179-4a03-8367-5ed152d51d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:31.131860 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e596018c-e179-4a03-8367-5ed152d51d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:31.132203 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:31.145298 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e596018c-e179-4a03-8367-5ed152d51d80 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:31.189962 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 814/1671] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:10:31.192463 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-c6288d81-c27e-4754-abb5-26a6b7611c2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64ef58668b8b476bb54c258dbe5ff5f3', 'request_id': 'req-c6288d81-c27e-4754-abb5-26a6b7611c2e'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:31.194352 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8b95c-fd19-4161-92bc-7484afc64207 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:31.206630 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8b95c-fd19-4161-92bc-7484afc64207 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:31.206630 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8b95c-fd19-4161-92bc-7484afc64207 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:31.206630 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 815/1672] 10.222.0.20 () {54 vars in 912 bytes} [Tue Aug 2 09:10:31 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:10:31.206630 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8b95c-fd19-4161-92bc-7484afc64207 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:31.288686 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-c6288d81-c27e-4754-abb5-26a6b7611c2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64ef58668b8b476bb54c258dbe5ff5f3', 'request_id': 'req-c6288d81-c27e-4754-abb5-26a6b7611c2e'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:31.304119 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-c6288d81-c27e-4754-abb5-26a6b7611c2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64ef58668b8b476bb54c258dbe5ff5f3', 'request_id': 'req-c6288d81-c27e-4754-abb5-26a6b7611c2e'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:31.340698 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-c6288d81-c27e-4754-abb5-26a6b7611c2e admin admin] The token cache is being invalidate because project 64ef58668b8b476bb54c258dbe5ff5f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:10:31.341114 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-c6288d81-c27e-4754-abb5-26a6b7611c2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:31.350543 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-c6288d81-c27e-4754-abb5-26a6b7611c2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:31.360597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 858/1673] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:10:30 2022] DELETE /identity/v3/projects/64ef58668b8b476bb54c258dbe5ff5f3 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:10:31.374397 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbb046-4089-4fa6-bae2-be84eda45557 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:31.375847 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbb046-4089-4fa6-bae2-be84eda45557 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:31.379271 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbb046-4089-4fa6-bae2-be84eda45557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:31.463889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8b95c-fd19-4161-92bc-7484afc64207 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:31.485736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bbe4a-3c8c-4508-93e9-d7f05d89f3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:31.485736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bbe4a-3c8c-4508-93e9-d7f05d89f3eb admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:31.485736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bbe4a-3c8c-4508-93e9-d7f05d89f3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:31.485736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bbe4a-3c8c-4508-93e9-d7f05d89f3eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:31.486374 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bbe4a-3c8c-4508-93e9-d7f05d89f3eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:31.487742 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bbe4a-3c8c-4508-93e9-d7f05d89f3eb admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:31.537941 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 816/1674] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:10:31.539704 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb341a-b2a0-4c11-a308-0a2f4c2a133f None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:31.539999 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb341a-b2a0-4c11-a308-0a2f4c2a133f None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:31.540351 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb341a-b2a0-4c11-a308-0a2f4c2a133f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:31.541580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-7bfbb046-4089-4fa6-bae2-be84eda45557 None None] MFA Rules not processed for user `6128f07ffd5f4357968b0e2e300f2e09`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:31.547452 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-7bfbb046-4089-4fa6-bae2-be84eda45557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:31.606846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-68fb341a-b2a0-4c11-a308-0a2f4c2a133f None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:31.616575 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-68fb341a-b2a0-4c11-a308-0a2f4c2a133f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:31.639193 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 817/1675] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:31.650330 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb341a-b2a0-4c11-a308-0a2f4c2a133f None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:31.657625 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-68fb341a-b2a0-4c11-a308-0a2f4c2a133f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:31.684731 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb341a-b2a0-4c11-a308-0a2f4c2a133f None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:31.700888 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e34153-cbcd-469a-8d2b-d10242c29365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:31.701615 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e34153-cbcd-469a-8d2b-d10242c29365 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:31.701904 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e34153-cbcd-469a-8d2b-d10242c29365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:31.702182 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e34153-cbcd-469a-8d2b-d10242c29365 admin admin] PATH_INFO: `/v3/projects/d94ca6cfb1b44494962d542774b81724/users/7fa8a30eb9814ca086e8982e8aa4d64d/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:31.745699 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e34153-cbcd-469a-8d2b-d10242c29365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d94ca6cfb1b44494962d542774b81724, user_id=7fa8a30eb9814ca086e8982e8aa4d64d, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:31.759141 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 859/1676] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Aug 2 09:10:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:31.761189 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f76616-1820-47e1-bbbd-0ae87c17783c None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:31.761621 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f76616-1820-47e1-bbbd-0ae87c17783c None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:31.761785 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e34153-cbcd-469a-8d2b-d10242c29365 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:31.762185 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f76616-1820-47e1-bbbd-0ae87c17783c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:31.828536 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-59f76616-1820-47e1-bbbd-0ae87c17783c None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:31.832231 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-59f76616-1820-47e1-bbbd-0ae87c17783c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:31.854489 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 860/1677] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:31.861905 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f76616-1820-47e1-bbbd-0ae87c17783c None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:31.878626 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 818/1678] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:10:31 2022] PUT /identity/v3/projects/d94ca6cfb1b44494962d542774b81724/users/7fa8a30eb9814ca086e8982e8aa4d64d/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:31.879740 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e34153-cbcd-469a-8d2b-d10242c29365 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:31.892748 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-99e34153-cbcd-469a-8d2b-d10242c29365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:31.908608 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f76616-1820-47e1-bbbd-0ae87c17783c None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:32.086001 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e34153-cbcd-469a-8d2b-d10242c29365 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:32.093465 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226e3fb-1734-44e6-bce6-56e906250d1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:32.094651 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226e3fb-1734-44e6-bce6-56e906250d1a service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:32.095618 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226e3fb-1734-44e6-bce6-56e906250d1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:32.096203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226e3fb-1734-44e6-bce6-56e906250d1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:32.111654 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226e3fb-1734-44e6-bce6-56e906250d1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:32.116419 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226e3fb-1734-44e6-bce6-56e906250d1a service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:32.144804 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 819/1679] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:10:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:10:32.149691 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7fdae-f1f5-41f1-9417-b54b2b7eea75 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:32.151258 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf534b2f-bca9-4256-933d-e9d74d6621f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:32.152267 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7fdae-f1f5-41f1-9417-b54b2b7eea75 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:32.156434 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf534b2f-bca9-4256-933d-e9d74d6621f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:32.156434 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf534b2f-bca9-4256-933d-e9d74d6621f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:32.156730 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7fdae-f1f5-41f1-9417-b54b2b7eea75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:32.159650 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf534b2f-bca9-4256-933d-e9d74d6621f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:32.162949 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf534b2f-bca9-4256-933d-e9d74d6621f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:10:32.163840 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf534b2f-bca9-4256-933d-e9d74d6621f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:32.171442 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf534b2f-bca9-4256-933d-e9d74d6621f6 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:32.231696 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 861/1680] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:10:32.235032 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf534b2f-bca9-4256-933d-e9d74d6621f6 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:32.269538 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-3ec7fdae-f1f5-41f1-9417-b54b2b7eea75 None None] MFA Rules not processed for user `7fa8a30eb9814ca086e8982e8aa4d64d`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:32.270529 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf534b2f-bca9-4256-933d-e9d74d6621f6 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:32.275110 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-3ec7fdae-f1f5-41f1-9417-b54b2b7eea75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:32.292371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e43ca0-388d-480c-aca4-37b2809a272e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:32.294678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e43ca0-388d-480c-aca4-37b2809a272e admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:32.295474 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e43ca0-388d-480c-aca4-37b2809a272e admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:32.296544 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e43ca0-388d-480c-aca4-37b2809a272e admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:32.299000 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e43ca0-388d-480c-aca4-37b2809a272e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:32.305185 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e43ca0-388d-480c-aca4-37b2809a272e admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:32.455972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:32.497645 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 862/1681] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:10:32 2022] POST /identity/v3/projects => generated 389 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:32.503157 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e43ca0-388d-480c-aca4-37b2809a272e admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:32.548081 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:32.608860 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 820/1682] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:32.614944 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7fdae-f1f5-41f1-9417-b54b2b7eea75 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:32.645246 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7fdae-f1f5-41f1-9417-b54b2b7eea75 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:32.686427 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e43ca0-388d-480c-aca4-37b2809a272e admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:32.709197 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d7c96-95de-42c8-833e-4f5a9fa4ed38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:32.711567 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d7c96-95de-42c8-833e-4f5a9fa4ed38 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:32.713613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d7c96-95de-42c8-833e-4f5a9fa4ed38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:32.716048 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d7c96-95de-42c8-833e-4f5a9fa4ed38 admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:32.720111 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d7c96-95de-42c8-833e-4f5a9fa4ed38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:32.725993 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d7c96-95de-42c8-833e-4f5a9fa4ed38 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:32.840875 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 863/1683] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:10:32 2022] POST /identity/v3/users => generated 295 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:10:32.844058 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0270d3-10d5-4616-84fa-1b3a2ef75f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:32.845796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0270d3-10d5-4616-84fa-1b3a2ef75f4f admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:32.846542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0270d3-10d5-4616-84fa-1b3a2ef75f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:32.847047 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0270d3-10d5-4616-84fa-1b3a2ef75f4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:32.847755 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d7c96-95de-42c8-833e-4f5a9fa4ed38 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:32.848446 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0270d3-10d5-4616-84fa-1b3a2ef75f4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:32.852880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0270d3-10d5-4616-84fa-1b3a2ef75f4f admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:32.904087 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d7c96-95de-42c8-833e-4f5a9fa4ed38 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:32.929330 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7431d7-3570-4596-b41a-e4bdea15b511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:32.940152 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7431d7-3570-4596-b41a-e4bdea15b511 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:32.940152 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7431d7-3570-4596-b41a-e4bdea15b511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:32.940152 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7431d7-3570-4596-b41a-e4bdea15b511 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:32.941676 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7431d7-3570-4596-b41a-e4bdea15b511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:32.946125 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7431d7-3570-4596-b41a-e4bdea15b511 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:32.979853 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 864/1684] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:10:32.988498 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7431d7-3570-4596-b41a-e4bdea15b511 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:33.045271 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7431d7-3570-4596-b41a-e4bdea15b511 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:33.064335 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 821/1685] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:10:32 2022] POST /identity/v3/projects => generated 365 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:33.065283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0270d3-10d5-4616-84fa-1b3a2ef75f4f admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:33.085228 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1ed3d-2f32-4a1d-b078-805e8a3eb9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:33.093838 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1ed3d-2f32-4a1d-b078-805e8a3eb9ff admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:33.095617 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1ed3d-2f32-4a1d-b078-805e8a3eb9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:33.098215 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1ed3d-2f32-4a1d-b078-805e8a3eb9ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:33.100987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f1ed3d-2f32-4a1d-b078-805e8a3eb9ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:33.114520 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f1ed3d-2f32-4a1d-b078-805e8a3eb9ff admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:33.185662 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 865/1686] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:10:33.192921 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1ed3d-2f32-4a1d-b078-805e8a3eb9ff admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:33.246954 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1ed3d-2f32-4a1d-b078-805e8a3eb9ff admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:33.463718 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0270d3-10d5-4616-84fa-1b3a2ef75f4f admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:33.502997 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be33aaf-f5b8-4282-9b5e-a7c413d1d719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:33.504138 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be33aaf-f5b8-4282-9b5e-a7c413d1d719 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:33.504745 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be33aaf-f5b8-4282-9b5e-a7c413d1d719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:33.505238 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be33aaf-f5b8-4282-9b5e-a7c413d1d719 admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:33.512447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be33aaf-f5b8-4282-9b5e-a7c413d1d719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:33.521523 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be33aaf-f5b8-4282-9b5e-a7c413d1d719 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:33.618656 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c92ff-6af7-4f59-9283-ce5ab7459826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:33.623361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c92ff-6af7-4f59-9283-ce5ab7459826 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:33.623900 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c92ff-6af7-4f59-9283-ce5ab7459826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:33.624598 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c92ff-6af7-4f59-9283-ce5ab7459826 admin admin] PATH_INFO: `/v3/projects/8e023d2ec5184a3b946928e9d6518307/users/bcd3f7946f0549b195c12af4acf0a61a/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:33.691453 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c92ff-6af7-4f59-9283-ce5ab7459826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e023d2ec5184a3b946928e9d6518307, user_id=bcd3f7946f0549b195c12af4acf0a61a, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:33.705536 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c92ff-6af7-4f59-9283-ce5ab7459826 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:33.756695 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 822/1687] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:10:33 2022] POST /identity/v3/users => generated 289 bytes in 689 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:33.758573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be33aaf-f5b8-4282-9b5e-a7c413d1d719 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:33.804947 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be33aaf-f5b8-4282-9b5e-a7c413d1d719 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:33.848714 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 866/1688] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:10:33 2022] PUT /identity/v3/projects/8e023d2ec5184a3b946928e9d6518307/users/bcd3f7946f0549b195c12af4acf0a61a/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:33.851004 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19cfc5-c1ad-4a73-bcf9-0faa0e9c4451 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:33.851905 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19cfc5-c1ad-4a73-bcf9-0faa0e9c4451 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:33.860683 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19cfc5-c1ad-4a73-bcf9-0faa0e9c4451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:33.946055 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-dd19cfc5-c1ad-4a73-bcf9-0faa0e9c4451 None None] MFA Rules not processed for user `bcd3f7946f0549b195c12af4acf0a61a`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:33.952136 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-dd19cfc5-c1ad-4a73-bcf9-0faa0e9c4451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:34.041159 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:34.149095 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b8837-7850-48ad-a733-8e78c3bafa52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:34.162455 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b8837-7850-48ad-a733-8e78c3bafa52 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:34.163070 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b8837-7850-48ad-a733-8e78c3bafa52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:34.163600 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b8837-7850-48ad-a733-8e78c3bafa52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:34.165353 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b8837-7850-48ad-a733-8e78c3bafa52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:34.169947 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:34.181075 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b8837-7850-48ad-a733-8e78c3bafa52 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:34.184188 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 867/1689] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:34.190632 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19cfc5-c1ad-4a73-bcf9-0faa0e9c4451 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:34.224693 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19cfc5-c1ad-4a73-bcf9-0faa0e9c4451 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:34.265723 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 823/1690] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 508 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:10:34.270474 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8bc88-36b4-4158-9097-7801f77c2b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:34.276595 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8bc88-36b4-4158-9097-7801f77c2b6b admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:34.276595 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8bc88-36b4-4158-9097-7801f77c2b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:34.276595 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8bc88-36b4-4158-9097-7801f77c2b6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:34.276595 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8bc88-36b4-4158-9097-7801f77c2b6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:34.292081 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8bc88-36b4-4158-9097-7801f77c2b6b admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:34.292450 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb2682-5d5a-47b3-8896-1f5b04bb162c None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:34.292450 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb2682-5d5a-47b3-8896-1f5b04bb162c None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:34.292450 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb2682-5d5a-47b3-8896-1f5b04bb162c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:34.499895 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 868/1691] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:10:34 2022] POST /identity/v3/projects => generated 385 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:34.499895 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8bc88-36b4-4158-9097-7801f77c2b6b admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:34.535950 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-82fb2682-5d5a-47b3-8896-1f5b04bb162c None None] MFA Rules not processed for user `ad3a9141e9284bb5a096fb04d3e9d581`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:34.565155 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-82fb2682-5d5a-47b3-8896-1f5b04bb162c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:34.794417 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8bc88-36b4-4158-9097-7801f77c2b6b admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:34.820853 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f517e1c-5009-4c21-955f-946588cd244f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:34.828792 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f517e1c-5009-4c21-955f-946588cd244f admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:34.828792 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f517e1c-5009-4c21-955f-946588cd244f admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:34.829161 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f517e1c-5009-4c21-955f-946588cd244f admin admin] PATH_INFO: `/v3/projects/4c23e01d8dc044b7afd3185f44696140/users/7f69e81fd0f54928b84e66b7f4744d65/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:34.877831 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f517e1c-5009-4c21-955f-946588cd244f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c23e01d8dc044b7afd3185f44696140, user_id=7f69e81fd0f54928b84e66b7f4744d65, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:34.886452 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f517e1c-5009-4c21-955f-946588cd244f admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:34.932508 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 824/1692] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 651 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:34.934558 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb2682-5d5a-47b3-8896-1f5b04bb162c None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:34.947699 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-82fb2682-5d5a-47b3-8896-1f5b04bb162c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:35.017833 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb2682-5d5a-47b3-8896-1f5b04bb162c None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:35.038911 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf9842-ac14-4be6-ac05-6039b813b621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:35.040050 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf9842-ac14-4be6-ac05-6039b813b621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:35.040550 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf9842-ac14-4be6-ac05-6039b813b621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:35.041036 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf9842-ac14-4be6-ac05-6039b813b621 admin admin] PATH_INFO: `/v3/users/5fc3c9af90504357b9f09ca0ebeb4bcc` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:35.048243 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf9842-ac14-4be6-ac05-6039b813b621 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fc3c9af90504357b9f09ca0ebeb4bcc)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:35.052084 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf9842-ac14-4be6-ac05-6039b813b621 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:35.116306 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 869/1693] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:10:34 2022] PUT /identity/v3/projects/4c23e01d8dc044b7afd3185f44696140/users/7f69e81fd0f54928b84e66b7f4744d65/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:35.119528 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f517e1c-5009-4c21-955f-946588cd244f admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:35.377743 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f517e1c-5009-4c21-955f-946588cd244f admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:35.404063 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf56987-bda6-49cc-b268-1d2eb2b6d315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:35.405987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf56987-bda6-49cc-b268-1d2eb2b6d315 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:35.405987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf56987-bda6-49cc-b268-1d2eb2b6d315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:35.406476 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf56987-bda6-49cc-b268-1d2eb2b6d315 admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:35.407875 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf56987-bda6-49cc-b268-1d2eb2b6d315 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:35.421080 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf56987-bda6-49cc-b268-1d2eb2b6d315 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:35.478649 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-7ebf9842-ac14-4be6-ac05-6039b813b621 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fc3c9af90504357b9f09ca0ebeb4bcc'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:35.537997 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-7ebf9842-ac14-4be6-ac05-6039b813b621 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fc3c9af90504357b9f09ca0ebeb4bcc'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:35.539313 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-7ebf9842-ac14-4be6-ac05-6039b813b621 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fc3c9af90504357b9f09ca0ebeb4bcc'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:35.581758 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 870/1694] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:10:35 2022] POST /identity/v3/users => generated 299 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:35.583362 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf56987-bda6-49cc-b268-1d2eb2b6d315 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:35.598592 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-fdf56987-bda6-49cc-b268-1d2eb2b6d315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:35.697342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-7ebf9842-ac14-4be6-ac05-6039b813b621 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fc3c9af90504357b9f09ca0ebeb4bcc'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:35.727881 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-7ebf9842-ac14-4be6-ac05-6039b813b621 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fc3c9af90504357b9f09ca0ebeb4bcc'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:35.738103 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 825/1695] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:10:34 2022] DELETE /identity/v3/users/5fc3c9af90504357b9f09ca0ebeb4bcc => generated 0 bytes in 805 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:35.739470 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf9842-ac14-4be6-ac05-6039b813b621 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:35.744010 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-7ebf9842-ac14-4be6-ac05-6039b813b621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:35.807450 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:35.891173 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf56987-bda6-49cc-b268-1d2eb2b6d315 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:35.894356 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:36.004973 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf9842-ac14-4be6-ac05-6039b813b621 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:36.034710 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafd68a-74be-4e6f-bf46-c9164a6fb396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:36.037509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafd68a-74be-4e6f-bf46-c9164a6fb396 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:36.038040 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafd68a-74be-4e6f-bf46-c9164a6fb396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:36.038523 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafd68a-74be-4e6f-bf46-c9164a6fb396 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:36.040004 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafd68a-74be-4e6f-bf46-c9164a6fb396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:36.043521 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafd68a-74be-4e6f-bf46-c9164a6fb396 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:36.094901 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 826/1696] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:10:36.106838 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3192c4-38bc-45f4-99e5-2c418f74f6f5 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:36.107322 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3192c4-38bc-45f4-99e5-2c418f74f6f5 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:36.108464 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3192c4-38bc-45f4-99e5-2c418f74f6f5 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:36.117663 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 827/1697] 10.222.0.20 () {54 vars in 961 bytes} [Tue Aug 2 09:10:36 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:10:36.119557 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3192c4-38bc-45f4-99e5-2c418f74f6f5 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:36.126604 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-eb3192c4-38bc-45f4-99e5-2c418f74f6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:36.174007 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3192c4-38bc-45f4-99e5-2c418f74f6f5 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:36.185462 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc0b73-0786-4cad-be3a-98aba0e62aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:36.186708 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc0b73-0786-4cad-be3a-98aba0e62aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:36.187227 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc0b73-0786-4cad-be3a-98aba0e62aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:36.187724 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc0b73-0786-4cad-be3a-98aba0e62aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:36.189164 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc0b73-0786-4cad-be3a-98aba0e62aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:36.193646 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc0b73-0786-4cad-be3a-98aba0e62aa0 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:36.218896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 828/1698] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:10:36.222065 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a0ccc-8249-46c0-a58d-3b6d40da2c8b None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:36.222954 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a0ccc-8249-46c0-a58d-3b6d40da2c8b None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:36.224002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a0ccc-8249-46c0-a58d-3b6d40da2c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:36.251773 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b217a84-19c3-4462-9b3d-9ba334db72e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:36.252870 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b217a84-19c3-4462-9b3d-9ba334db72e3 service nova] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:36.253415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b217a84-19c3-4462-9b3d-9ba334db72e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:36.253913 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b217a84-19c3-4462-9b3d-9ba334db72e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:36.260252 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-6b217a84-19c3-4462-9b3d-9ba334db72e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:36.268224 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-210a0ccc-8249-46c0-a58d-3b6d40da2c8b None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:36.272388 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-210a0ccc-8249-46c0-a58d-3b6d40da2c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:36.295360 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 829/1699] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:36.298120 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a0ccc-8249-46c0-a58d-3b6d40da2c8b None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:36.324886 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a0ccc-8249-46c0-a58d-3b6d40da2c8b None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:36.342641 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a6805-099e-4908-b79d-6956b1063f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:36.342641 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a6805-099e-4908-b79d-6956b1063f9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:36.342641 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a6805-099e-4908-b79d-6956b1063f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:36.342641 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a6805-099e-4908-b79d-6956b1063f9a admin admin] PATH_INFO: `/v3/projects/4c23e01d8dc044b7afd3185f44696140/users/7f69e81fd0f54928b84e66b7f4744d65/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:36.345944 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a6805-099e-4908-b79d-6956b1063f9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c23e01d8dc044b7afd3185f44696140, user_id=7f69e81fd0f54928b84e66b7f4744d65, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:36.352154 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a6805-099e-4908-b79d-6956b1063f9a admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:36.379256 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 830/1700] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:10:36 2022] PUT /identity/v3/projects/4c23e01d8dc044b7afd3185f44696140/users/7f69e81fd0f54928b84e66b7f4744d65/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:36.383035 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac966fc6-7986-4e5e-bc4f-3ca56dddd44e None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:36.383860 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac966fc6-7986-4e5e-bc4f-3ca56dddd44e None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:36.384608 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac966fc6-7986-4e5e-bc4f-3ca56dddd44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:36.436529 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-ac966fc6-7986-4e5e-bc4f-3ca56dddd44e None None] MFA Rules not processed for user `aa8cac76aa21415d8ab0a2524a7049d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:36.438528 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-ac966fc6-7986-4e5e-bc4f-3ca56dddd44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:36.491858 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b217a84-19c3-4462-9b3d-9ba334db72e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:36.494631 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b217a84-19c3-4462-9b3d-9ba334db72e3 service nova] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:36.524922 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 871/1701] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:10:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 943 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:10:36.540849 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b217a84-19c3-4462-9b3d-9ba334db72e3 service nova] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:36.546772 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 831/1702] 10.222.0.20 () {58 vars in 1058 bytes} [Tue Aug 2 09:10:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:36.548810 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac966fc6-7986-4e5e-bc4f-3ca56dddd44e None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:36.550433 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-ac966fc6-7986-4e5e-bc4f-3ca56dddd44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:36.624924 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b217a84-19c3-4462-9b3d-9ba334db72e3 service nova] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:36.639198 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac966fc6-7986-4e5e-bc4f-3ca56dddd44e None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:36.644070 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171274ea-4abb-42c5-8b88-66b2e07954de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:36.645192 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171274ea-4abb-42c5-8b88-66b2e07954de service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:36.645720 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171274ea-4abb-42c5-8b88-66b2e07954de service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:36.647625 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171274ea-4abb-42c5-8b88-66b2e07954de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:36.749163 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:36.778198 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171274ea-4abb-42c5-8b88-66b2e07954de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:36.781494 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171274ea-4abb-42c5-8b88-66b2e07954de service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:36.840897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 832/1703] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:10:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:10:36.844331 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d5377-c353-486e-b7fd-02e436c05ff4 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:36.846498 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d5377-c353-486e-b7fd-02e436c05ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:36.848688 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d5377-c353-486e-b7fd-02e436c05ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:36.897782 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048c775-748e-4e6a-bcdb-e0ffd401aeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:36.898961 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048c775-748e-4e6a-bcdb-e0ffd401aeed admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:36.900004 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048c775-748e-4e6a-bcdb-e0ffd401aeed admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:36.903986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048c775-748e-4e6a-bcdb-e0ffd401aeed admin admin] PATH_INFO: `/v3/projects/dfd9b90b1eb440ef883d429334a6febb/users/e853fec2284f4e77888bffab4b253b2b/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:36.966440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-7e8d5377-c353-486e-b7fd-02e436c05ff4 None None] MFA Rules not processed for user `7f69e81fd0f54928b84e66b7f4744d65`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:36.968745 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048c775-748e-4e6a-bcdb-e0ffd401aeed admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfd9b90b1eb440ef883d429334a6febb, user_id=e853fec2284f4e77888bffab4b253b2b, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:36.970354 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-7e8d5377-c353-486e-b7fd-02e436c05ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:36.973140 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048c775-748e-4e6a-bcdb-e0ffd401aeed admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:37.122312 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 872/1704] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:10:36 2022] PUT /identity/v3/projects/dfd9b90b1eb440ef883d429334a6febb/users/e853fec2284f4e77888bffab4b253b2b/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:37.154400 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048c775-748e-4e6a-bcdb-e0ffd401aeed admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:37.212683 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:37.318630 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 833/1705] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:36 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:37.350851 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d5377-c353-486e-b7fd-02e436c05ff4 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:37.418978 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d5377-c353-486e-b7fd-02e436c05ff4 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:37.549566 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048c775-748e-4e6a-bcdb-e0ffd401aeed admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:37.580403 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d502fc-4147-4f32-a44c-40a62aef0005 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cac76aa21415d8ab0a2524a7049d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:37.581547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d502fc-4147-4f32-a44c-40a62aef0005 service placement] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:37.583964 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d502fc-4147-4f32-a44c-40a62aef0005 service placement] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:37.587261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d502fc-4147-4f32-a44c-40a62aef0005 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:37.600091 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-e3d502fc-4147-4f32-a44c-40a62aef0005 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:37.656476 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d502fc-4147-4f32-a44c-40a62aef0005 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:37.666692 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d502fc-4147-4f32-a44c-40a62aef0005 service placement] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:37.689046 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df18c8-c040-48de-8a26-cfec09dbd7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:37.690542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df18c8-c040-48de-8a26-cfec09dbd7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:37.691041 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df18c8-c040-48de-8a26-cfec09dbd7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:37.691513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df18c8-c040-48de-8a26-cfec09dbd7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:37.692469 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df18c8-c040-48de-8a26-cfec09dbd7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:37.698856 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df18c8-c040-48de-8a26-cfec09dbd7b1 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:37.716988 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 873/1706] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:10:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:10:37.718570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d502fc-4147-4f32-a44c-40a62aef0005 service placement] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:37.726504 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-e3d502fc-4147-4f32-a44c-40a62aef0005 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:37.744942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 834/1707] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:10:37.755501 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df18c8-c040-48de-8a26-cfec09dbd7b1 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:37.791723 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df18c8-c040-48de-8a26-cfec09dbd7b1 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:37.814146 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21329b4-df15-43ae-a9b6-2f12d66c125b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:37.814886 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21329b4-df15-43ae-a9b6-2f12d66c125b admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:37.815174 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21329b4-df15-43ae-a9b6-2f12d66c125b admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:37.816078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21329b4-df15-43ae-a9b6-2f12d66c125b admin admin] PATH_INFO: `/v3/projects/dfd9b90b1eb440ef883d429334a6febb/users/e853fec2284f4e77888bffab4b253b2b/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:37.829278 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21329b4-df15-43ae-a9b6-2f12d66c125b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfd9b90b1eb440ef883d429334a6febb, user_id=e853fec2284f4e77888bffab4b253b2b, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:37.838534 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21329b4-df15-43ae-a9b6-2f12d66c125b admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:37.887452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 835/1708] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:10:37 2022] PUT /identity/v3/projects/dfd9b90b1eb440ef883d429334a6febb/users/e853fec2284f4e77888bffab4b253b2b/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:37.906025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82464106-b75e-4ba3-bc9e-068acef6e811 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:37.906546 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82464106-b75e-4ba3-bc9e-068acef6e811 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:37.907018 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82464106-b75e-4ba3-bc9e-068acef6e811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:37.950302 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d502fc-4147-4f32-a44c-40a62aef0005 service placement] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:38.007969 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-82464106-b75e-4ba3-bc9e-068acef6e811 None None] MFA Rules not processed for user `e853fec2284f4e77888bffab4b253b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:38.009317 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-82464106-b75e-4ba3-bc9e-068acef6e811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:38.109378 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81e89a-6049-4be0-9c12-7568420572e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:38.110271 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81e89a-6049-4be0-9c12-7568420572e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:38.114653 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81e89a-6049-4be0-9c12-7568420572e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:38.114653 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81e89a-6049-4be0-9c12-7568420572e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:38.255741 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:38.321851 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81e89a-6049-4be0-9c12-7568420572e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:38.327870 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81e89a-6049-4be0-9c12-7568420572e7 service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:38.377937 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 836/1709] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:38.386167 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 874/1710] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:10:37 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:10:38.464868 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82464106-b75e-4ba3-bc9e-068acef6e811 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:38.470392 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-82464106-b75e-4ba3-bc9e-068acef6e811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:38.495688 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82464106-b75e-4ba3-bc9e-068acef6e811 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:38.502055 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118b82b-e1a9-449b-bd98-0c58eec111b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:38.503460 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118b82b-e1a9-449b-bd98-0c58eec111b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:38.503715 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118b82b-e1a9-449b-bd98-0c58eec111b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:38.504294 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118b82b-e1a9-449b-bd98-0c58eec111b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:38.519248 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118b82b-e1a9-449b-bd98-0c58eec111b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:38.523560 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118b82b-e1a9-449b-bd98-0c58eec111b7 service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:38.541011 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 837/1711] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:10:38 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:10:38.926482 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81e89a-6049-4be0-9c12-7568420572e7 service cinder] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:38.945233 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:38.955353 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81e89a-6049-4be0-9c12-7568420572e7 service cinder] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:38.990475 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e98a78-d2dd-4932-838f-4c5a162236e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:38.995118 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e98a78-d2dd-4932-838f-4c5a162236e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:38.995897 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e98a78-d2dd-4932-838f-4c5a162236e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:38.997525 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e98a78-d2dd-4932-838f-4c5a162236e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:39.003191 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-b8e98a78-d2dd-4932-838f-4c5a162236e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:39.201328 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e98a78-d2dd-4932-838f-4c5a162236e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:39.203271 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e98a78-d2dd-4932-838f-4c5a162236e5 service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:39.229862 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 875/1712] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:10:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:10:39.560896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118b82b-e1a9-449b-bd98-0c58eec111b7 service cinder] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:39.564075 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-6118b82b-e1a9-449b-bd98-0c58eec111b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:39.883098 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118b82b-e1a9-449b-bd98-0c58eec111b7 service cinder] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:39.906572 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb361d6-8640-493c-8f71-18775dd2add3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:39.907291 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb361d6-8640-493c-8f71-18775dd2add3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:39.907536 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb361d6-8640-493c-8f71-18775dd2add3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:39.907800 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb361d6-8640-493c-8f71-18775dd2add3 admin admin] PATH_INFO: `/v3/projects/6face5ff38704f6fb2b2c17eeeaea1b8` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:39.910222 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb361d6-8640-493c-8f71-18775dd2add3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6face5ff38704f6fb2b2c17eeeaea1b8)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:39.912322 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb361d6-8640-493c-8f71-18775dd2add3 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:39.950584 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e98a78-d2dd-4932-838f-4c5a162236e5 service cinder] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:39.980150 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e98a78-d2dd-4932-838f-4c5a162236e5 service cinder] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:39.992319 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703cb49f-dc54-493f-93e4-925e9898492e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:39.993381 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cb49f-dc54-493f-93e4-925e9898492e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:39.994262 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cb49f-dc54-493f-93e4-925e9898492e admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:39.995437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cb49f-dc54-493f-93e4-925e9898492e admin admin] PATH_INFO: `/v3/users/bcd3f7946f0549b195c12af4acf0a61a` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:39.997552 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703cb49f-dc54-493f-93e4-925e9898492e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcd3f7946f0549b195c12af4acf0a61a)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:40.002013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703cb49f-dc54-493f-93e4-925e9898492e admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:40.341330 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5fb361d6-8640-493c-8f71-18775dd2add3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6face5ff38704f6fb2b2c17eeeaea1b8', 'request_id': 'req-5fb361d6-8640-493c-8f71-18775dd2add3'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:40.408295 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5fb361d6-8640-493c-8f71-18775dd2add3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6face5ff38704f6fb2b2c17eeeaea1b8', 'request_id': 'req-5fb361d6-8640-493c-8f71-18775dd2add3'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:40.457990 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5fb361d6-8640-493c-8f71-18775dd2add3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6face5ff38704f6fb2b2c17eeeaea1b8', 'request_id': 'req-5fb361d6-8640-493c-8f71-18775dd2add3'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:40.472049 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-703cb49f-dc54-493f-93e4-925e9898492e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcd3f7946f0549b195c12af4acf0a61a'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:40.643207 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5fb361d6-8640-493c-8f71-18775dd2add3 admin admin] The token cache is being invalidate because project 6face5ff38704f6fb2b2c17eeeaea1b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:10:40.643779 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5fb361d6-8640-493c-8f71-18775dd2add3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:40.645589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5fb361d6-8640-493c-8f71-18775dd2add3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:40.652892 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 838/1713] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:10:39 2022] DELETE /identity/v3/projects/6face5ff38704f6fb2b2c17eeeaea1b8 => generated 0 bytes in 1093 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:40.660960 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8ed21-5104-4c6e-83cf-ab446016be2e None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:40.662575 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8ed21-5104-4c6e-83cf-ab446016be2e None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:40.662575 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8ed21-5104-4c6e-83cf-ab446016be2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:40.712009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-703cb49f-dc54-493f-93e4-925e9898492e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcd3f7946f0549b195c12af4acf0a61a'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:40.722767 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-703cb49f-dc54-493f-93e4-925e9898492e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcd3f7946f0549b195c12af4acf0a61a'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:40.731344 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-703cb49f-dc54-493f-93e4-925e9898492e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcd3f7946f0549b195c12af4acf0a61a'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:40.733592 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-703cb49f-dc54-493f-93e4-925e9898492e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcd3f7946f0549b195c12af4acf0a61a'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:40.775617 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-e6f8ed21-5104-4c6e-83cf-ab446016be2e None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:40.777348 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-e6f8ed21-5104-4c6e-83cf-ab446016be2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:40.781001 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 876/1714] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:10:39 2022] DELETE /identity/v3/users/bcd3f7946f0549b195c12af4acf0a61a => generated 0 bytes in 832 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:40.788086 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13231c33-e616-4999-b927-a32301a9387d None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:40.794520 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13231c33-e616-4999-b927-a32301a9387d None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:40.794520 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13231c33-e616-4999-b927-a32301a9387d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:40.851399 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-13231c33-e616-4999-b927-a32301a9387d None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:40.852857 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-13231c33-e616-4999-b927-a32301a9387d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:41.092994 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 839/1715] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:41.098186 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5be5a-e5b6-497c-8af1-2b0d2c2a4996 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:41.098773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5be5a-e5b6-497c-8af1-2b0d2c2a4996 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:41.099854 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5be5a-e5b6-497c-8af1-2b0d2c2a4996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:41.108380 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 877/1716] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:41.121817 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:41.153976 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-42f5be5a-e5b6-497c-8af1-2b0d2c2a4996 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:41.160714 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-42f5be5a-e5b6-497c-8af1-2b0d2c2a4996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:41.166567 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13231c33-e616-4999-b927-a32301a9387d None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:41.168603 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-13231c33-e616-4999-b927-a32301a9387d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:41.209517 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 840/1717] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:41.213446 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5be5a-e5b6-497c-8af1-2b0d2c2a4996 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:41.224749 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:41.236435 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5be5a-e5b6-497c-8af1-2b0d2c2a4996 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:41.258928 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39251f-c43d-4664-929c-e28b5df54172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:41.263073 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39251f-c43d-4664-929c-e28b5df54172 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:41.263073 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39251f-c43d-4664-929c-e28b5df54172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:41.263073 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39251f-c43d-4664-929c-e28b5df54172 admin admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:41.270516 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39251f-c43d-4664-929c-e28b5df54172 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:10:41.272101 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39251f-c43d-4664-929c-e28b5df54172 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:41.274834 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39251f-c43d-4664-929c-e28b5df54172 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:41.309739 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 841/1718] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:10:41.319965 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39251f-c43d-4664-929c-e28b5df54172 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:41.371870 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13231c33-e616-4999-b927-a32301a9387d None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:41.374217 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39251f-c43d-4664-929c-e28b5df54172 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:41.388972 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16614b-3e57-4da9-b143-c1960e9a22e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:41.390150 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16614b-3e57-4da9-b143-c1960e9a22e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:41.390628 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16614b-3e57-4da9-b143-c1960e9a22e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:41.390980 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16614b-3e57-4da9-b143-c1960e9a22e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:41.408116 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caac682-176b-43da-bf00-d47e6f2b888a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:41.413192 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caac682-176b-43da-bf00-d47e6f2b888a admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:41.416022 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caac682-176b-43da-bf00-d47e6f2b888a admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:41.417269 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caac682-176b-43da-bf00-d47e6f2b888a admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:41.417816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16614b-3e57-4da9-b143-c1960e9a22e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:41.418738 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caac682-176b-43da-bf00-d47e6f2b888a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:41.421734 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16614b-3e57-4da9-b143-c1960e9a22e5 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:41.450682 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caac682-176b-43da-bf00-d47e6f2b888a admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:41.455586 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 878/1719] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:10:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:10:41.457470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a599ef-4d97-4055-b499-0550146178e6 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:41.457978 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a599ef-4d97-4055-b499-0550146178e6 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:41.459087 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a599ef-4d97-4055-b499-0550146178e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:41.522565 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-91a599ef-4d97-4055-b499-0550146178e6 None None] MFA Rules not processed for user `4a1a40ef55434cd48a2dc4385880fe0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:41.523868 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-91a599ef-4d97-4055-b499-0550146178e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:41.621168 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 842/1720] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:10:41 2022] POST /identity/v3/projects => generated 373 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:41.626652 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55709fe5-9aee-479a-b466-8d3dce13fcc9 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:41.627173 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55709fe5-9aee-479a-b466-8d3dce13fcc9 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:41.627655 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55709fe5-9aee-479a-b466-8d3dce13fcc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:41.703522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-55709fe5-9aee-479a-b466-8d3dce13fcc9 None None] MFA Rules not processed for user `1eda94767d1547fa82f6407a4c7de1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:41.704597 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-55709fe5-9aee-479a-b466-8d3dce13fcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:41.760702 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 879/1721] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:41.761643 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a599ef-4d97-4055-b499-0550146178e6 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:41.807426 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a599ef-4d97-4055-b499-0550146178e6 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:42.031928 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 843/1722] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:42.031928 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55709fe5-9aee-479a-b466-8d3dce13fcc9 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:42.033249 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-55709fe5-9aee-479a-b466-8d3dce13fcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:42.130994 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08780b-1e7d-4213-9bf0-c63f2d1950cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:42.134464 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08780b-1e7d-4213-9bf0-c63f2d1950cb admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:42.135231 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08780b-1e7d-4213-9bf0-c63f2d1950cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:42.136554 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08780b-1e7d-4213-9bf0-c63f2d1950cb admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:42.141835 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08780b-1e7d-4213-9bf0-c63f2d1950cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:42.153763 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08780b-1e7d-4213-9bf0-c63f2d1950cb admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:42.393999 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 880/1723] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:10:41 2022] POST /identity/v3/users => generated 287 bytes in 633 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:42.397101 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d441af-91b2-4ce9-a812-f776027b65b7 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:42.401888 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d441af-91b2-4ce9-a812-f776027b65b7 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:42.402560 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d441af-91b2-4ce9-a812-f776027b65b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:42.453742 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55709fe5-9aee-479a-b466-8d3dce13fcc9 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:42.481032 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-b5d441af-91b2-4ce9-a812-f776027b65b7 None None] MFA Rules not processed for user `1eda94767d1547fa82f6407a4c7de1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:42.482347 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-b5d441af-91b2-4ce9-a812-f776027b65b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:42.508601 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 881/1724] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:42.509736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae79ecd9-4e32-47e6-bb0f-5bee0cd10c39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:42.516072 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d441af-91b2-4ce9-a812-f776027b65b7 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:42.516367 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79ecd9-4e32-47e6-bb0f-5bee0cd10c39 service nova] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:42.530465 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79ecd9-4e32-47e6-bb0f-5bee0cd10c39 service nova] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:42.531944 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79ecd9-4e32-47e6-bb0f-5bee0cd10c39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:42.553692 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d441af-91b2-4ce9-a812-f776027b65b7 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:42.580309 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb737c7-8cd5-4fb9-950b-9f9c975e06ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:42.582925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb737c7-8cd5-4fb9-950b-9f9c975e06ca admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:42.582925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb737c7-8cd5-4fb9-950b-9f9c975e06ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:42.582925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb737c7-8cd5-4fb9-950b-9f9c975e06ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:42.582925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb737c7-8cd5-4fb9-950b-9f9c975e06ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:42.588144 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb737c7-8cd5-4fb9-950b-9f9c975e06ca admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:42.660312 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 882/1725] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:10:42.662656 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb737c7-8cd5-4fb9-950b-9f9c975e06ca admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:42.689086 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb737c7-8cd5-4fb9-950b-9f9c975e06ca admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:42.700000 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243a7b1-9aa2-436d-b2fa-e875abb6efe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:42.700766 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243a7b1-9aa2-436d-b2fa-e875abb6efe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:42.701148 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243a7b1-9aa2-436d-b2fa-e875abb6efe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:42.701543 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243a7b1-9aa2-436d-b2fa-e875abb6efe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:42.702370 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243a7b1-9aa2-436d-b2fa-e875abb6efe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:42.704152 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243a7b1-9aa2-436d-b2fa-e875abb6efe6 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:42.730232 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 883/1726] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:10:42.807514 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243a7b1-9aa2-436d-b2fa-e875abb6efe6 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:42.807514 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243a7b1-9aa2-436d-b2fa-e875abb6efe6 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:42.828182 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14edbc-2f0a-42fc-87cf-f1632a39647a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:42.828182 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14edbc-2f0a-42fc-87cf-f1632a39647a admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:42.828182 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14edbc-2f0a-42fc-87cf-f1632a39647a admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:42.830109 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14edbc-2f0a-42fc-87cf-f1632a39647a admin admin] PATH_INFO: `/v3/projects/c0dc48dd9e3f4cf0a93c4f91d52d4cda/users/4ee442e6640c4e6a8f5426d6ab613783/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:42.874053 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14edbc-2f0a-42fc-87cf-f1632a39647a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0dc48dd9e3f4cf0a93c4f91d52d4cda, user_id=4ee442e6640c4e6a8f5426d6ab613783, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:42.878336 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:42.888786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14edbc-2f0a-42fc-87cf-f1632a39647a admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:42.929296 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae79ecd9-4e32-47e6-bb0f-5bee0cd10c39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:42.930926 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae79ecd9-4e32-47e6-bb0f-5bee0cd10c39 service nova] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:42.977840 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 844/1727] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:10:42 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 934 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:10:42.977840 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae79ecd9-4e32-47e6-bb0f-5bee0cd10c39 service nova] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:42.977840 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-ae79ecd9-4e32-47e6-bb0f-5bee0cd10c39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:43.009957 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae79ecd9-4e32-47e6-bb0f-5bee0cd10c39 service nova] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:43.021371 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d6a25-8968-48c4-83cf-3b507c42bbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:43.023005 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d6a25-8968-48c4-83cf-3b507c42bbbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:43.023456 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d6a25-8968-48c4-83cf-3b507c42bbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:43.023877 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d6a25-8968-48c4-83cf-3b507c42bbbf admin admin] PATH_INFO: `/v3/projects/8e023d2ec5184a3b946928e9d6518307` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:43.038119 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d6a25-8968-48c4-83cf-3b507c42bbbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e023d2ec5184a3b946928e9d6518307)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:43.043951 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d6a25-8968-48c4-83cf-3b507c42bbbf admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:43.289872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:43.362503 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 884/1728] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:10:42 2022] PUT /identity/v3/projects/c0dc48dd9e3f4cf0a93c4f91d52d4cda/users/4ee442e6640c4e6a8f5426d6ab613783/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:43.376015 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14edbc-2f0a-42fc-87cf-f1632a39647a admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:43.398621 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-ff14edbc-2f0a-42fc-87cf-f1632a39647a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:43.482795 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5e5d6a25-8968-48c4-83cf-3b507c42bbbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e023d2ec5184a3b946928e9d6518307', 'request_id': 'req-5e5d6a25-8968-48c4-83cf-3b507c42bbbf'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:43.509001 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5e5d6a25-8968-48c4-83cf-3b507c42bbbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e023d2ec5184a3b946928e9d6518307', 'request_id': 'req-5e5d6a25-8968-48c4-83cf-3b507c42bbbf'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:43.600803 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5e5d6a25-8968-48c4-83cf-3b507c42bbbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e023d2ec5184a3b946928e9d6518307', 'request_id': 'req-5e5d6a25-8968-48c4-83cf-3b507c42bbbf'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:43.766841 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5e5d6a25-8968-48c4-83cf-3b507c42bbbf admin admin] The token cache is being invalidate because project 8e023d2ec5184a3b946928e9d6518307 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:10:43.774835 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5e5d6a25-8968-48c4-83cf-3b507c42bbbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:43.776916 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5e5d6a25-8968-48c4-83cf-3b507c42bbbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:43.778695 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14edbc-2f0a-42fc-87cf-f1632a39647a admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:43.813088 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 845/1729] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:10:42 2022] DELETE /identity/v3/projects/8e023d2ec5184a3b946928e9d6518307 => generated 0 bytes in 848 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:43.826819 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac4bb8-7fd6-4ee2-99df-13687ad67ba1 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:43.830307 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac4bb8-7fd6-4ee2-99df-13687ad67ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:43.831087 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac4bb8-7fd6-4ee2-99df-13687ad67ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:43.990528 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-5eac4bb8-7fd6-4ee2-99df-13687ad67ba1 None None] MFA Rules not processed for user `4ee442e6640c4e6a8f5426d6ab613783`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:43.994612 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-5eac4bb8-7fd6-4ee2-99df-13687ad67ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:44.160882 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5321d99-acf5-4fa1-a707-8f40edd848c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:44.165763 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5321d99-acf5-4fa1-a707-8f40edd848c7 service nova] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:44.166205 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5321d99-acf5-4fa1-a707-8f40edd848c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:44.190529 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5321d99-acf5-4fa1-a707-8f40edd848c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:44.206657 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-a5321d99-acf5-4fa1-a707-8f40edd848c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:44.430334 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 846/1730] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 617 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:44.432445 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac4bb8-7fd6-4ee2-99df-13687ad67ba1 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:44.436823 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-5eac4bb8-7fd6-4ee2-99df-13687ad67ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:44.570953 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5321d99-acf5-4fa1-a707-8f40edd848c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:44.573668 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5321d99-acf5-4fa1-a707-8f40edd848c7 service nova] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:44.622856 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 885/1731] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:10:43 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 1251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:10:44.688861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac4bb8-7fd6-4ee2-99df-13687ad67ba1 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:44.704240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62952f3c-10a3-48e4-89af-47ec63ad0843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:44.706068 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62952f3c-10a3-48e4-89af-47ec63ad0843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:44.706971 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62952f3c-10a3-48e4-89af-47ec63ad0843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:44.714878 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62952f3c-10a3-48e4-89af-47ec63ad0843 admin admin] PATH_INFO: `/v3/users/e853fec2284f4e77888bffab4b253b2b` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:44.714878 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62952f3c-10a3-48e4-89af-47ec63ad0843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e853fec2284f4e77888bffab4b253b2b)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:44.720074 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62952f3c-10a3-48e4-89af-47ec63ad0843 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:44.729079 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:45.045318 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5321d99-acf5-4fa1-a707-8f40edd848c7 service nova] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:45.049445 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-a5321d99-acf5-4fa1-a707-8f40edd848c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:45.071255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5321d99-acf5-4fa1-a707-8f40edd848c7 service nova] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:45.079185 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef31fab-1700-42f4-abca-9314f0a7859d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:45.080557 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef31fab-1700-42f4-abca-9314f0a7859d service nova] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:45.082111 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef31fab-1700-42f4-abca-9314f0a7859d service nova] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:45.082737 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef31fab-1700-42f4-abca-9314f0a7859d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:45.107308 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-62952f3c-10a3-48e4-89af-47ec63ad0843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e853fec2284f4e77888bffab4b253b2b'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:45.110319 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef31fab-1700-42f4-abca-9314f0a7859d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:45.130770 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef31fab-1700-42f4-abca-9314f0a7859d service nova] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:45.141971 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-62952f3c-10a3-48e4-89af-47ec63ad0843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e853fec2284f4e77888bffab4b253b2b'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:45.143268 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-62952f3c-10a3-48e4-89af-47ec63ad0843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e853fec2284f4e77888bffab4b253b2b'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:45.170846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 886/1732] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:10:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:10:45.242792 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-62952f3c-10a3-48e4-89af-47ec63ad0843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e853fec2284f4e77888bffab4b253b2b'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:45.264914 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-62952f3c-10a3-48e4-89af-47ec63ad0843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e853fec2284f4e77888bffab4b253b2b'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:45.295158 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 847/1733] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:10:44 2022] DELETE /identity/v3/users/e853fec2284f4e77888bffab4b253b2b => generated 0 bytes in 861 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:45.754731 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248c392-3933-430c-a142-4eaaf8946c85 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:45.756596 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248c392-3933-430c-a142-4eaaf8946c85 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:45.757431 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248c392-3933-430c-a142-4eaaf8946c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:45.817515 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:45.841205 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-3248c392-3933-430c-a142-4eaaf8946c85 None None] MFA Rules not processed for user `ad3a9141e9284bb5a096fb04d3e9d581`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:45.846438 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-3248c392-3933-430c-a142-4eaaf8946c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:46.042572 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2619d5-768d-4ef6-99c1-beae76f43485 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:46.043058 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2619d5-768d-4ef6-99c1-beae76f43485 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:46.043732 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2619d5-768d-4ef6-99c1-beae76f43485 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:46.046663 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 848/1734] 10.222.0.20 () {54 vars in 912 bytes} [Tue Aug 2 09:10:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:10:46.061185 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c5a91-4f96-405c-a6de-33f4f2a3b157 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:46.061731 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c5a91-4f96-405c-a6de-33f4f2a3b157 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:46.062196 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c5a91-4f96-405c-a6de-33f4f2a3b157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:46.101690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 887/1735] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:46.195306 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-cb1c5a91-4f96-405c-a6de-33f4f2a3b157 None None] MFA Rules not processed for user `6128f07ffd5f4357968b0e2e300f2e09`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:46.202145 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-cb1c5a91-4f96-405c-a6de-33f4f2a3b157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:46.274751 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d26fb-6567-498d-a02a-4723872b131b None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:46.288985 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d26fb-6567-498d-a02a-4723872b131b None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:46.290866 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d26fb-6567-498d-a02a-4723872b131b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:46.475320 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 849/1736] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Aug 2 09:10:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:46.485645 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-a78d26fb-6567-498d-a02a-4723872b131b None None] MFA Rules not processed for user `eb640d92cb9b49019f42351a60efe258`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:46.499528 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-a78d26fb-6567-498d-a02a-4723872b131b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:46.499624 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c5a91-4f96-405c-a6de-33f4f2a3b157 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:46.499624 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-cb1c5a91-4f96-405c-a6de-33f4f2a3b157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:46.549087 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c5a91-4f96-405c-a6de-33f4f2a3b157 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:46.590454 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40a021-58b0-49f8-a024-387c1010c104 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:46.591587 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40a021-58b0-49f8-a024-387c1010c104 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:46.604342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40a021-58b0-49f8-a024-387c1010c104 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:46.604342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40a021-58b0-49f8-a024-387c1010c104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:46.668091 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40a021-58b0-49f8-a024-387c1010c104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:46.671017 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40a021-58b0-49f8-a024-387c1010c104 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:46.705458 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 888/1737] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Aug 2 09:10:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:46.725111 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 850/1738] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:10:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:10:47.313993 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d26fb-6567-498d-a02a-4723872b131b None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:47.316414 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-a78d26fb-6567-498d-a02a-4723872b131b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:47.851622 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d26fb-6567-498d-a02a-4723872b131b None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:47.873133 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c7413-5614-4b31-9360-9bf303b47943 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f8e572550b4ab5955d7a94f1563441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:47.874205 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c7413-5614-4b31-9360-9bf303b47943 service swift] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:47.874692 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c7413-5614-4b31-9360-9bf303b47943 service swift] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:47.875447 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c7413-5614-4b31-9360-9bf303b47943 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:47.896479 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c7413-5614-4b31-9360-9bf303b47943 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:47.896479 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c7413-5614-4b31-9360-9bf303b47943 service swift] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:47.902780 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:47.924377 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 889/1739] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Aug 2 09:10:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:10:48.411952 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40a021-58b0-49f8-a024-387c1010c104 service neutron] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:48.414305 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-2a40a021-58b0-49f8-a024-387c1010c104 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:48.662919 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40a021-58b0-49f8-a024-387c1010c104 service neutron] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:48.684334 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152e755-7a3f-4a9e-b475-91531e1001aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:48.687383 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152e755-7a3f-4a9e-b475-91531e1001aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:48.688056 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152e755-7a3f-4a9e-b475-91531e1001aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:48.688580 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152e755-7a3f-4a9e-b475-91531e1001aa admin admin] PATH_INFO: `/v3/projects/dfd9b90b1eb440ef883d429334a6febb` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:48.695101 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152e755-7a3f-4a9e-b475-91531e1001aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfd9b90b1eb440ef883d429334a6febb)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:48.702649 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152e755-7a3f-4a9e-b475-91531e1001aa admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:48.793432 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:49.073107 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-c152e755-7a3f-4a9e-b475-91531e1001aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfd9b90b1eb440ef883d429334a6febb', 'request_id': 'req-c152e755-7a3f-4a9e-b475-91531e1001aa'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:49.088113 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-c152e755-7a3f-4a9e-b475-91531e1001aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfd9b90b1eb440ef883d429334a6febb', 'request_id': 'req-c152e755-7a3f-4a9e-b475-91531e1001aa'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:49.101543 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-c152e755-7a3f-4a9e-b475-91531e1001aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfd9b90b1eb440ef883d429334a6febb', 'request_id': 'req-c152e755-7a3f-4a9e-b475-91531e1001aa'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:49.203905 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c7413-5614-4b31-9360-9bf303b47943 service swift] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:49.218771 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-574c7413-5614-4b31-9360-9bf303b47943 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:49.242090 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-c152e755-7a3f-4a9e-b475-91531e1001aa admin admin] The token cache is being invalidate because project dfd9b90b1eb440ef883d429334a6febb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:10:49.243522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-c152e755-7a3f-4a9e-b475-91531e1001aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:49.246334 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-c152e755-7a3f-4a9e-b475-91531e1001aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:49.261344 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 851/1740] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:10:48 2022] DELETE /identity/v3/projects/dfd9b90b1eb440ef883d429334a6febb => generated 0 bytes in 851 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:49.273461 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce38d3e-8816-41ff-8585-55829518dc5d None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:49.276922 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce38d3e-8816-41ff-8585-55829518dc5d None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:49.277517 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce38d3e-8816-41ff-8585-55829518dc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:49.340792 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-0ce38d3e-8816-41ff-8585-55829518dc5d None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:49.342996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-0ce38d3e-8816-41ff-8585-55829518dc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:49.344134 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c7413-5614-4b31-9360-9bf303b47943 service swift] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:49.570811 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 852/1741] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:49.572614 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97738b-60e6-4863-921d-d380dcd1e2fc None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:49.572900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97738b-60e6-4863-921d-d380dcd1e2fc None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:49.573176 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97738b-60e6-4863-921d-d380dcd1e2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:49.610767 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-7a97738b-60e6-4863-921d-d380dcd1e2fc None None] MFA Rules not processed for user `4a1a40ef55434cd48a2dc4385880fe0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:49.612677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-7a97738b-60e6-4863-921d-d380dcd1e2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:49.761273 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64cdd1-4892-4044-b9c4-50e2381f9c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:49.766214 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64cdd1-4892-4044-b9c4-50e2381f9c61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:49.767988 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64cdd1-4892-4044-b9c4-50e2381f9c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:49.771314 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64cdd1-4892-4044-b9c4-50e2381f9c61 admin admin] PATH_INFO: `/v3/users/4ee442e6640c4e6a8f5426d6ab613783` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:49.778665 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64cdd1-4892-4044-b9c4-50e2381f9c61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ee442e6640c4e6a8f5426d6ab613783)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:49.786040 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64cdd1-4892-4044-b9c4-50e2381f9c61 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:49.791130 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 853/1742] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:49.809908 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaed12a-97ca-40e9-ad44-c8adc59b93db None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:49.811199 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaed12a-97ca-40e9-ad44-c8adc59b93db None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:49.812765 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaed12a-97ca-40e9-ad44-c8adc59b93db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:49.959184 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-dbaed12a-97ca-40e9-ad44-c8adc59b93db None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:49.965618 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-dbaed12a-97ca-40e9-ad44-c8adc59b93db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:49.995784 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 854/1743] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:49.995784 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae4d92-4d76-4254-869c-dddc5bf8c375 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:49.996067 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae4d92-4d76-4254-869c-dddc5bf8c375 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:49.997129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae4d92-4d76-4254-869c-dddc5bf8c375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:50.077419 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-feae4d92-4d76-4254-869c-dddc5bf8c375 None None] MFA Rules not processed for user `1eda94767d1547fa82f6407a4c7de1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:50.080741 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-feae4d92-4d76-4254-869c-dddc5bf8c375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:50.249245 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-da64cdd1-4892-4044-b9c4-50e2381f9c61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ee442e6640c4e6a8f5426d6ab613783'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:50.341750 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 855/1744] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:50.369121 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae4d92-4d76-4254-869c-dddc5bf8c375 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:50.374326 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-da64cdd1-4892-4044-b9c4-50e2381f9c61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ee442e6640c4e6a8f5426d6ab613783'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:50.409350 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae4d92-4d76-4254-869c-dddc5bf8c375 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:50.422780 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-da64cdd1-4892-4044-b9c4-50e2381f9c61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ee442e6640c4e6a8f5426d6ab613783'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:50.428957 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167c617-e4d9-4d9d-a060-6e429211933a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:50.429910 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167c617-e4d9-4d9d-a060-6e429211933a admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:50.430029 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-da64cdd1-4892-4044-b9c4-50e2381f9c61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ee442e6640c4e6a8f5426d6ab613783'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:50.430645 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167c617-e4d9-4d9d-a060-6e429211933a admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:50.431308 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167c617-e4d9-4d9d-a060-6e429211933a admin admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:50.431624 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-da64cdd1-4892-4044-b9c4-50e2381f9c61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ee442e6640c4e6a8f5426d6ab613783'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:50.432241 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167c617-e4d9-4d9d-a060-6e429211933a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:10:50.432745 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167c617-e4d9-4d9d-a060-6e429211933a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:50.435023 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167c617-e4d9-4d9d-a060-6e429211933a admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:50.453102 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 856/1745] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:10:50.459042 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167c617-e4d9-4d9d-a060-6e429211933a admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:50.462195 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-9167c617-e4d9-4d9d-a060-6e429211933a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:50.476434 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 890/1746] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:10:49 2022] DELETE /identity/v3/users/4ee442e6640c4e6a8f5426d6ab613783 => generated 0 bytes in 1277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:10:50.485542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167c617-e4d9-4d9d-a060-6e429211933a admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:50.485793 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bda405-0865-42c3-83d1-bf0716a7f92f None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:50.486041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bda405-0865-42c3-83d1-bf0716a7f92f None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:50.488243 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bda405-0865-42c3-83d1-bf0716a7f92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:50.566609 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-e5bda405-0865-42c3-83d1-bf0716a7f92f None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:50.586651 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-e5bda405-0865-42c3-83d1-bf0716a7f92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:50.698809 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b356b3-8419-4413-bf35-9ecf9225afb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:50.699569 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b356b3-8419-4413-bf35-9ecf9225afb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:50.699806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b356b3-8419-4413-bf35-9ecf9225afb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:50.700087 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b356b3-8419-4413-bf35-9ecf9225afb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:50.700928 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b356b3-8419-4413-bf35-9ecf9225afb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:50.706946 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b356b3-8419-4413-bf35-9ecf9225afb2 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:50.774480 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 891/1747] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:10:50.788627 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bda405-0865-42c3-83d1-bf0716a7f92f None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:50.790746 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-e5bda405-0865-42c3-83d1-bf0716a7f92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:50.820906 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:50.941272 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bda405-0865-42c3-83d1-bf0716a7f92f None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:50.947373 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 857/1748] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:10:50 2022] POST /identity/v3/projects => generated 377 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:50.949826 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b356b3-8419-4413-bf35-9ecf9225afb2 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:51.165033 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b356b3-8419-4413-bf35-9ecf9225afb2 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:51.173716 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53fdb4-533b-4c90-836d-81f2c9b88c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:51.175010 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53fdb4-533b-4c90-836d-81f2c9b88c27 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:51.175299 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53fdb4-533b-4c90-836d-81f2c9b88c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:51.175576 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53fdb4-533b-4c90-836d-81f2c9b88c27 admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:51.176463 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53fdb4-533b-4c90-836d-81f2c9b88c27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:51.183220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53fdb4-533b-4c90-836d-81f2c9b88c27 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:51.262295 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a09a4-246a-4430-9c26-dcdbf5ed6dd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:51.267660 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a09a4-246a-4430-9c26-dcdbf5ed6dd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:51.267660 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a09a4-246a-4430-9c26-dcdbf5ed6dd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:51.304261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a09a4-246a-4430-9c26-dcdbf5ed6dd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:51.387043 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:51.388894 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 858/1749] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:10:50 2022] POST /identity/v3/users => generated 289 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:51.394309 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53fdb4-533b-4c90-836d-81f2c9b88c27 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:51.436401 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9a09a4-246a-4430-9c26-dcdbf5ed6dd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:51.447207 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9a09a4-246a-4430-9c26-dcdbf5ed6dd7 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:51.482437 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53fdb4-533b-4c90-836d-81f2c9b88c27 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:51.519401 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640f545-e374-4b41-ae0b-00bc11e1931c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:51.525241 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640f545-e374-4b41-ae0b-00bc11e1931c admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:51.526405 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 892/1750] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:10:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 738 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:10:51.529242 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640f545-e374-4b41-ae0b-00bc11e1931c admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:51.529652 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640f545-e374-4b41-ae0b-00bc11e1931c admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:51.530487 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640f545-e374-4b41-ae0b-00bc11e1931c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:51.541099 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640f545-e374-4b41-ae0b-00bc11e1931c admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:51.625092 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a09a4-246a-4430-9c26-dcdbf5ed6dd7 service neutron] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:51.641272 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 859/1751] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:10:51.654196 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a09a4-246a-4430-9c26-dcdbf5ed6dd7 service neutron] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:51.673584 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7fe0b-bf66-463b-ad76-9965815a5faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:51.674290 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7fe0b-bf66-463b-ad76-9965815a5faa admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:51.674749 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7fe0b-bf66-463b-ad76-9965815a5faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:51.678249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7fe0b-bf66-463b-ad76-9965815a5faa admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:51.678249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b7fe0b-bf66-463b-ad76-9965815a5faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:51.686968 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b7fe0b-bf66-463b-ad76-9965815a5faa admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:51.725410 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 893/1752] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:10:51.729925 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640f545-e374-4b41-ae0b-00bc11e1931c admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:51.764667 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640f545-e374-4b41-ae0b-00bc11e1931c admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:51.796979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449b877-d61e-42ef-966f-f4decba5c11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:51.797695 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449b877-d61e-42ef-966f-f4decba5c11b admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:51.805865 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449b877-d61e-42ef-966f-f4decba5c11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:51.806169 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449b877-d61e-42ef-966f-f4decba5c11b admin admin] PATH_INFO: `/v3/projects/31d97df5519b4b18a976288e4b06414b/users/0d7f6c687b324b3ea9f1f9bcb640f70b/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:51.887817 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449b877-d61e-42ef-966f-f4decba5c11b admin admin] RBAC: Authorizing `identity:create_grant(project_id=31d97df5519b4b18a976288e4b06414b, user_id=0d7f6c687b324b3ea9f1f9bcb640f70b, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:51.898980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449b877-d61e-42ef-966f-f4decba5c11b admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:52.075291 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 860/1753] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:10:51 2022] PUT /identity/v3/projects/31d97df5519b4b18a976288e4b06414b/users/0d7f6c687b324b3ea9f1f9bcb640f70b/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:10:52.089298 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8acd71-dccd-46fc-b213-b0dfb9a0431b None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:52.089526 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8acd71-dccd-46fc-b213-b0dfb9a0431b None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:52.089791 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8acd71-dccd-46fc-b213-b0dfb9a0431b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:52.212344 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-5c8acd71-dccd-46fc-b213-b0dfb9a0431b None None] MFA Rules not processed for user `0d7f6c687b324b3ea9f1f9bcb640f70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:52.214658 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-5c8acd71-dccd-46fc-b213-b0dfb9a0431b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:52.682185 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 894/1754] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 594 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:52.705709 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449b877-d61e-42ef-966f-f4decba5c11b admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:52.708054 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-5449b877-d61e-42ef-966f-f4decba5c11b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:52.988365 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ea9cd-8975-4ab4-ae2f-542dcecafcea None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:52.990631 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ea9cd-8975-4ab4-ae2f-542dcecafcea None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:52.991545 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ea9cd-8975-4ab4-ae2f-542dcecafcea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:53.112672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449b877-d61e-42ef-966f-f4decba5c11b admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:53.122815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-a49ea9cd-8975-4ab4-ae2f-542dcecafcea None None] MFA Rules not processed for user `6128f07ffd5f4357968b0e2e300f2e09`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:53.128336 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-a49ea9cd-8975-4ab4-ae2f-542dcecafcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:53.136820 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335628df-8dc5-4a3d-ac3e-6f2be2e8fc4e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca8afe2c10f4db58716aacfd373504b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:53.137339 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335628df-8dc5-4a3d-ac3e-6f2be2e8fc4e service glance] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:53.137631 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335628df-8dc5-4a3d-ac3e-6f2be2e8fc4e service glance] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:53.143913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335628df-8dc5-4a3d-ac3e-6f2be2e8fc4e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:53.186393 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335628df-8dc5-4a3d-ac3e-6f2be2e8fc4e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:53.188080 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335628df-8dc5-4a3d-ac3e-6f2be2e8fc4e service glance] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:53.230245 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 861/1755] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:10:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:10:53.355560 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:53.430565 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 895/1756] 10.222.0.75 () {58 vars in 1015 bytes} [Tue Aug 2 09:10:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:53.647185 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335628df-8dc5-4a3d-ac3e-6f2be2e8fc4e service glance] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:53.653059 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-335628df-8dc5-4a3d-ac3e-6f2be2e8fc4e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:53.681340 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335628df-8dc5-4a3d-ac3e-6f2be2e8fc4e service glance] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:53.686618 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53082073-2464-4c7a-9d4e-6aa7c3278621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:53.687721 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53082073-2464-4c7a-9d4e-6aa7c3278621 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:53.688231 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53082073-2464-4c7a-9d4e-6aa7c3278621 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:53.688726 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53082073-2464-4c7a-9d4e-6aa7c3278621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:53.700516 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53082073-2464-4c7a-9d4e-6aa7c3278621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:53.703196 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53082073-2464-4c7a-9d4e-6aa7c3278621 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:53.719955 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 862/1757] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:10:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:10:53.765159 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:53.846445 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ea9cd-8975-4ab4-ae2f-542dcecafcea None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:53.848305 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-a49ea9cd-8975-4ab4-ae2f-542dcecafcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:54.357731 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ea9cd-8975-4ab4-ae2f-542dcecafcea None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:54.421024 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdafd74-4e2d-4fa9-9d7c-c7723a314626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:54.425159 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdafd74-4e2d-4fa9-9d7c-c7723a314626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:54.430789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdafd74-4e2d-4fa9-9d7c-c7723a314626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:54.433101 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdafd74-4e2d-4fa9-9d7c-c7723a314626 admin admin] PATH_INFO: `/v3/projects/c0dc48dd9e3f4cf0a93c4f91d52d4cda` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:54.438851 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdafd74-4e2d-4fa9-9d7c-c7723a314626 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0dc48dd9e3f4cf0a93c4f91d52d4cda)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:54.444766 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdafd74-4e2d-4fa9-9d7c-c7723a314626 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:54.969093 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-1fdafd74-4e2d-4fa9-9d7c-c7723a314626 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0dc48dd9e3f4cf0a93c4f91d52d4cda', 'request_id': 'req-1fdafd74-4e2d-4fa9-9d7c-c7723a314626'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:55.092950 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-1fdafd74-4e2d-4fa9-9d7c-c7723a314626 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0dc48dd9e3f4cf0a93c4f91d52d4cda', 'request_id': 'req-1fdafd74-4e2d-4fa9-9d7c-c7723a314626'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:55.107544 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-1fdafd74-4e2d-4fa9-9d7c-c7723a314626 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0dc48dd9e3f4cf0a93c4f91d52d4cda', 'request_id': 'req-1fdafd74-4e2d-4fa9-9d7c-c7723a314626'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:55.160051 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-1fdafd74-4e2d-4fa9-9d7c-c7723a314626 admin admin] The token cache is being invalidate because project c0dc48dd9e3f4cf0a93c4f91d52d4cda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:10:55.160576 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-1fdafd74-4e2d-4fa9-9d7c-c7723a314626 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:55.163458 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-1fdafd74-4e2d-4fa9-9d7c-c7723a314626 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:55.176930 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 896/1758] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:10:53 2022] DELETE /identity/v3/projects/c0dc48dd9e3f4cf0a93c4f91d52d4cda => generated 0 bytes in 1327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:55.183810 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c9864-c82f-40a3-baeb-ae50e74bcd49 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:55.186453 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c9864-c82f-40a3-baeb-ae50e74bcd49 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:55.187529 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c9864-c82f-40a3-baeb-ae50e74bcd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:55.266980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-2e0c9864-c82f-40a3-baeb-ae50e74bcd49 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:55.274360 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-2e0c9864-c82f-40a3-baeb-ae50e74bcd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:55.777825 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 863/1759] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 599 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:55.787311 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ff268-03f0-42b6-8272-c9d5deb9787c None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:55.787679 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ff268-03f0-42b6-8272-c9d5deb9787c None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:55.788020 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ff268-03f0-42b6-8272-c9d5deb9787c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:55.921512 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-492ff268-03f0-42b6-8272-c9d5deb9787c None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:55.956457 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-492ff268-03f0-42b6-8272-c9d5deb9787c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:55.956457 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 897/1760] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:55.960642 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c9864-c82f-40a3-baeb-ae50e74bcd49 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:56.016296 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c9864-c82f-40a3-baeb-ae50e74bcd49 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:56.045237 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e233b-97a8-47e8-9dc4-00b734d0b40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:56.059538 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e233b-97a8-47e8-9dc4-00b734d0b40e admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:56.059538 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e233b-97a8-47e8-9dc4-00b734d0b40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:56.059538 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e233b-97a8-47e8-9dc4-00b734d0b40e admin admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:56.059538 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e233b-97a8-47e8-9dc4-00b734d0b40e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:10:56.059538 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e233b-97a8-47e8-9dc4-00b734d0b40e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:56.070580 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e233b-97a8-47e8-9dc4-00b734d0b40e admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:56.163761 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ff268-03f0-42b6-8272-c9d5deb9787c None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:56.168687 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 864/1761] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:10:56.216626 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ff268-03f0-42b6-8272-c9d5deb9787c None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:56.269576 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c929a-68cf-4c57-9a91-5d17e7295ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:56.281562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c929a-68cf-4c57-9a91-5d17e7295ebe admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:56.281562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c929a-68cf-4c57-9a91-5d17e7295ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:56.292067 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c929a-68cf-4c57-9a91-5d17e7295ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:56.299281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c929a-68cf-4c57-9a91-5d17e7295ebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:56.299281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c929a-68cf-4c57-9a91-5d17e7295ebe admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:56.457815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 898/1762] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:10:56 2022] POST /identity/v3/projects => generated 399 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:56.459708 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e233b-97a8-47e8-9dc4-00b734d0b40e admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:56.512883 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e233b-97a8-47e8-9dc4-00b734d0b40e admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:56.824944 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f08f1-229c-4e11-9c1d-1b37589f109c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:56.861849 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f08f1-229c-4e11-9c1d-1b37589f109c admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:56.862806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f08f1-229c-4e11-9c1d-1b37589f109c admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:56.868473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f08f1-229c-4e11-9c1d-1b37589f109c admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:56.872636 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f08f1-229c-4e11-9c1d-1b37589f109c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:56.888553 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f08f1-229c-4e11-9c1d-1b37589f109c admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:57.037245 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 865/1763] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:10:56 2022] POST /identity/v3/users => generated 300 bytes in 579 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:57.042380 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c929a-68cf-4c57-9a91-5d17e7295ebe admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:57.064286 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c929a-68cf-4c57-9a91-5d17e7295ebe admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:57.086646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11b1f6-1a92-442b-a582-86a735e659d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:57.088852 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11b1f6-1a92-442b-a582-86a735e659d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:57.091286 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11b1f6-1a92-442b-a582-86a735e659d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:57.092347 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11b1f6-1a92-442b-a582-86a735e659d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:57.094347 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11b1f6-1a92-442b-a582-86a735e659d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:57.104142 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11b1f6-1a92-442b-a582-86a735e659d8 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:57.165189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f08f1-229c-4e11-9c1d-1b37589f109c admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:57.166118 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 899/1764] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:10:57.190856 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:57.198612 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca005ef9-fbae-4aa9-8b32-793c589143e3 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:57.199496 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca005ef9-fbae-4aa9-8b32-793c589143e3 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:57.199975 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca005ef9-fbae-4aa9-8b32-793c589143e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:57.223415 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f08f1-229c-4e11-9c1d-1b37589f109c admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:57.232136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c9933-357f-40cc-998f-23b09837f9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:57.233437 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c9933-357f-40cc-998f-23b09837f9ec admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:57.233707 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c9933-357f-40cc-998f-23b09837f9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:57.234029 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c9933-357f-40cc-998f-23b09837f9ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:57.234828 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c9933-357f-40cc-998f-23b09837f9ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:57.260042 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c9933-357f-40cc-998f-23b09837f9ec admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:57.260125 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-ca005ef9-fbae-4aa9-8b32-793c589143e3 None None] MFA Rules not processed for user `eb640d92cb9b49019f42351a60efe258`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:57.262539 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-ca005ef9-fbae-4aa9-8b32-793c589143e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:57.324720 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 866/1765] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:10:57.333983 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c9933-357f-40cc-998f-23b09837f9ec admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:57.375151 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c9933-357f-40cc-998f-23b09837f9ec admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:57.392108 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ceac39-7f29-4e11-9ae5-8f2844842c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:57.392108 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceac39-7f29-4e11-9ae5-8f2844842c1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:57.392108 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceac39-7f29-4e11-9ae5-8f2844842c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:57.393046 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceac39-7f29-4e11-9ae5-8f2844842c1a admin admin] PATH_INFO: `/v3/projects/f5da87f8c9db4d52a5708f133d2d7406/users/924699a0e05544d4a7cf8a203084955e/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:57.451686 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ceac39-7f29-4e11-9ae5-8f2844842c1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5da87f8c9db4d52a5708f133d2d7406, user_id=924699a0e05544d4a7cf8a203084955e, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:57.464684 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ceac39-7f29-4e11-9ae5-8f2844842c1a admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:57.530270 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:57.587970 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 900/1766] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Aug 2 09:10:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 02 09:10:57.612501 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca005ef9-fbae-4aa9-8b32-793c589143e3 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:57.617707 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-ca005ef9-fbae-4aa9-8b32-793c589143e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:57.641511 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 867/1767] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:10:57 2022] PUT /identity/v3/projects/f5da87f8c9db4d52a5708f133d2d7406/users/924699a0e05544d4a7cf8a203084955e/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:57.646471 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fbe96-f69f-4bef-aece-9c5ecec916de None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:57.646846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fbe96-f69f-4bef-aece-9c5ecec916de None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:57.647069 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fbe96-f69f-4bef-aece-9c5ecec916de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:57.792404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-4a2fbe96-f69f-4bef-aece-9c5ecec916de None None] MFA Rules not processed for user `924699a0e05544d4a7cf8a203084955e`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:57.793732 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-4a2fbe96-f69f-4bef-aece-9c5ecec916de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:57.978597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca005ef9-fbae-4aa9-8b32-793c589143e3 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:58.059739 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 868/1768] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:57 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:10:58.085074 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fbe96-f69f-4bef-aece-9c5ecec916de None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:58.392939 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fbe96-f69f-4bef-aece-9c5ecec916de None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:58.395123 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c1d6a-4ac5-4387-b704-bfc58a734b68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f8e572550b4ab5955d7a94f1563441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:58.404962 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c1d6a-4ac5-4387-b704-bfc58a734b68 service swift] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:58.408199 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6be31-4fdd-4d3f-b9ea-a273266a2348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:58.410627 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6be31-4fdd-4d3f-b9ea-a273266a2348 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:58.411062 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c1d6a-4ac5-4387-b704-bfc58a734b68 service swift] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:58.411848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c1d6a-4ac5-4387-b704-bfc58a734b68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:58.413999 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6be31-4fdd-4d3f-b9ea-a273266a2348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:58.414374 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6be31-4fdd-4d3f-b9ea-a273266a2348 admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:58.415125 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6be31-4fdd-4d3f-b9ea-a273266a2348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:58.421124 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6be31-4fdd-4d3f-b9ea-a273266a2348 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:58.599555 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 869/1769] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:10:58 2022] POST /identity/v3/projects => generated 401 bytes in 528 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:58.601457 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6be31-4fdd-4d3f-b9ea-a273266a2348 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:58.608199 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-d5e6be31-4fdd-4d3f-b9ea-a273266a2348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:58.763865 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:58.838227 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c1d6a-4ac5-4387-b704-bfc58a734b68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:58.853865 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6be31-4fdd-4d3f-b9ea-a273266a2348 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:58.858594 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c1d6a-4ac5-4387-b704-bfc58a734b68 service swift] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:58.886460 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed90ef-8a92-4b81-8b5b-2b58d3c16287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:58.894076 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed90ef-8a92-4b81-8b5b-2b58d3c16287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:58.894076 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed90ef-8a92-4b81-8b5b-2b58d3c16287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:58.894076 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed90ef-8a92-4b81-8b5b-2b58d3c16287 admin admin] PATH_INFO: `/v3/users/7fa8a30eb9814ca086e8982e8aa4d64d` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:58.901156 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed90ef-8a92-4b81-8b5b-2b58d3c16287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fa8a30eb9814ca086e8982e8aa4d64d)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:58.907834 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed90ef-8a92-4b81-8b5b-2b58d3c16287 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:58.940373 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 901/1770] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Aug 2 09:10:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 1329 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:10:58.942124 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c1d6a-4ac5-4387-b704-bfc58a734b68 service swift] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:58.989976 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c1d6a-4ac5-4387-b704-bfc58a734b68 service swift] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:59.030422 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441aad6-d59e-488b-888f-6698b58b7746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:59.034727 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441aad6-d59e-488b-888f-6698b58b7746 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:59.041599 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441aad6-d59e-488b-888f-6698b58b7746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:59.042044 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441aad6-d59e-488b-888f-6698b58b7746 admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:59.042835 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441aad6-d59e-488b-888f-6698b58b7746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:59.057511 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441aad6-d59e-488b-888f-6698b58b7746 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:59.219540 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 902/1771] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:10:58 2022] POST /identity/v3/users => generated 307 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:10:59.222275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441aad6-d59e-488b-888f-6698b58b7746 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:59.269500 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441aad6-d59e-488b-888f-6698b58b7746 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:59.310417 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae03ac-e102-4f92-a0d2-bbc7de8b9d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:59.320002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-85ed90ef-8a92-4b81-8b5b-2b58d3c16287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fa8a30eb9814ca086e8982e8aa4d64d'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:59.328642 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae03ac-e102-4f92-a0d2-bbc7de8b9d6f admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:59.332705 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae03ac-e102-4f92-a0d2-bbc7de8b9d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:59.336608 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae03ac-e102-4f92-a0d2-bbc7de8b9d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:59.338073 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae03ac-e102-4f92-a0d2-bbc7de8b9d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:59.356792 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-85ed90ef-8a92-4b81-8b5b-2b58d3c16287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fa8a30eb9814ca086e8982e8aa4d64d'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:59.357654 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae03ac-e102-4f92-a0d2-bbc7de8b9d6f admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:59.362485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-85ed90ef-8a92-4b81-8b5b-2b58d3c16287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fa8a30eb9814ca086e8982e8aa4d64d'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:59.436391 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 903/1772] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:10:59.440411 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae03ac-e102-4f92-a0d2-bbc7de8b9d6f admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:10:59.472015 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-87ae03ac-e102-4f92-a0d2-bbc7de8b9d6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:59.492292 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-85ed90ef-8a92-4b81-8b5b-2b58d3c16287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fa8a30eb9814ca086e8982e8aa4d64d'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:59.576760 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae03ac-e102-4f92-a0d2-bbc7de8b9d6f admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:10:59.627843 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3787366-9b5d-48f0-8d20-f47dea1b3f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:10:59.642303 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3787366-9b5d-48f0-8d20-f47dea1b3f8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:59.648597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3787366-9b5d-48f0-8d20-f47dea1b3f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:59.650155 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3787366-9b5d-48f0-8d20-f47dea1b3f8f admin admin] PATH_INFO: `/v3/projects/d32a4df1742a4617adfb6a261e53c7ca/users/b0c5019371554e03b4021cd509ce390d/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:59.673376 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-85ed90ef-8a92-4b81-8b5b-2b58d3c16287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fa8a30eb9814ca086e8982e8aa4d64d'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:10:59.703343 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:59.727997 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3787366-9b5d-48f0-8d20-f47dea1b3f8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d32a4df1742a4617adfb6a261e53c7ca, user_id=b0c5019371554e03b4021cd509ce390d, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:10:59.735168 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3787366-9b5d-48f0-8d20-f47dea1b3f8f admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:10:59.739459 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 870/1773] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:10:58 2022] DELETE /identity/v3/users/7fa8a30eb9814ca086e8982e8aa4d64d => generated 0 bytes in 1130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:59.748768 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915cef5f-fa33-4f44-9ec1-75dffbac38c1 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:10:59.750463 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915cef5f-fa33-4f44-9ec1-75dffbac38c1 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:10:59.750463 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915cef5f-fa33-4f44-9ec1-75dffbac38c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:10:59.832438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-915cef5f-fa33-4f44-9ec1-75dffbac38c1 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:10:59.835666 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 904/1774] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:10:59 2022] PUT /identity/v3/projects/d32a4df1742a4617adfb6a261e53c7ca/users/b0c5019371554e03b4021cd509ce390d/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:10:59.841949 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-915cef5f-fa33-4f44-9ec1-75dffbac38c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:10:59.844230 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3787366-9b5d-48f0-8d20-f47dea1b3f8f admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:00.129356 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3787366-9b5d-48f0-8d20-f47dea1b3f8f admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:00.148291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbda9e9-bfc4-4f60-b033-c8e91ae34cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:00.149429 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbda9e9-bfc4-4f60-b033-c8e91ae34cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:00.154279 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbda9e9-bfc4-4f60-b033-c8e91ae34cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:00.154279 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbda9e9-bfc4-4f60-b033-c8e91ae34cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:00.154279 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbda9e9-bfc4-4f60-b033-c8e91ae34cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:00.156300 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbda9e9-bfc4-4f60-b033-c8e91ae34cf0 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:00.207324 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 871/1775] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:10:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:11:00.214201 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b74553-dd54-4359-928b-473a5bf8c39c None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:00.228460 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b74553-dd54-4359-928b-473a5bf8c39c None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:00.229494 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b74553-dd54-4359-928b-473a5bf8c39c None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:00.247314 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 905/1777] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:11:00.248285 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 872/1777] 10.222.0.20 () {54 vars in 921 bytes} [Tue Aug 2 09:11:00 2022] GET /identity => generated 270 bytes in 31 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:11:00.258427 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbda9e9-bfc4-4f60-b033-c8e91ae34cf0 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:00.289999 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b74553-dd54-4359-928b-473a5bf8c39c None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:00.295193 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-54b74553-dd54-4359-928b-473a5bf8c39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:00.324488 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbda9e9-bfc4-4f60-b033-c8e91ae34cf0 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:00.370078 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906033e3-6040-482e-8886-f08704b2fd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:00.373502 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906033e3-6040-482e-8886-f08704b2fd62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:00.377890 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906033e3-6040-482e-8886-f08704b2fd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:00.381964 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906033e3-6040-482e-8886-f08704b2fd62 admin admin] PATH_INFO: `/v3/projects/d32a4df1742a4617adfb6a261e53c7ca/users/b0c5019371554e03b4021cd509ce390d/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:00.397683 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906033e3-6040-482e-8886-f08704b2fd62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d32a4df1742a4617adfb6a261e53c7ca, user_id=b0c5019371554e03b4021cd509ce390d, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:00.410633 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906033e3-6040-482e-8886-f08704b2fd62 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:00.515247 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 906/1778] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:11:00 2022] PUT /identity/v3/projects/d32a4df1742a4617adfb6a261e53c7ca/users/b0c5019371554e03b4021cd509ce390d/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:00.524597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8e8da-f56b-40d7-bef0-657c006ddbf9 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:00.525857 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8e8da-f56b-40d7-bef0-657c006ddbf9 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:00.526433 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8e8da-f56b-40d7-bef0-657c006ddbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:00.592032 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-3dc8e8da-f56b-40d7-bef0-657c006ddbf9 None None] MFA Rules not processed for user `7bfcddefa71546d28078a38325c723a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:00.597763 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-3dc8e8da-f56b-40d7-bef0-657c006ddbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:00.610216 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b74553-dd54-4359-928b-473a5bf8c39c None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:00.644882 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:00.704572 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272138f7-183c-4a89-b368-08f5fee4cb45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:00.705873 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272138f7-183c-4a89-b368-08f5fee4cb45 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:00.705873 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272138f7-183c-4a89-b368-08f5fee4cb45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:00.706132 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272138f7-183c-4a89-b368-08f5fee4cb45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:00.849982 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272138f7-183c-4a89-b368-08f5fee4cb45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:00.852613 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272138f7-183c-4a89-b368-08f5fee4cb45 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:00.906501 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 873/1779] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:11:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:11:00.912455 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3f966-3ab3-4410-9bea-c06e126caae5 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:00.912968 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 907/1780] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Aug 2 09:11:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:11:00.913288 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3f966-3ab3-4410-9bea-c06e126caae5 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:00.914425 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3f966-3ab3-4410-9bea-c06e126caae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:01.057118 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-a1a3f966-3ab3-4410-9bea-c06e126caae5 None None] MFA Rules not processed for user `b0c5019371554e03b4021cd509ce390d`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:01.058696 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-a1a3f966-3ab3-4410-9bea-c06e126caae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:01.476278 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 874/1781] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:00 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 565 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:11:01.490318 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8e8da-f56b-40d7-bef0-657c006ddbf9 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:01.496870 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-3dc8e8da-f56b-40d7-bef0-657c006ddbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:01.557096 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3f966-3ab3-4410-9bea-c06e126caae5 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:01.560410 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-a1a3f966-3ab3-4410-9bea-c06e126caae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:01.656532 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3f966-3ab3-4410-9bea-c06e126caae5 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:01.692405 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f166b3c-7e43-49c2-9fe5-1ddf2d68dae5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:01.693546 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f166b3c-7e43-49c2-9fe5-1ddf2d68dae5 service nova] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:01.693878 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f166b3c-7e43-49c2-9fe5-1ddf2d68dae5 service nova] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:01.694136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f166b3c-7e43-49c2-9fe5-1ddf2d68dae5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:01.743517 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f166b3c-7e43-49c2-9fe5-1ddf2d68dae5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:01.745508 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f166b3c-7e43-49c2-9fe5-1ddf2d68dae5 service nova] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:01.749133 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8e8da-f56b-40d7-bef0-657c006ddbf9 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:01.774024 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c38c81-da4e-46be-90b2-8201380634d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:01.781278 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c38c81-da4e-46be-90b2-8201380634d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:01.781278 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c38c81-da4e-46be-90b2-8201380634d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:01.781615 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c38c81-da4e-46be-90b2-8201380634d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:01.810798 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c38c81-da4e-46be-90b2-8201380634d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:01.812736 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c38c81-da4e-46be-90b2-8201380634d2 service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:01.815312 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 875/1782] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:11:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:11:01.854964 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 908/1783] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:11:01 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:11:02.564079 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f166b3c-7e43-49c2-9fe5-1ddf2d68dae5 service nova] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:02.566603 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-6f166b3c-7e43-49c2-9fe5-1ddf2d68dae5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:02.612255 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f166b3c-7e43-49c2-9fe5-1ddf2d68dae5 service nova] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:02.623131 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26ae8c-1f05-47e6-8982-4f15fbdbdbaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:02.625171 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26ae8c-1f05-47e6-8982-4f15fbdbdbaa service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:02.625753 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26ae8c-1f05-47e6-8982-4f15fbdbdbaa service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:02.626339 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26ae8c-1f05-47e6-8982-4f15fbdbdbaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:02.633862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-2b26ae8c-1f05-47e6-8982-4f15fbdbdbaa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:02.766105 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:02.822422 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26ae8c-1f05-47e6-8982-4f15fbdbdbaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:02.825723 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26ae8c-1f05-47e6-8982-4f15fbdbdbaa service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:02.877793 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 876/1784] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:11:02 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:11:04.516371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c38c81-da4e-46be-90b2-8201380634d2 service cinder] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:04.518689 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-85c38c81-da4e-46be-90b2-8201380634d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:04.562726 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:04.572462 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c38c81-da4e-46be-90b2-8201380634d2 service cinder] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:04.590409 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f476921-c5fc-40a0-9c2a-5b512630e210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:04.591428 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f476921-c5fc-40a0-9c2a-5b512630e210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:04.591982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f476921-c5fc-40a0-9c2a-5b512630e210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:04.592531 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f476921-c5fc-40a0-9c2a-5b512630e210 admin admin] PATH_INFO: `/v3/projects/d94ca6cfb1b44494962d542774b81724` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:04.594734 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f476921-c5fc-40a0-9c2a-5b512630e210 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d94ca6cfb1b44494962d542774b81724)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:04.597403 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f476921-c5fc-40a0-9c2a-5b512630e210 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:04.866521 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-7f476921-c5fc-40a0-9c2a-5b512630e210 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd94ca6cfb1b44494962d542774b81724', 'request_id': 'req-7f476921-c5fc-40a0-9c2a-5b512630e210'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:05.016936 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-7f476921-c5fc-40a0-9c2a-5b512630e210 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd94ca6cfb1b44494962d542774b81724', 'request_id': 'req-7f476921-c5fc-40a0-9c2a-5b512630e210'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:05.030984 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-7f476921-c5fc-40a0-9c2a-5b512630e210 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd94ca6cfb1b44494962d542774b81724', 'request_id': 'req-7f476921-c5fc-40a0-9c2a-5b512630e210'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:05.124099 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-7f476921-c5fc-40a0-9c2a-5b512630e210 admin admin] The token cache is being invalidate because project d94ca6cfb1b44494962d542774b81724 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:11:05.127359 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-7f476921-c5fc-40a0-9c2a-5b512630e210 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:05.135833 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-7f476921-c5fc-40a0-9c2a-5b512630e210 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:05.151056 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 909/1785] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:11:04 2022] DELETE /identity/v3/projects/d94ca6cfb1b44494962d542774b81724 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:05.154873 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26ae8c-1f05-47e6-8982-4f15fbdbdbaa service cinder] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:05.170182 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26ae8c-1f05-47e6-8982-4f15fbdbdbaa service cinder] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:05.305512 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9e5ea-d9f1-45ce-aa93-96cb24c83f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:05.306877 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9e5ea-d9f1-45ce-aa93-96cb24c83f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:05.307404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9e5ea-d9f1-45ce-aa93-96cb24c83f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:05.307989 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9e5ea-d9f1-45ce-aa93-96cb24c83f36 admin admin] PATH_INFO: `/v3/users/7f69e81fd0f54928b84e66b7f4744d65` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:05.313188 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9e5ea-d9f1-45ce-aa93-96cb24c83f36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f69e81fd0f54928b84e66b7f4744d65)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:05.322396 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9e5ea-d9f1-45ce-aa93-96cb24c83f36 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:05.758061 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-cfd9e5ea-d9f1-45ce-aa93-96cb24c83f36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f69e81fd0f54928b84e66b7f4744d65'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:05.768819 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-cfd9e5ea-d9f1-45ce-aa93-96cb24c83f36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f69e81fd0f54928b84e66b7f4744d65'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:05.769660 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-cfd9e5ea-d9f1-45ce-aa93-96cb24c83f36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f69e81fd0f54928b84e66b7f4744d65'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:05.847707 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-cfd9e5ea-d9f1-45ce-aa93-96cb24c83f36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f69e81fd0f54928b84e66b7f4744d65'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:05.868845 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-cfd9e5ea-d9f1-45ce-aa93-96cb24c83f36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f69e81fd0f54928b84e66b7f4744d65'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:05.883432 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 877/1786] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:11:05 2022] DELETE /identity/v3/users/7f69e81fd0f54928b84e66b7f4744d65 => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:11:06.002873 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898b302-5acc-443c-a0f7-f1c26bea1ca8 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:06.003424 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898b302-5acc-443c-a0f7-f1c26bea1ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:06.003581 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898b302-5acc-443c-a0f7-f1c26bea1ca8 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:06.006714 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 910/1787] 10.222.0.20 () {54 vars in 921 bytes} [Tue Aug 2 09:11:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:11:06.038521 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7c81c-d6f5-4f8e-962b-c8acb61ec871 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:06.039077 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7c81c-d6f5-4f8e-962b-c8acb61ec871 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:06.039372 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7c81c-d6f5-4f8e-962b-c8acb61ec871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:06.086088 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-a0a7c81c-d6f5-4f8e-962b-c8acb61ec871 None None] MFA Rules not processed for user `7bfcddefa71546d28078a38325c723a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:06.089489 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-a0a7c81c-d6f5-4f8e-962b-c8acb61ec871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:06.225830 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:06.258649 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 878/1788] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Aug 2 09:11:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:11:06.550281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898b302-5acc-443c-a0f7-f1c26bea1ca8 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:06.553223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-4898b302-5acc-443c-a0f7-f1c26bea1ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:06.583859 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898b302-5acc-443c-a0f7-f1c26bea1ca8 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:06.594901 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850eb0fe-dfa2-4d87-b05e-125e739f0bc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:06.596230 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850eb0fe-dfa2-4d87-b05e-125e739f0bc8 service nova] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:06.596982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850eb0fe-dfa2-4d87-b05e-125e739f0bc8 service nova] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:06.597685 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850eb0fe-dfa2-4d87-b05e-125e739f0bc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:06.615905 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850eb0fe-dfa2-4d87-b05e-125e739f0bc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:06.619149 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850eb0fe-dfa2-4d87-b05e-125e739f0bc8 service nova] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:06.637023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 911/1789] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:11:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:11:06.668606 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7c81c-d6f5-4f8e-962b-c8acb61ec871 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:06.671201 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-a0a7c81c-d6f5-4f8e-962b-c8acb61ec871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:06.822024 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7c81c-d6f5-4f8e-962b-c8acb61ec871 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:06.827540 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d3e8e-a729-43c0-8476-49c200bd8fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:06.828256 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d3e8e-a729-43c0-8476-49c200bd8fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:06.828541 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d3e8e-a729-43c0-8476-49c200bd8fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:06.828817 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d3e8e-a729-43c0-8476-49c200bd8fb5 admin admin] PATH_INFO: `/v3/projects/4c23e01d8dc044b7afd3185f44696140` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:06.830393 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d3e8e-a729-43c0-8476-49c200bd8fb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c23e01d8dc044b7afd3185f44696140)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:06.833414 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d3e8e-a729-43c0-8476-49c200bd8fb5 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:07.018224 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-ed8d3e8e-a729-43c0-8476-49c200bd8fb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c23e01d8dc044b7afd3185f44696140', 'request_id': 'req-ed8d3e8e-a729-43c0-8476-49c200bd8fb5'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:07.026409 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-ed8d3e8e-a729-43c0-8476-49c200bd8fb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c23e01d8dc044b7afd3185f44696140', 'request_id': 'req-ed8d3e8e-a729-43c0-8476-49c200bd8fb5'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:07.034793 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-ed8d3e8e-a729-43c0-8476-49c200bd8fb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c23e01d8dc044b7afd3185f44696140', 'request_id': 'req-ed8d3e8e-a729-43c0-8476-49c200bd8fb5'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:07.163294 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-ed8d3e8e-a729-43c0-8476-49c200bd8fb5 admin admin] The token cache is being invalidate because project 4c23e01d8dc044b7afd3185f44696140 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:11:07.163766 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-ed8d3e8e-a729-43c0-8476-49c200bd8fb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:07.164857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-ed8d3e8e-a729-43c0-8476-49c200bd8fb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:07.181820 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 879/1790] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:11:06 2022] DELETE /identity/v3/projects/4c23e01d8dc044b7afd3185f44696140 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:07.188222 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41a908-5df4-42b2-8c6e-632f6fea7830 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:07.189775 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41a908-5df4-42b2-8c6e-632f6fea7830 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:07.190490 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41a908-5df4-42b2-8c6e-632f6fea7830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:07.275080 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-df41a908-5df4-42b2-8c6e-632f6fea7830 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:07.279702 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-df41a908-5df4-42b2-8c6e-632f6fea7830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:07.399691 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 912/1791] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:11:07.416900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82eb021-e604-4984-a9b3-e782b356fa8f None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:07.416900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82eb021-e604-4984-a9b3-e782b356fa8f None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:07.416900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82eb021-e604-4984-a9b3-e782b356fa8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:07.435813 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-e82eb021-e604-4984-a9b3-e782b356fa8f None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:07.437420 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-e82eb021-e604-4984-a9b3-e782b356fa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:07.447060 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 880/1792] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:11:07.454358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41a908-5df4-42b2-8c6e-632f6fea7830 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:07.471663 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41a908-5df4-42b2-8c6e-632f6fea7830 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:07.485177 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbb413-54f7-422a-9711-d21721bdfa16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:07.485966 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbb413-54f7-422a-9711-d21721bdfa16 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:07.486226 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbb413-54f7-422a-9711-d21721bdfa16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:07.486498 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbb413-54f7-422a-9711-d21721bdfa16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:07.487224 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dbb413-54f7-422a-9711-d21721bdfa16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:11:07.487530 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dbb413-54f7-422a-9711-d21721bdfa16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:07.489920 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dbb413-54f7-422a-9711-d21721bdfa16 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:07.517315 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 913/1793] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:11:07.517532 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82eb021-e604-4984-a9b3-e782b356fa8f None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:07.527498 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82eb021-e604-4984-a9b3-e782b356fa8f None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:07.534476 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c57e5b-16de-4069-9db5-9872e1843122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:07.535872 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c57e5b-16de-4069-9db5-9872e1843122 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:07.536977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c57e5b-16de-4069-9db5-9872e1843122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:07.538436 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c57e5b-16de-4069-9db5-9872e1843122 admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:07.539609 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c57e5b-16de-4069-9db5-9872e1843122 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:07.541992 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c57e5b-16de-4069-9db5-9872e1843122 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:07.694267 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 881/1794] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:11:07 2022] POST /identity/v3/projects => generated 365 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:11:07.709837 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbb413-54f7-422a-9711-d21721bdfa16 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:07.729106 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbb413-54f7-422a-9711-d21721bdfa16 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:07.925565 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32b68d-6912-4ca8-9039-abb17cf5b6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:07.928403 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32b68d-6912-4ca8-9039-abb17cf5b6c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:07.929505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32b68d-6912-4ca8-9039-abb17cf5b6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:07.930088 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32b68d-6912-4ca8-9039-abb17cf5b6c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:07.931735 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32b68d-6912-4ca8-9039-abb17cf5b6c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:07.936486 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32b68d-6912-4ca8-9039-abb17cf5b6c3 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:07.968010 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:08.142292 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 914/1795] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:11:07 2022] POST /identity/v3/users => generated 283 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:11:08.149670 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c57e5b-16de-4069-9db5-9872e1843122 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:08.176548 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c57e5b-16de-4069-9db5-9872e1843122 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:08.189225 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c699c47-4ebb-4988-a775-57c813c4f72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:08.190627 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c699c47-4ebb-4988-a775-57c813c4f72f admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:08.191317 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c699c47-4ebb-4988-a775-57c813c4f72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:08.192207 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c699c47-4ebb-4988-a775-57c813c4f72f admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:08.195073 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c699c47-4ebb-4988-a775-57c813c4f72f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:08.199954 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c699c47-4ebb-4988-a775-57c813c4f72f admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:08.221934 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 882/1796] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:11:08.224738 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32b68d-6912-4ca8-9039-abb17cf5b6c3 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:08.259319 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32b68d-6912-4ca8-9039-abb17cf5b6c3 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:08.270569 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c56ac-37b5-4a20-967c-2dc128e0f602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:08.271649 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c56ac-37b5-4a20-967c-2dc128e0f602 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:08.272505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c56ac-37b5-4a20-967c-2dc128e0f602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:08.273182 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c56ac-37b5-4a20-967c-2dc128e0f602 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:08.274932 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c56ac-37b5-4a20-967c-2dc128e0f602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:08.279890 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c56ac-37b5-4a20-967c-2dc128e0f602 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:08.305249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 915/1797] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:11:08.317842 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c699c47-4ebb-4988-a775-57c813c4f72f admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:08.329611 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c699c47-4ebb-4988-a775-57c813c4f72f admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:08.335766 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cfcfe-4aee-4d37-b47b-b1a921e2c634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:08.337211 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cfcfe-4aee-4d37-b47b-b1a921e2c634 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:08.337654 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cfcfe-4aee-4d37-b47b-b1a921e2c634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:08.338087 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cfcfe-4aee-4d37-b47b-b1a921e2c634 admin admin] PATH_INFO: `/v3/projects/df3ee49515e94ab89c0ed0cb41bd386c/users/f002187d0eee4d16b371a90fecc4ae16/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:08.366795 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76cfcfe-4aee-4d37-b47b-b1a921e2c634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df3ee49515e94ab89c0ed0cb41bd386c, user_id=f002187d0eee4d16b371a90fecc4ae16, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:08.372430 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76cfcfe-4aee-4d37-b47b-b1a921e2c634 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:08.492548 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 883/1798] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:11:08 2022] PUT /identity/v3/projects/df3ee49515e94ab89c0ed0cb41bd386c/users/f002187d0eee4d16b371a90fecc4ae16/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:11:08.502703 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378df82-2cd5-40aa-a49f-a65dd2c88713 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:08.502996 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378df82-2cd5-40aa-a49f-a65dd2c88713 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:08.503304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378df82-2cd5-40aa-a49f-a65dd2c88713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:08.574287 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-c378df82-2cd5-40aa-a49f-a65dd2c88713 None None] MFA Rules not processed for user `f002187d0eee4d16b371a90fecc4ae16`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:08.576528 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-c378df82-2cd5-40aa-a49f-a65dd2c88713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:08.706941 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 916/1799] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:11:08.712704 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cfcfe-4aee-4d37-b47b-b1a921e2c634 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:08.742297 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:08.872405 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cfcfe-4aee-4d37-b47b-b1a921e2c634 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:08.883477 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d3087-9564-4397-bf15-356ee8f3998e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:08.884307 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d3087-9564-4397-bf15-356ee8f3998e admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:08.884669 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d3087-9564-4397-bf15-356ee8f3998e admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:08.884934 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d3087-9564-4397-bf15-356ee8f3998e admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:08.885976 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d3087-9564-4397-bf15-356ee8f3998e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:08.888104 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d3087-9564-4397-bf15-356ee8f3998e admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:08.999939 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 884/1800] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:11:08 2022] POST /identity/v3/projects => generated 363 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:11:09.002029 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378df82-2cd5-40aa-a49f-a65dd2c88713 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:09.022612 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378df82-2cd5-40aa-a49f-a65dd2c88713 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:09.149707 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6233945-ba74-4457-907a-ae0e27bdeffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:09.151392 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6233945-ba74-4457-907a-ae0e27bdeffd admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:09.152383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6233945-ba74-4457-907a-ae0e27bdeffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:09.153213 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6233945-ba74-4457-907a-ae0e27bdeffd admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:09.156024 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6233945-ba74-4457-907a-ae0e27bdeffd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:09.160332 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6233945-ba74-4457-907a-ae0e27bdeffd admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:09.537783 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 917/1801] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:11:09 2022] POST /identity/v3/users => generated 288 bytes in 533 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:11:09.541590 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d3087-9564-4397-bf15-356ee8f3998e admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:09.593043 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d3087-9564-4397-bf15-356ee8f3998e admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:09.609388 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1bfcd-9c50-4b09-a1df-e87e90caf065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:09.610522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1bfcd-9c50-4b09-a1df-e87e90caf065 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:09.611145 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1bfcd-9c50-4b09-a1df-e87e90caf065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:09.611909 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1bfcd-9c50-4b09-a1df-e87e90caf065 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:09.613597 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e1bfcd-9c50-4b09-a1df-e87e90caf065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:09.617678 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e1bfcd-9c50-4b09-a1df-e87e90caf065 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:09.651324 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 885/1802] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:11:09.655225 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6233945-ba74-4457-907a-ae0e27bdeffd admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:09.677896 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6233945-ba74-4457-907a-ae0e27bdeffd admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:09.692056 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1e9b4-258b-4f6f-b9e7-263ead4c23be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:09.693434 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1e9b4-258b-4f6f-b9e7-263ead4c23be admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:09.694042 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1e9b4-258b-4f6f-b9e7-263ead4c23be admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:09.700239 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1e9b4-258b-4f6f-b9e7-263ead4c23be admin admin] PATH_INFO: `/v3/projects/230a9a87290a44ef94e94ac25506de37/users/969f2839334a48a8980c55ef856942fe/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:09.720088 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d1e9b4-258b-4f6f-b9e7-263ead4c23be admin admin] RBAC: Authorizing `identity:create_grant(project_id=230a9a87290a44ef94e94ac25506de37, user_id=969f2839334a48a8980c55ef856942fe, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:09.723358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d1e9b4-258b-4f6f-b9e7-263ead4c23be admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:09.783796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 918/1803] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:11:09 2022] PUT /identity/v3/projects/230a9a87290a44ef94e94ac25506de37/users/969f2839334a48a8980c55ef856942fe/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:09.788072 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1bfcd-9c50-4b09-a1df-e87e90caf065 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:09.806930 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1bfcd-9c50-4b09-a1df-e87e90caf065 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:09.913330 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aad9c5-ea28-4c05-86d1-b8f215a117ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:09.914021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aad9c5-ea28-4c05-86d1-b8f215a117ca admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:09.914411 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aad9c5-ea28-4c05-86d1-b8f215a117ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:09.914586 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aad9c5-ea28-4c05-86d1-b8f215a117ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:09.915287 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aad9c5-ea28-4c05-86d1-b8f215a117ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:09.917127 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aad9c5-ea28-4c05-86d1-b8f215a117ca admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:09.932428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 886/1804] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:11:09.936783 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1e9b4-258b-4f6f-b9e7-263ead4c23be admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:09.948904 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1e9b4-258b-4f6f-b9e7-263ead4c23be admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:09.957259 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa978df8-eef5-4fde-b117-5fcf6a978e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:09.959021 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa978df8-eef5-4fde-b117-5fcf6a978e7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:09.959466 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa978df8-eef5-4fde-b117-5fcf6a978e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:09.959853 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa978df8-eef5-4fde-b117-5fcf6a978e7e admin admin] PATH_INFO: `/v3/projects/230a9a87290a44ef94e94ac25506de37/users/969f2839334a48a8980c55ef856942fe/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:09.962130 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa978df8-eef5-4fde-b117-5fcf6a978e7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=230a9a87290a44ef94e94ac25506de37, user_id=969f2839334a48a8980c55ef856942fe, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:09.965574 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa978df8-eef5-4fde-b117-5fcf6a978e7e admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:09.978026 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 919/1805] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:11:09 2022] PUT /identity/v3/projects/230a9a87290a44ef94e94ac25506de37/users/969f2839334a48a8980c55ef856942fe/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:09.992192 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ca798-0a82-4cf1-8273-a86e16cda9f2 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:09.992625 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ca798-0a82-4cf1-8273-a86e16cda9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:09.993737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ca798-0a82-4cf1-8273-a86e16cda9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:10.032458 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-c70ca798-0a82-4cf1-8273-a86e16cda9f2 None None] MFA Rules not processed for user `969f2839334a48a8980c55ef856942fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:10.034059 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-c70ca798-0a82-4cf1-8273-a86e16cda9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:10.140366 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 887/1806] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:11:10.152976 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa978df8-eef5-4fde-b117-5fcf6a978e7e admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:10.157137 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-fa978df8-eef5-4fde-b117-5fcf6a978e7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:10.240809 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:10.301101 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa978df8-eef5-4fde-b117-5fcf6a978e7e admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:10.306196 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61195a-663f-4879-b89a-bc44fc911d2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:10.307032 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61195a-663f-4879-b89a-bc44fc911d2a service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:10.307546 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61195a-663f-4879-b89a-bc44fc911d2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:10.307877 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61195a-663f-4879-b89a-bc44fc911d2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:10.327815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61195a-663f-4879-b89a-bc44fc911d2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:10.328820 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61195a-663f-4879-b89a-bc44fc911d2a service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:10.345014 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 920/1807] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:11:10 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:11:10.720994 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ca798-0a82-4cf1-8273-a86e16cda9f2 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:10.748849 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ca798-0a82-4cf1-8273-a86e16cda9f2 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:10.754409 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2355b0f-b0ec-444a-9e50-22a72350a655 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:10.756116 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2355b0f-b0ec-444a-9e50-22a72350a655 service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:10.756823 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2355b0f-b0ec-444a-9e50-22a72350a655 service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:10.757675 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2355b0f-b0ec-444a-9e50-22a72350a655 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:10.772064 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:10.866384 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2355b0f-b0ec-444a-9e50-22a72350a655 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:10.869233 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2355b0f-b0ec-444a-9e50-22a72350a655 service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:10.894589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 888/1808] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:11:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:11:12.216998 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61195a-663f-4879-b89a-bc44fc911d2a service cinder] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:12.225157 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-2e61195a-663f-4879-b89a-bc44fc911d2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:12.441557 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61195a-663f-4879-b89a-bc44fc911d2a service cinder] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:12.459802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3bdb65-6dc3-4d8d-8d48-1c6bcdabb4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:12.459918 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bdb65-6dc3-4d8d-8d48-1c6bcdabb4db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:12.460369 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bdb65-6dc3-4d8d-8d48-1c6bcdabb4db admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:12.460654 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bdb65-6dc3-4d8d-8d48-1c6bcdabb4db admin admin] PATH_INFO: `/v3/users/924699a0e05544d4a7cf8a203084955e` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:12.462112 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3bdb65-6dc3-4d8d-8d48-1c6bcdabb4db admin admin] RBAC: Authorizing `identity:delete_user(user_id=924699a0e05544d4a7cf8a203084955e)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:12.464655 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3bdb65-6dc3-4d8d-8d48-1c6bcdabb4db admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:12.841150 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-bd3bdb65-6dc3-4d8d-8d48-1c6bcdabb4db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '924699a0e05544d4a7cf8a203084955e'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:12.990869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-bd3bdb65-6dc3-4d8d-8d48-1c6bcdabb4db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '924699a0e05544d4a7cf8a203084955e'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:13.026897 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-bd3bdb65-6dc3-4d8d-8d48-1c6bcdabb4db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '924699a0e05544d4a7cf8a203084955e'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:13.030041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-bd3bdb65-6dc3-4d8d-8d48-1c6bcdabb4db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '924699a0e05544d4a7cf8a203084955e'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:13.031418 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-bd3bdb65-6dc3-4d8d-8d48-1c6bcdabb4db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '924699a0e05544d4a7cf8a203084955e'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:13.090466 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 921/1809] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:11:12 2022] DELETE /identity/v3/users/924699a0e05544d4a7cf8a203084955e => generated 0 bytes in 876 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:13.101690 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94c65e-6ccf-4aad-abff-ce417d3039c2 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:13.103213 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94c65e-6ccf-4aad-abff-ce417d3039c2 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:13.103213 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94c65e-6ccf-4aad-abff-ce417d3039c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:13.127006 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-0f94c65e-6ccf-4aad-abff-ce417d3039c2 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:13.129143 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-0f94c65e-6ccf-4aad-abff-ce417d3039c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:13.246754 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 889/1810] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:11:13.295390 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3bdb65-6dc3-4d8d-8d48-1c6bcdabb4db admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:13.297348 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-bd3bdb65-6dc3-4d8d-8d48-1c6bcdabb4db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:13.385752 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:13.410477 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3bdb65-6dc3-4d8d-8d48-1c6bcdabb4db admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:13.426179 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c49db-516d-4169-83a7-607a836ce9c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:13.426179 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c49db-516d-4169-83a7-607a836ce9c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:13.426179 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c49db-516d-4169-83a7-607a836ce9c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:13.426179 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c49db-516d-4169-83a7-607a836ce9c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:13.439467 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c49db-516d-4169-83a7-607a836ce9c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:13.441374 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c49db-516d-4169-83a7-607a836ce9c2 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:13.459879 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 922/1811] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:11:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:11:15.642256 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94c65e-6ccf-4aad-abff-ce417d3039c2 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:15.644666 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-0f94c65e-6ccf-4aad-abff-ce417d3039c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:15.677093 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94c65e-6ccf-4aad-abff-ce417d3039c2 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:15.686132 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99143150-4bc2-4d06-857f-e6ebc073c379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:15.687576 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99143150-4bc2-4d06-857f-e6ebc073c379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:15.688481 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99143150-4bc2-4d06-857f-e6ebc073c379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:15.689181 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99143150-4bc2-4d06-857f-e6ebc073c379 admin admin] PATH_INFO: `/v3/projects/f5da87f8c9db4d52a5708f133d2d7406` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:15.691621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99143150-4bc2-4d06-857f-e6ebc073c379 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5da87f8c9db4d52a5708f133d2d7406)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:15.697088 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99143150-4bc2-4d06-857f-e6ebc073c379 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:15.925192 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-99143150-4bc2-4d06-857f-e6ebc073c379 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5da87f8c9db4d52a5708f133d2d7406', 'request_id': 'req-99143150-4bc2-4d06-857f-e6ebc073c379'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:15.937480 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-99143150-4bc2-4d06-857f-e6ebc073c379 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5da87f8c9db4d52a5708f133d2d7406', 'request_id': 'req-99143150-4bc2-4d06-857f-e6ebc073c379'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:15.947076 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-99143150-4bc2-4d06-857f-e6ebc073c379 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5da87f8c9db4d52a5708f133d2d7406', 'request_id': 'req-99143150-4bc2-4d06-857f-e6ebc073c379'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:16.157084 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-99143150-4bc2-4d06-857f-e6ebc073c379 admin admin] The token cache is being invalidate because project f5da87f8c9db4d52a5708f133d2d7406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:11:16.158057 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-99143150-4bc2-4d06-857f-e6ebc073c379 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:16.159750 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-99143150-4bc2-4d06-857f-e6ebc073c379 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:16.163181 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 890/1812] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:11:15 2022] DELETE /identity/v3/projects/f5da87f8c9db4d52a5708f133d2d7406 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:16.168891 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c49db-516d-4169-83a7-607a836ce9c2 service neutron] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:16.196622 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c49db-516d-4169-83a7-607a836ce9c2 service neutron] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:16.347641 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b50b5f-138a-4b03-bd2a-3cd81475786d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:16.349553 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b50b5f-138a-4b03-bd2a-3cd81475786d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:16.349553 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b50b5f-138a-4b03-bd2a-3cd81475786d admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:16.350263 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b50b5f-138a-4b03-bd2a-3cd81475786d admin admin] PATH_INFO: `/v3/users/b0c5019371554e03b4021cd509ce390d` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:16.352740 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b50b5f-138a-4b03-bd2a-3cd81475786d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0c5019371554e03b4021cd509ce390d)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:16.359824 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b50b5f-138a-4b03-bd2a-3cd81475786d admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:16.594326 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-c0b50b5f-138a-4b03-bd2a-3cd81475786d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0c5019371554e03b4021cd509ce390d'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:16.675749 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-c0b50b5f-138a-4b03-bd2a-3cd81475786d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0c5019371554e03b4021cd509ce390d'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:16.685913 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-c0b50b5f-138a-4b03-bd2a-3cd81475786d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0c5019371554e03b4021cd509ce390d'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:16.686779 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-c0b50b5f-138a-4b03-bd2a-3cd81475786d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0c5019371554e03b4021cd509ce390d'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:16.687473 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-c0b50b5f-138a-4b03-bd2a-3cd81475786d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0c5019371554e03b4021cd509ce390d'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:16.715368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 923/1813] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:11:16 2022] DELETE /identity/v3/users/b0c5019371554e03b4021cd509ce390d => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:17.203757 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99143150-4bc2-4d06-857f-e6ebc073c379 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:17.207066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-99143150-4bc2-4d06-857f-e6ebc073c379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:17.231388 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99143150-4bc2-4d06-857f-e6ebc073c379 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:17.275600 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:17.321136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab4c78-d86b-448f-81c7-82721e820d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:17.322227 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab4c78-d86b-448f-81c7-82721e820d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:17.322665 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab4c78-d86b-448f-81c7-82721e820d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:17.323113 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab4c78-d86b-448f-81c7-82721e820d03 admin admin] PATH_INFO: `/v3/users/f002187d0eee4d16b371a90fecc4ae16` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:17.324702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab4c78-d86b-448f-81c7-82721e820d03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f002187d0eee4d16b371a90fecc4ae16)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:17.327021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab4c78-d86b-448f-81c7-82721e820d03 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:17.524654 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b50b5f-138a-4b03-bd2a-3cd81475786d admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:17.526387 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-c0b50b5f-138a-4b03-bd2a-3cd81475786d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:17.556403 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b50b5f-138a-4b03-bd2a-3cd81475786d admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:17.561710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7b5bd-c6c3-4b61-9c60-827c7ca9feec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:17.562252 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7b5bd-c6c3-4b61-9c60-827c7ca9feec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:17.562536 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7b5bd-c6c3-4b61-9c60-827c7ca9feec admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:17.563047 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7b5bd-c6c3-4b61-9c60-827c7ca9feec admin admin] PATH_INFO: `/v3/projects/d32a4df1742a4617adfb6a261e53c7ca` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:17.564036 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e7b5bd-c6c3-4b61-9c60-827c7ca9feec admin admin] RBAC: Authorizing `identity:delete_project(project_id=d32a4df1742a4617adfb6a261e53c7ca)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:17.566138 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e7b5bd-c6c3-4b61-9c60-827c7ca9feec admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:17.575757 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-47ab4c78-d86b-448f-81c7-82721e820d03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f002187d0eee4d16b371a90fecc4ae16'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:17.615773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-47ab4c78-d86b-448f-81c7-82721e820d03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f002187d0eee4d16b371a90fecc4ae16'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:17.616693 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-47ab4c78-d86b-448f-81c7-82721e820d03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f002187d0eee4d16b371a90fecc4ae16'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:17.757493 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-38e7b5bd-c6c3-4b61-9c60-827c7ca9feec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd32a4df1742a4617adfb6a261e53c7ca', 'request_id': 'req-38e7b5bd-c6c3-4b61-9c60-827c7ca9feec'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:17.802197 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-47ab4c78-d86b-448f-81c7-82721e820d03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f002187d0eee4d16b371a90fecc4ae16'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:17.831794 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-47ab4c78-d86b-448f-81c7-82721e820d03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f002187d0eee4d16b371a90fecc4ae16'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:17.854622 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 891/1814] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:11:17 2022] DELETE /identity/v3/users/f002187d0eee4d16b371a90fecc4ae16 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:17.859397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c469a-5785-4a04-8918-00c94bb6d3cb None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:17.860238 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c469a-5785-4a04-8918-00c94bb6d3cb None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:17.861008 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c469a-5785-4a04-8918-00c94bb6d3cb None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:17.864808 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 892/1815] 10.222.0.20 () {54 vars in 921 bytes} [Tue Aug 2 09:11:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:11:17.867845 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4eac06-5820-48aa-92ab-48c487dc517f None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:17.870851 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4eac06-5820-48aa-92ab-48c487dc517f None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:17.871664 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4eac06-5820-48aa-92ab-48c487dc517f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:17.922245 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-8b4eac06-5820-48aa-92ab-48c487dc517f None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:17.925301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-8b4eac06-5820-48aa-92ab-48c487dc517f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:17.964349 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-38e7b5bd-c6c3-4b61-9c60-827c7ca9feec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd32a4df1742a4617adfb6a261e53c7ca', 'request_id': 'req-38e7b5bd-c6c3-4b61-9c60-827c7ca9feec'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:17.973289 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-38e7b5bd-c6c3-4b61-9c60-827c7ca9feec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd32a4df1742a4617adfb6a261e53c7ca', 'request_id': 'req-38e7b5bd-c6c3-4b61-9c60-827c7ca9feec'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:18.003907 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-38e7b5bd-c6c3-4b61-9c60-827c7ca9feec admin admin] The token cache is being invalidate because project d32a4df1742a4617adfb6a261e53c7ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:11:18.004488 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-38e7b5bd-c6c3-4b61-9c60-827c7ca9feec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:18.008205 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-38e7b5bd-c6c3-4b61-9c60-827c7ca9feec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:18.012043 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 924/1816] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:11:17 2022] DELETE /identity/v3/projects/d32a4df1742a4617adfb6a261e53c7ca => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:18.015806 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664365a6-f3d1-4cf7-a416-0a853a0b0bb7 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:18.017580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664365a6-f3d1-4cf7-a416-0a853a0b0bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:18.018674 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664365a6-f3d1-4cf7-a416-0a853a0b0bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:18.075535 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-664365a6-f3d1-4cf7-a416-0a853a0b0bb7 None None] MFA Rules not processed for user `7bfcddefa71546d28078a38325c723a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:18.077727 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-664365a6-f3d1-4cf7-a416-0a853a0b0bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:18.156790 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 893/1817] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:11:18.161855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf07e4e-d0d3-4bf4-a671-919b9a792691 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:18.162395 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf07e4e-d0d3-4bf4-a671-919b9a792691 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:18.163583 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf07e4e-d0d3-4bf4-a671-919b9a792691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:18.222521 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 925/1818] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Aug 2 09:11:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:11:18.234036 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-3cf07e4e-d0d3-4bf4-a671-919b9a792691 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:18.236269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664365a6-f3d1-4cf7-a416-0a853a0b0bb7 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:18.238204 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-3cf07e4e-d0d3-4bf4-a671-919b9a792691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:18.240627 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-664365a6-f3d1-4cf7-a416-0a853a0b0bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:18.266582 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 894/1819] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:11:18.266582 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf07e4e-d0d3-4bf4-a671-919b9a792691 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:18.266582 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-3cf07e4e-d0d3-4bf4-a671-919b9a792691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:18.292568 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf07e4e-d0d3-4bf4-a671-919b9a792691 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:18.303946 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11feed0b-4846-42d4-ac5f-4ff9cc0c8b3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:18.304903 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11feed0b-4846-42d4-ac5f-4ff9cc0c8b3d service nova] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:18.305343 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11feed0b-4846-42d4-ac5f-4ff9cc0c8b3d service nova] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:18.305629 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11feed0b-4846-42d4-ac5f-4ff9cc0c8b3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:18.322113 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11feed0b-4846-42d4-ac5f-4ff9cc0c8b3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:18.323693 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11feed0b-4846-42d4-ac5f-4ff9cc0c8b3d service nova] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:18.352743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 895/1820] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:11:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:11:18.385165 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac71e2-9185-4a7b-9444-d37d30a43041 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:18.385165 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac71e2-9185-4a7b-9444-d37d30a43041 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:18.385165 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac71e2-9185-4a7b-9444-d37d30a43041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:18.429063 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664365a6-f3d1-4cf7-a416-0a853a0b0bb7 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:18.437744 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603bac2-e71a-4ccf-b440-9f2684a31af8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:18.439314 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-5fac71e2-9185-4a7b-9444-d37d30a43041 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:18.441429 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603bac2-e71a-4ccf-b440-9f2684a31af8 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:18.444435 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603bac2-e71a-4ccf-b440-9f2684a31af8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:18.444435 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603bac2-e71a-4ccf-b440-9f2684a31af8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:18.444902 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-5fac71e2-9185-4a7b-9444-d37d30a43041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:18.467393 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3603bac2-e71a-4ccf-b440-9f2684a31af8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:18.470182 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3603bac2-e71a-4ccf-b440-9f2684a31af8 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:18.471197 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 896/1821] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:11:18.477746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac71e2-9185-4a7b-9444-d37d30a43041 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:18.489749 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 926/1822] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:11:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:11:18.523613 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac71e2-9185-4a7b-9444-d37d30a43041 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:18.534691 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae80a59-cfc9-4641-be3e-00ee3869f471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:18.535404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae80a59-cfc9-4641-be3e-00ee3869f471 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:18.535694 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae80a59-cfc9-4641-be3e-00ee3869f471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:18.536690 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae80a59-cfc9-4641-be3e-00ee3869f471 admin admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:18.537612 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae80a59-cfc9-4641-be3e-00ee3869f471 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:11:18.538060 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae80a59-cfc9-4641-be3e-00ee3869f471 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:18.539253 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:18.539985 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae80a59-cfc9-4641-be3e-00ee3869f471 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:18.589840 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 897/1823] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:11:18.595160 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603bac2-e71a-4ccf-b440-9f2684a31af8 service neutron] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:18.669294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603bac2-e71a-4ccf-b440-9f2684a31af8 service neutron] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:18.689242 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359deed7-cd0a-4967-9f93-8fb92f72d6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:18.690908 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359deed7-cd0a-4967-9f93-8fb92f72d6a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:18.691693 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359deed7-cd0a-4967-9f93-8fb92f72d6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:18.694100 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359deed7-cd0a-4967-9f93-8fb92f72d6a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:18.695810 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359deed7-cd0a-4967-9f93-8fb92f72d6a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:18.700215 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359deed7-cd0a-4967-9f93-8fb92f72d6a3 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:18.932034 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 927/1824] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:11:18 2022] POST /identity/v3/projects => generated 371 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:11:18.938884 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae80a59-cfc9-4641-be3e-00ee3869f471 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:18.960102 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae80a59-cfc9-4641-be3e-00ee3869f471 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:19.084375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e1872-4918-4bdd-9b87-7c4931c1d8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:19.085496 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e1872-4918-4bdd-9b87-7c4931c1d8c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:19.086034 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e1872-4918-4bdd-9b87-7c4931c1d8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:19.086521 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e1872-4918-4bdd-9b87-7c4931c1d8c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:19.087504 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e1872-4918-4bdd-9b87-7c4931c1d8c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:19.090066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e1872-4918-4bdd-9b87-7c4931c1d8c0 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:19.241115 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 898/1825] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:11:18 2022] POST /identity/v3/users => generated 286 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:11:19.242441 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359deed7-cd0a-4967-9f93-8fb92f72d6a3 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:19.260739 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359deed7-cd0a-4967-9f93-8fb92f72d6a3 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:19.278948 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe969d-bd64-4717-991f-7fbbb147fc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:19.279638 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe969d-bd64-4717-991f-7fbbb147fc50 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:19.279923 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe969d-bd64-4717-991f-7fbbb147fc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:19.280236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe969d-bd64-4717-991f-7fbbb147fc50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:19.281016 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe969d-bd64-4717-991f-7fbbb147fc50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:19.288786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe969d-bd64-4717-991f-7fbbb147fc50 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:19.323518 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 928/1826] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:11:19.327889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e1872-4918-4bdd-9b87-7c4931c1d8c0 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:19.346379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e1872-4918-4bdd-9b87-7c4931c1d8c0 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:19.361122 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7951217-900d-445d-bb77-595f59b6b9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:19.363121 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7951217-900d-445d-bb77-595f59b6b9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:19.363842 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7951217-900d-445d-bb77-595f59b6b9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:19.365328 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7951217-900d-445d-bb77-595f59b6b9a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:19.366468 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7951217-900d-445d-bb77-595f59b6b9a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:19.368754 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7951217-900d-445d-bb77-595f59b6b9a1 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:19.394386 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe969d-bd64-4717-991f-7fbbb147fc50 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:19.394620 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 899/1827] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:11:19.408219 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe969d-bd64-4717-991f-7fbbb147fc50 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:19.424329 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7a4fa-d468-474d-a2bd-028cf620afe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:19.425149 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7a4fa-d468-474d-a2bd-028cf620afe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:19.425433 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7a4fa-d468-474d-a2bd-028cf620afe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:19.425711 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7a4fa-d468-474d-a2bd-028cf620afe1 admin admin] PATH_INFO: `/v3/projects/5c4996c2e1f948eba6f54698eb8eb988/users/c10ab81a47204dc4a09ac62e4989e978/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:19.465118 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a7a4fa-d468-474d-a2bd-028cf620afe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c4996c2e1f948eba6f54698eb8eb988, user_id=c10ab81a47204dc4a09ac62e4989e978, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:19.469562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a7a4fa-d468-474d-a2bd-028cf620afe1 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:19.631026 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 929/1828] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:11:19 2022] PUT /identity/v3/projects/5c4996c2e1f948eba6f54698eb8eb988/users/c10ab81a47204dc4a09ac62e4989e978/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:19.639310 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3942c-4640-45da-856b-a5390b12a2f5 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:19.639743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3942c-4640-45da-856b-a5390b12a2f5 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:19.640518 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3942c-4640-45da-856b-a5390b12a2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:19.694084 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-63a3942c-4640-45da-856b-a5390b12a2f5 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:19.696559 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-63a3942c-4640-45da-856b-a5390b12a2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:19.809743 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7a4fa-d468-474d-a2bd-028cf620afe1 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:19.813305 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-a9a7a4fa-d468-474d-a2bd-028cf620afe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:19.830787 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 900/1829] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:11:19.839432 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7a4fa-d468-474d-a2bd-028cf620afe1 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:19.851379 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9580f6-e3f8-43d2-8072-f76d2f0130d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:19.852375 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9580f6-e3f8-43d2-8072-f76d2f0130d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:19.853011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9580f6-e3f8-43d2-8072-f76d2f0130d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:19.853642 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9580f6-e3f8-43d2-8072-f76d2f0130d8 admin admin] PATH_INFO: `/v3/projects/df3ee49515e94ab89c0ed0cb41bd386c` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:19.855364 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9580f6-e3f8-43d2-8072-f76d2f0130d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df3ee49515e94ab89c0ed0cb41bd386c)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:19.858109 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9580f6-e3f8-43d2-8072-f76d2f0130d8 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:19.909372 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3942c-4640-45da-856b-a5390b12a2f5 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:20.061352 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:20.063704 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-be9580f6-e3f8-43d2-8072-f76d2f0130d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df3ee49515e94ab89c0ed0cb41bd386c', 'request_id': 'req-be9580f6-e3f8-43d2-8072-f76d2f0130d8'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:20.082639 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3942c-4640-45da-856b-a5390b12a2f5 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:20.144835 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba123b1-50f4-4bbe-bddd-bc74df6ec45c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:20.146266 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba123b1-50f4-4bbe-bddd-bc74df6ec45c service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:20.147057 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-be9580f6-e3f8-43d2-8072-f76d2f0130d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df3ee49515e94ab89c0ed0cb41bd386c', 'request_id': 'req-be9580f6-e3f8-43d2-8072-f76d2f0130d8'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:20.147351 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba123b1-50f4-4bbe-bddd-bc74df6ec45c service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:20.148903 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba123b1-50f4-4bbe-bddd-bc74df6ec45c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:20.160568 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-be9580f6-e3f8-43d2-8072-f76d2f0130d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df3ee49515e94ab89c0ed0cb41bd386c', 'request_id': 'req-be9580f6-e3f8-43d2-8072-f76d2f0130d8'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:20.199638 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-be9580f6-e3f8-43d2-8072-f76d2f0130d8 admin admin] The token cache is being invalidate because project df3ee49515e94ab89c0ed0cb41bd386c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:11:20.200314 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-be9580f6-e3f8-43d2-8072-f76d2f0130d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:20.203626 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-be9580f6-e3f8-43d2-8072-f76d2f0130d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:20.205258 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 930/1830] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:11:19 2022] DELETE /identity/v3/projects/df3ee49515e94ab89c0ed0cb41bd386c => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:11:20.214885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9580f6-e3f8-43d2-8072-f76d2f0130d8 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:20.217575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-be9580f6-e3f8-43d2-8072-f76d2f0130d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:20.268397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba123b1-50f4-4bbe-bddd-bc74df6ec45c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:20.273474 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba123b1-50f4-4bbe-bddd-bc74df6ec45c service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:20.310835 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 901/1831] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:11:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:11:20.372787 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9580f6-e3f8-43d2-8072-f76d2f0130d8 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:20.379548 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7acbdb-5c0d-4fe2-9137-a9596b19a90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:20.381478 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7acbdb-5c0d-4fe2-9137-a9596b19a90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:20.382142 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7acbdb-5c0d-4fe2-9137-a9596b19a90f admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:20.382375 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7acbdb-5c0d-4fe2-9137-a9596b19a90f admin admin] PATH_INFO: `/v3/users/969f2839334a48a8980c55ef856942fe` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:20.384113 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7acbdb-5c0d-4fe2-9137-a9596b19a90f admin admin] RBAC: Authorizing `identity:delete_user(user_id=969f2839334a48a8980c55ef856942fe)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:20.387816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7acbdb-5c0d-4fe2-9137-a9596b19a90f admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:20.654678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-9b7acbdb-5c0d-4fe2-9137-a9596b19a90f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '969f2839334a48a8980c55ef856942fe'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:20.785020 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-9b7acbdb-5c0d-4fe2-9137-a9596b19a90f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '969f2839334a48a8980c55ef856942fe'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:20.799707 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-9b7acbdb-5c0d-4fe2-9137-a9596b19a90f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '969f2839334a48a8980c55ef856942fe'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:20.802167 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-9b7acbdb-5c0d-4fe2-9137-a9596b19a90f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '969f2839334a48a8980c55ef856942fe'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:20.803482 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-9b7acbdb-5c0d-4fe2-9137-a9596b19a90f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '969f2839334a48a8980c55ef856942fe'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:20.816631 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:20.843509 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 931/1832] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:11:20 2022] DELETE /identity/v3/users/969f2839334a48a8980c55ef856942fe => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:21.634136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba123b1-50f4-4bbe-bddd-bc74df6ec45c service neutron] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:21.648298 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba123b1-50f4-4bbe-bddd-bc74df6ec45c service neutron] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:21.790527 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5397c-7242-47f1-a158-1051545d92ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:21.791379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5397c-7242-47f1-a158-1051545d92ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:21.791812 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5397c-7242-47f1-a158-1051545d92ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:21.792233 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5397c-7242-47f1-a158-1051545d92ff admin admin] PATH_INFO: `/v3/projects/230a9a87290a44ef94e94ac25506de37` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:21.794053 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb5397c-7242-47f1-a158-1051545d92ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=230a9a87290a44ef94e94ac25506de37)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:21.823357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb5397c-7242-47f1-a158-1051545d92ff admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:22.009457 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-2fb5397c-7242-47f1-a158-1051545d92ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '230a9a87290a44ef94e94ac25506de37', 'request_id': 'req-2fb5397c-7242-47f1-a158-1051545d92ff'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:22.020757 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-2fb5397c-7242-47f1-a158-1051545d92ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '230a9a87290a44ef94e94ac25506de37', 'request_id': 'req-2fb5397c-7242-47f1-a158-1051545d92ff'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:22.032784 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-2fb5397c-7242-47f1-a158-1051545d92ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '230a9a87290a44ef94e94ac25506de37', 'request_id': 'req-2fb5397c-7242-47f1-a158-1051545d92ff'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:22.150619 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:22.188990 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-2fb5397c-7242-47f1-a158-1051545d92ff admin admin] The token cache is being invalidate because project 230a9a87290a44ef94e94ac25506de37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:11:22.189425 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-2fb5397c-7242-47f1-a158-1051545d92ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:22.190600 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-2fb5397c-7242-47f1-a158-1051545d92ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:22.194267 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 902/1833] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:11:21 2022] DELETE /identity/v3/projects/230a9a87290a44ef94e94ac25506de37 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:11:22.202734 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c605828-1b3e-4fb4-bd8d-a5be190b67ab None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:22.203585 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c605828-1b3e-4fb4-bd8d-a5be190b67ab None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:22.204094 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c605828-1b3e-4fb4-bd8d-a5be190b67ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:22.243701 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-2c605828-1b3e-4fb4-bd8d-a5be190b67ab None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:22.258948 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-2c605828-1b3e-4fb4-bd8d-a5be190b67ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:22.367942 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 932/1834] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:11:22.376484 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d55dc-b0eb-4075-a20d-036fcb60eef9 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:22.376803 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d55dc-b0eb-4075-a20d-036fcb60eef9 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:22.377039 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d55dc-b0eb-4075-a20d-036fcb60eef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:22.412118 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-050d55dc-b0eb-4075-a20d-036fcb60eef9 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:22.412403 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-050d55dc-b0eb-4075-a20d-036fcb60eef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:22.425341 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 903/1835] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:11:22.426257 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c605828-1b3e-4fb4-bd8d-a5be190b67ab None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:22.447688 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c605828-1b3e-4fb4-bd8d-a5be190b67ab None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:22.456608 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0068be2-eb61-4bb0-a3ea-000f267c6cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:22.458321 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0068be2-eb61-4bb0-a3ea-000f267c6cde admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:22.458988 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0068be2-eb61-4bb0-a3ea-000f267c6cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:22.459493 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0068be2-eb61-4bb0-a3ea-000f267c6cde admin admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:22.460943 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0068be2-eb61-4bb0-a3ea-000f267c6cde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:11:22.461494 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0068be2-eb61-4bb0-a3ea-000f267c6cde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:22.464933 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0068be2-eb61-4bb0-a3ea-000f267c6cde admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:22.488345 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 933/1836] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:11:22.493813 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d55dc-b0eb-4075-a20d-036fcb60eef9 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:22.497457 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30953f-424f-4c4f-b61e-c95463a80037 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:22.498124 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30953f-424f-4c4f-b61e-c95463a80037 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:22.499088 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30953f-424f-4c4f-b61e-c95463a80037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:22.509761 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d55dc-b0eb-4075-a20d-036fcb60eef9 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:22.521936 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138daf4d-664b-46f3-aa6a-65bbbb34a0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:22.522706 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138daf4d-664b-46f3-aa6a-65bbbb34a0b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:22.522989 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138daf4d-664b-46f3-aa6a-65bbbb34a0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:22.523261 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138daf4d-664b-46f3-aa6a-65bbbb34a0b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:22.524720 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138daf4d-664b-46f3-aa6a-65bbbb34a0b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:22.538064 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138daf4d-664b-46f3-aa6a-65bbbb34a0b8 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:22.556021 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-9d30953f-424f-4c4f-b61e-c95463a80037 None None] MFA Rules not processed for user `c10ab81a47204dc4a09ac62e4989e978`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:22.558294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-9d30953f-424f-4c4f-b61e-c95463a80037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:22.653679 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 904/1837] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:11:22 2022] POST /identity/v3/projects => generated 381 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:11:22.658976 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138daf4d-664b-46f3-aa6a-65bbbb34a0b8 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:22.675768 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 934/1838] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:11:22.687175 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30953f-424f-4c4f-b61e-c95463a80037 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:22.687175 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-9d30953f-424f-4c4f-b61e-c95463a80037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:22.707086 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30953f-424f-4c4f-b61e-c95463a80037 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:22.811721 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138daf4d-664b-46f3-aa6a-65bbbb34a0b8 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:22.817768 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd22df-f271-4c30-ab7f-88cf5e5d0b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:22.818852 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd22df-f271-4c30-ab7f-88cf5e5d0b53 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:22.819207 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd22df-f271-4c30-ab7f-88cf5e5d0b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:22.819541 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd22df-f271-4c30-ab7f-88cf5e5d0b53 admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:22.821332 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd22df-f271-4c30-ab7f-88cf5e5d0b53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:22.824435 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd22df-f271-4c30-ab7f-88cf5e5d0b53 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:22.928796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fa0b5-564e-4539-8d6f-127af8479f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:22.929507 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fa0b5-564e-4539-8d6f-127af8479f9b admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:22.929788 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fa0b5-564e-4539-8d6f-127af8479f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:22.930065 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fa0b5-564e-4539-8d6f-127af8479f9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:22.930771 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48fa0b5-564e-4539-8d6f-127af8479f9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:22.933525 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48fa0b5-564e-4539-8d6f-127af8479f9b admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:22.975368 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 905/1839] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:11:22 2022] POST /identity/v3/users => generated 291 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:11:22.992488 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd22df-f271-4c30-ab7f-88cf5e5d0b53 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:23.012904 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd22df-f271-4c30-ab7f-88cf5e5d0b53 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:23.048378 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:23.075733 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a4cb2-1ebe-4b32-80a3-a6a9ac2cbd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:23.081196 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a4cb2-1ebe-4b32-80a3-a6a9ac2cbd91 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:23.088952 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a4cb2-1ebe-4b32-80a3-a6a9ac2cbd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:23.090068 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a4cb2-1ebe-4b32-80a3-a6a9ac2cbd91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:23.092011 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a4cb2-1ebe-4b32-80a3-a6a9ac2cbd91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:23.106613 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a4cb2-1ebe-4b32-80a3-a6a9ac2cbd91 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:23.148565 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 935/1840] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:11:22 2022] POST /identity/v3/projects => generated 371 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:11:23.149476 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fa0b5-564e-4539-8d6f-127af8479f9b admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:23.183004 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 906/1841] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:11:23.193023 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a4cb2-1ebe-4b32-80a3-a6a9ac2cbd91 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:23.228145 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a4cb2-1ebe-4b32-80a3-a6a9ac2cbd91 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:23.356585 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fa0b5-564e-4539-8d6f-127af8479f9b admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:23.366580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33374be8-4e12-4628-84d7-6b5f8339f686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:23.370427 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33374be8-4e12-4628-84d7-6b5f8339f686 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:23.370954 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33374be8-4e12-4628-84d7-6b5f8339f686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:23.371645 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33374be8-4e12-4628-84d7-6b5f8339f686 admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:23.373964 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33374be8-4e12-4628-84d7-6b5f8339f686 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:23.377327 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33374be8-4e12-4628-84d7-6b5f8339f686 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:23.430832 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53726a86-a066-4a57-b531-e7730b50c634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:23.431637 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53726a86-a066-4a57-b531-e7730b50c634 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:23.432179 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53726a86-a066-4a57-b531-e7730b50c634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:23.432674 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53726a86-a066-4a57-b531-e7730b50c634 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:23.433991 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53726a86-a066-4a57-b531-e7730b50c634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:23.437235 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53726a86-a066-4a57-b531-e7730b50c634 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:23.490304 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 907/1842] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:11:23.498060 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53726a86-a066-4a57-b531-e7730b50c634 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:23.501098 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 936/1843] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:11:23 2022] POST /identity/v3/users => generated 292 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:11:23.507629 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33374be8-4e12-4628-84d7-6b5f8339f686 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:23.521372 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53726a86-a066-4a57-b531-e7730b50c634 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:23.533760 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f23c5-5b4a-46bb-a61f-f949560c4713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:23.537819 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f23c5-5b4a-46bb-a61f-f949560c4713 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:23.537819 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f23c5-5b4a-46bb-a61f-f949560c4713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:23.539622 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f23c5-5b4a-46bb-a61f-f949560c4713 admin admin] PATH_INFO: `/v3/projects/54a6f82e6dc843628455b12d8cb702bd/users/de5ffc138fc2464991f8ef3ff46737cb/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:23.540408 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33374be8-4e12-4628-84d7-6b5f8339f686 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:23.550699 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebea77-74f5-4522-a040-5bddd99d8e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:23.553073 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebea77-74f5-4522-a040-5bddd99d8e4d admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:23.553551 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebea77-74f5-4522-a040-5bddd99d8e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:23.554320 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebea77-74f5-4522-a040-5bddd99d8e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:23.555665 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebea77-74f5-4522-a040-5bddd99d8e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:23.559734 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebea77-74f5-4522-a040-5bddd99d8e4d admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:23.584819 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f23c5-5b4a-46bb-a61f-f949560c4713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54a6f82e6dc843628455b12d8cb702bd, user_id=de5ffc138fc2464991f8ef3ff46737cb, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:23.586319 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 937/1844] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:11:23.588018 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f23c5-5b4a-46bb-a61f-f949560c4713 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:23.590944 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebea77-74f5-4522-a040-5bddd99d8e4d admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:23.611975 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebea77-74f5-4522-a040-5bddd99d8e4d admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:23.620460 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d993fed-95de-4319-ba46-6fdc1521f123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:23.621340 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d993fed-95de-4319-ba46-6fdc1521f123 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:23.622254 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d993fed-95de-4319-ba46-6fdc1521f123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:23.622765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d993fed-95de-4319-ba46-6fdc1521f123 admin admin] PATH_INFO: `/v3/projects/66df5c2e75df4980a216e3fb3ad335d8/users/9c6c6660ed3841768652beee041d1dbd/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:23.652630 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d993fed-95de-4319-ba46-6fdc1521f123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66df5c2e75df4980a216e3fb3ad335d8, user_id=9c6c6660ed3841768652beee041d1dbd, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:23.656195 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d993fed-95de-4319-ba46-6fdc1521f123 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:23.670387 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 908/1845] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:11:23 2022] PUT /identity/v3/projects/54a6f82e6dc843628455b12d8cb702bd/users/de5ffc138fc2464991f8ef3ff46737cb/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:23.691481 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed95a98-b287-46d2-a2c2-30c9db348809 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:23.692448 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed95a98-b287-46d2-a2c2-30c9db348809 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:23.693289 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed95a98-b287-46d2-a2c2-30c9db348809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:23.720073 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:23.755780 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-fed95a98-b287-46d2-a2c2-30c9db348809 None None] MFA Rules not processed for user `de5ffc138fc2464991f8ef3ff46737cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:23.755780 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-fed95a98-b287-46d2-a2c2-30c9db348809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:23.827133 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 938/1846] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:11:23 2022] PUT /identity/v3/projects/66df5c2e75df4980a216e3fb3ad335d8/users/9c6c6660ed3841768652beee041d1dbd/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:23.835264 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d993fed-95de-4319-ba46-6fdc1521f123 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:23.925218 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 909/1847] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:11:23.936913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed95a98-b287-46d2-a2c2-30c9db348809 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:24.004804 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d993fed-95de-4319-ba46-6fdc1521f123 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:24.012541 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fe73c-f498-4ceb-b253-8e83ba399067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:24.013616 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fe73c-f498-4ceb-b253-8e83ba399067 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:24.014086 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fe73c-f498-4ceb-b253-8e83ba399067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:24.014578 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fe73c-f498-4ceb-b253-8e83ba399067 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:24.015489 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974fe73c-f498-4ceb-b253-8e83ba399067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:24.017898 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974fe73c-f498-4ceb-b253-8e83ba399067 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:24.035135 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 939/1848] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:11:24.037563 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fe73c-f498-4ceb-b253-8e83ba399067 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:24.053871 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fe73c-f498-4ceb-b253-8e83ba399067 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:24.060725 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850bd031-18b4-430c-b8e5-c2364692abe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:24.061796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850bd031-18b4-430c-b8e5-c2364692abe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:24.062406 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850bd031-18b4-430c-b8e5-c2364692abe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:24.063028 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850bd031-18b4-430c-b8e5-c2364692abe8 admin admin] PATH_INFO: `/v3/projects/66df5c2e75df4980a216e3fb3ad335d8/users/9c6c6660ed3841768652beee041d1dbd/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:24.065988 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850bd031-18b4-430c-b8e5-c2364692abe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66df5c2e75df4980a216e3fb3ad335d8, user_id=9c6c6660ed3841768652beee041d1dbd, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:24.070744 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850bd031-18b4-430c-b8e5-c2364692abe8 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:24.081496 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed95a98-b287-46d2-a2c2-30c9db348809 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:24.085039 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94b654-a774-452d-a542-aa88786b7c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:24.085874 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94b654-a774-452d-a542-aa88786b7c73 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:24.086244 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94b654-a774-452d-a542-aa88786b7c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:24.086744 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94b654-a774-452d-a542-aa88786b7c73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:24.087545 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94b654-a774-452d-a542-aa88786b7c73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:24.090223 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94b654-a774-452d-a542-aa88786b7c73 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:24.113637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 940/1849] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:11:24 2022] PUT /identity/v3/projects/66df5c2e75df4980a216e3fb3ad335d8/users/9c6c6660ed3841768652beee041d1dbd/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:24.275554 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850bd031-18b4-430c-b8e5-c2364692abe8 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:24.277881 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 910/1850] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:11:23 2022] POST /identity/v3/projects => generated 381 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:11:24.417084 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850bd031-18b4-430c-b8e5-c2364692abe8 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:24.523140 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a4581-8058-4a75-bd02-b135fe40ff78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:24.524917 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a4581-8058-4a75-bd02-b135fe40ff78 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:24.525360 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a4581-8058-4a75-bd02-b135fe40ff78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:24.525838 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a4581-8058-4a75-bd02-b135fe40ff78 admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:24.527241 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a4581-8058-4a75-bd02-b135fe40ff78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:24.531205 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a4581-8058-4a75-bd02-b135fe40ff78 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:24.714526 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 941/1851] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:11:24 2022] POST /identity/v3/users => generated 297 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:11:24.719407 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94b654-a774-452d-a542-aa88786b7c73 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:24.733598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94b654-a774-452d-a542-aa88786b7c73 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:24.739295 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6fe22-bdac-4216-adc0-73ae59199661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:24.740264 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6fe22-bdac-4216-adc0-73ae59199661 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:24.740614 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6fe22-bdac-4216-adc0-73ae59199661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:24.740933 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6fe22-bdac-4216-adc0-73ae59199661 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:24.741672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6fe22-bdac-4216-adc0-73ae59199661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:24.743841 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6fe22-bdac-4216-adc0-73ae59199661 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:24.757886 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 911/1852] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:11:24.763683 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a4581-8058-4a75-bd02-b135fe40ff78 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:24.786644 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a4581-8058-4a75-bd02-b135fe40ff78 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:24.790138 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca6200-5746-4374-a68b-0621525a4534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:24.791186 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca6200-5746-4374-a68b-0621525a4534 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:24.791536 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca6200-5746-4374-a68b-0621525a4534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:24.791883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca6200-5746-4374-a68b-0621525a4534 admin admin] PATH_INFO: `/v3/projects/e29247965d154055b597b8096650b681/users/f75f5a48784f459a8a09acecedce2860/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:24.813623 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca6200-5746-4374-a68b-0621525a4534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e29247965d154055b597b8096650b681, user_id=f75f5a48784f459a8a09acecedce2860, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:24.819193 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca6200-5746-4374-a68b-0621525a4534 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:24.919355 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 942/1853] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:11:24 2022] PUT /identity/v3/projects/e29247965d154055b597b8096650b681/users/f75f5a48784f459a8a09acecedce2860/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:11:24.924455 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6fe22-bdac-4216-adc0-73ae59199661 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:24.961897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6fe22-bdac-4216-adc0-73ae59199661 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:24.985560 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:25.123023 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708f5f7-9e19-452b-bc13-8f073a4f6a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:25.123719 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708f5f7-9e19-452b-bc13-8f073a4f6a77 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:25.124002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708f5f7-9e19-452b-bc13-8f073a4f6a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:25.125178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708f5f7-9e19-452b-bc13-8f073a4f6a77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:25.125407 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708f5f7-9e19-452b-bc13-8f073a4f6a77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:25.127860 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708f5f7-9e19-452b-bc13-8f073a4f6a77 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:25.147938 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 912/1854] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:11:25.152567 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca6200-5746-4374-a68b-0621525a4534 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:25.168556 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca6200-5746-4374-a68b-0621525a4534 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:25.175107 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819b117-61f7-4efc-bb99-4f94df5ca4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:25.175857 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819b117-61f7-4efc-bb99-4f94df5ca4c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:25.177922 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819b117-61f7-4efc-bb99-4f94df5ca4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:25.177922 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819b117-61f7-4efc-bb99-4f94df5ca4c8 admin admin] PATH_INFO: `/v3/projects/e29247965d154055b597b8096650b681/users/f75f5a48784f459a8a09acecedce2860/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:25.179503 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819b117-61f7-4efc-bb99-4f94df5ca4c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e29247965d154055b597b8096650b681, user_id=f75f5a48784f459a8a09acecedce2860, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:25.182457 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819b117-61f7-4efc-bb99-4f94df5ca4c8 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:25.207002 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 943/1855] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:11:25 2022] PUT /identity/v3/projects/e29247965d154055b597b8096650b681/users/f75f5a48784f459a8a09acecedce2860/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:11:25.210195 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05849d-923b-4cf1-ac61-3fde9f5ede2f None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:25.211045 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05849d-923b-4cf1-ac61-3fde9f5ede2f None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:25.211045 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05849d-923b-4cf1-ac61-3fde9f5ede2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:25.249866 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-6e05849d-923b-4cf1-ac61-3fde9f5ede2f None None] MFA Rules not processed for user `f75f5a48784f459a8a09acecedce2860`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:25.251308 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-6e05849d-923b-4cf1-ac61-3fde9f5ede2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:25.404633 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 913/1856] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:25 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:11:25.418590 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:25.457413 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819b117-61f7-4efc-bb99-4f94df5ca4c8 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:25.459985 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-c819b117-61f7-4efc-bb99-4f94df5ca4c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:25.605514 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819b117-61f7-4efc-bb99-4f94df5ca4c8 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:25.612474 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35500f-a931-42c0-a43b-653f3ed94ac4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:25.615324 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35500f-a931-42c0-a43b-653f3ed94ac4 service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:25.621569 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35500f-a931-42c0-a43b-653f3ed94ac4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:25.622331 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35500f-a931-42c0-a43b-653f3ed94ac4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:25.640909 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35500f-a931-42c0-a43b-653f3ed94ac4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:25.644430 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35500f-a931-42c0-a43b-653f3ed94ac4 service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:25.668495 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 944/1857] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:11:25 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:11:26.101645 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:26.299908 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecc444-14c5-49eb-9975-53060714ed8f None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:26.300511 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecc444-14c5-49eb-9975-53060714ed8f None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:26.300925 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecc444-14c5-49eb-9975-53060714ed8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:26.361364 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-7aecc444-14c5-49eb-9975-53060714ed8f None None] MFA Rules not processed for user `9c6c6660ed3841768652beee041d1dbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:26.363606 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-7aecc444-14c5-49eb-9975-53060714ed8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:26.571050 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 914/1858] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:26 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:11:26.588669 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35500f-a931-42c0-a43b-653f3ed94ac4 service cinder] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:26.591126 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-db35500f-a931-42c0-a43b-653f3ed94ac4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:26.618537 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35500f-a931-42c0-a43b-653f3ed94ac4 service cinder] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:26.619340 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65484898-5811-4b9e-89e8-c4fb2643d781 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:26.630257 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65484898-5811-4b9e-89e8-c4fb2643d781 service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:26.630257 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65484898-5811-4b9e-89e8-c4fb2643d781 service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:26.630257 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65484898-5811-4b9e-89e8-c4fb2643d781 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:26.702415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65484898-5811-4b9e-89e8-c4fb2643d781 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:26.704384 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65484898-5811-4b9e-89e8-c4fb2643d781 service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:26.716270 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 945/1859] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:11:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:11:26.843657 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:27.409637 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aecc444-14c5-49eb-9975-53060714ed8f None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:27.436637 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aecc444-14c5-49eb-9975-53060714ed8f None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:27.465983 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2817a5-1b2a-42f2-b7bc-096ae77544e8 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75f5a48784f459a8a09acecedce2860', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29247965d154055b597b8096650b681', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:27.470628 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2817a5-1b2a-42f2-b7bc-096ae77544e8 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:27.471890 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2817a5-1b2a-42f2-b7bc-096ae77544e8 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:27.472703 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2817a5-1b2a-42f2-b7bc-096ae77544e8 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:27.474908 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2817a5-1b2a-42f2-b7bc-096ae77544e8 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:11:27.475943 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2817a5-1b2a-42f2-b7bc-096ae77544e8 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:27.481958 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2817a5-1b2a-42f2-b7bc-096ae77544e8 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:27.514152 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 915/1860] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:11:27.518597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65484898-5811-4b9e-89e8-c4fb2643d781 service cinder] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:27.532010 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65484898-5811-4b9e-89e8-c4fb2643d781 service cinder] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:27.538326 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc343633-ae68-4c94-acba-09a96ad81876 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75f5a48784f459a8a09acecedce2860', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29247965d154055b597b8096650b681', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:27.539054 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc343633-ae68-4c94-acba-09a96ad81876 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:27.539389 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc343633-ae68-4c94-acba-09a96ad81876 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:27.539676 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc343633-ae68-4c94-acba-09a96ad81876 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:27.540414 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc343633-ae68-4c94-acba-09a96ad81876 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:27.545397 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc343633-ae68-4c94-acba-09a96ad81876 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:27.655360 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 946/1861] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:11:27 2022] POST /identity/v3/projects => generated 353 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:11:27.660372 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2817a5-1b2a-42f2-b7bc-096ae77544e8 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:27.671909 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2817a5-1b2a-42f2-b7bc-096ae77544e8 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:27.679591 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:27.790948 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c38cd-2056-47c3-84d1-acdff04b94d3 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75f5a48784f459a8a09acecedce2860', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29247965d154055b597b8096650b681', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:27.791991 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c38cd-2056-47c3-84d1-acdff04b94d3 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:27.797252 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c38cd-2056-47c3-84d1-acdff04b94d3 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:27.797252 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c38cd-2056-47c3-84d1-acdff04b94d3 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:27.797252 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c38cd-2056-47c3-84d1-acdff04b94d3 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:11:27.797252 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c38cd-2056-47c3-84d1-acdff04b94d3 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:27.798195 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c38cd-2056-47c3-84d1-acdff04b94d3 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:27.823367 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 916/1862] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:11:27.894309 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc343633-ae68-4c94-acba-09a96ad81876 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:27.914882 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc343633-ae68-4c94-acba-09a96ad81876 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:27.921315 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688a3ab-481c-4c74-b9e7-e02c11217ed9 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75f5a48784f459a8a09acecedce2860', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29247965d154055b597b8096650b681', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:27.922218 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688a3ab-481c-4c74-b9e7-e02c11217ed9 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:27.923007 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688a3ab-481c-4c74-b9e7-e02c11217ed9 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:27.923613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688a3ab-481c-4c74-b9e7-e02c11217ed9 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] PATH_INFO: `/v3/projects/58832387cb674af7a6ef92bce2fb36b2` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:27.925633 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688a3ab-481c-4c74-b9e7-e02c11217ed9 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] RBAC: Authorizing `identity:delete_project(project_id=58832387cb674af7a6ef92bce2fb36b2)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:27.929679 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688a3ab-481c-4c74-b9e7-e02c11217ed9 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:28.099722 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-5688a3ab-481c-4c74-b9e7-e02c11217ed9 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58832387cb674af7a6ef92bce2fb36b2', 'request_id': 'req-5688a3ab-481c-4c74-b9e7-e02c11217ed9'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:28.229960 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-5688a3ab-481c-4c74-b9e7-e02c11217ed9 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58832387cb674af7a6ef92bce2fb36b2', 'request_id': 'req-5688a3ab-481c-4c74-b9e7-e02c11217ed9'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:28.249223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-5688a3ab-481c-4c74-b9e7-e02c11217ed9 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58832387cb674af7a6ef92bce2fb36b2', 'request_id': 'req-5688a3ab-481c-4c74-b9e7-e02c11217ed9'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:28.309220 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-5688a3ab-481c-4c74-b9e7-e02c11217ed9 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] The token cache is being invalidate because project 58832387cb674af7a6ef92bce2fb36b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:11:28.309522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-5688a3ab-481c-4c74-b9e7-e02c11217ed9 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:28.310218 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-5688a3ab-481c-4c74-b9e7-e02c11217ed9 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:28.312216 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 947/1863] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:11:27 2022] DELETE /identity/v3/projects/58832387cb674af7a6ef92bce2fb36b2 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:29.114516 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c38cd-2056-47c3-84d1-acdff04b94d3 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:29.118999 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-171c38cd-2056-47c3-84d1-acdff04b94d3 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:29.247057 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:29.256298 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c38cd-2056-47c3-84d1-acdff04b94d3 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:29.350317 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bc6c6-8b43-433c-89be-710d026e41a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:29.350996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bc6c6-8b43-433c-89be-710d026e41a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:29.351511 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bc6c6-8b43-433c-89be-710d026e41a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:29.351799 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bc6c6-8b43-433c-89be-710d026e41a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:29.354016 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-670bc6c6-8b43-433c-89be-710d026e41a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:29.466311 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bc6c6-8b43-433c-89be-710d026e41a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:29.468254 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bc6c6-8b43-433c-89be-710d026e41a2 service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:29.483383 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 917/1864] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:11:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:11:29.709501 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688a3ab-481c-4c74-b9e7-e02c11217ed9 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:29.713800 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-5688a3ab-481c-4c74-b9e7-e02c11217ed9 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:29.916531 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688a3ab-481c-4c74-b9e7-e02c11217ed9 tempest-VolumeQuotaClassesTest-1481618923 tempest-VolumeQuotaClassesTest-1481618923-project-admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:29.922164 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e4cdd-8854-44b3-9a7d-3356ebd255da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:29.922804 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e4cdd-8854-44b3-9a7d-3356ebd255da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:29.923037 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e4cdd-8854-44b3-9a7d-3356ebd255da admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:29.923311 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e4cdd-8854-44b3-9a7d-3356ebd255da admin admin] PATH_INFO: `/v3/users/de5ffc138fc2464991f8ef3ff46737cb` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:29.924791 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e4cdd-8854-44b3-9a7d-3356ebd255da admin admin] RBAC: Authorizing `identity:delete_user(user_id=de5ffc138fc2464991f8ef3ff46737cb)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:29.927631 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e4cdd-8854-44b3-9a7d-3356ebd255da admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:30.202284 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-e36e4cdd-8854-44b3-9a7d-3356ebd255da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de5ffc138fc2464991f8ef3ff46737cb'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:30.356812 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-e36e4cdd-8854-44b3-9a7d-3356ebd255da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de5ffc138fc2464991f8ef3ff46737cb'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:30.366769 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-e36e4cdd-8854-44b3-9a7d-3356ebd255da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de5ffc138fc2464991f8ef3ff46737cb'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:30.367559 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-e36e4cdd-8854-44b3-9a7d-3356ebd255da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de5ffc138fc2464991f8ef3ff46737cb'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:30.368291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-e36e4cdd-8854-44b3-9a7d-3356ebd255da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de5ffc138fc2464991f8ef3ff46737cb'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:30.378747 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=81,keystone:INSERT=3,keystone:DELETE=16 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:30.396229 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 948/1865] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:11:29 2022] DELETE /identity/v3/users/de5ffc138fc2464991f8ef3ff46737cb => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:30.401653 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5366f-91c9-40f0-b4d4-ba243d9bc86d None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:30.402440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5366f-91c9-40f0-b4d4-ba243d9bc86d None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:30.402440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5366f-91c9-40f0-b4d4-ba243d9bc86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:30.435159 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-4bf5366f-91c9-40f0-b4d4-ba243d9bc86d None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:30.435159 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-4bf5366f-91c9-40f0-b4d4-ba243d9bc86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:30.544365 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 918/1866] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:11:30.566430 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e4cdd-8854-44b3-9a7d-3356ebd255da admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:30.570046 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-e36e4cdd-8854-44b3-9a7d-3356ebd255da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:30.651370 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e4cdd-8854-44b3-9a7d-3356ebd255da admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:30.658518 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb505f-79e0-4c29-9151-cf69819a3851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:30.659696 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb505f-79e0-4c29-9151-cf69819a3851 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:30.660216 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb505f-79e0-4c29-9151-cf69819a3851 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:30.661863 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb505f-79e0-4c29-9151-cf69819a3851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:30.679332 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb505f-79e0-4c29-9151-cf69819a3851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:30.682137 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb505f-79e0-4c29-9151-cf69819a3851 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:30.700371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 949/1867] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:11:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:11:31.412110 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5366f-91c9-40f0-b4d4-ba243d9bc86d None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:31.414362 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-4bf5366f-91c9-40f0-b4d4-ba243d9bc86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:31.444229 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5366f-91c9-40f0-b4d4-ba243d9bc86d None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:31.465953 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d2c14-b10f-4cd6-958a-abe99a03c747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:31.468561 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d2c14-b10f-4cd6-958a-abe99a03c747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:31.470304 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d2c14-b10f-4cd6-958a-abe99a03c747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:31.471889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d2c14-b10f-4cd6-958a-abe99a03c747 admin admin] PATH_INFO: `/v3/projects/54a6f82e6dc843628455b12d8cb702bd` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:31.487086 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318d2c14-b10f-4cd6-958a-abe99a03c747 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54a6f82e6dc843628455b12d8cb702bd)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:31.488621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318d2c14-b10f-4cd6-958a-abe99a03c747 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:31.749961 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:31.749961 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-318d2c14-b10f-4cd6-958a-abe99a03c747 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54a6f82e6dc843628455b12d8cb702bd', 'request_id': 'req-318d2c14-b10f-4cd6-958a-abe99a03c747'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:31.749961 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-318d2c14-b10f-4cd6-958a-abe99a03c747 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54a6f82e6dc843628455b12d8cb702bd', 'request_id': 'req-318d2c14-b10f-4cd6-958a-abe99a03c747'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:31.749961 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-318d2c14-b10f-4cd6-958a-abe99a03c747 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54a6f82e6dc843628455b12d8cb702bd', 'request_id': 'req-318d2c14-b10f-4cd6-958a-abe99a03c747'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:31.905278 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-318d2c14-b10f-4cd6-958a-abe99a03c747 admin admin] The token cache is being invalidate because project 54a6f82e6dc843628455b12d8cb702bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:11:31.905871 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-318d2c14-b10f-4cd6-958a-abe99a03c747 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:31.907001 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-318d2c14-b10f-4cd6-958a-abe99a03c747 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:31.909020 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 919/1868] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:11:31 2022] DELETE /identity/v3/projects/54a6f82e6dc843628455b12d8cb702bd => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:31.919478 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb505f-79e0-4c29-9151-cf69819a3851 service neutron] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:31.932618 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb505f-79e0-4c29-9151-cf69819a3851 service neutron] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:32.045076 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d74ad5-b8eb-4462-ad35-64c02127f7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:32.045658 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d74ad5-b8eb-4462-ad35-64c02127f7f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:32.045947 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d74ad5-b8eb-4462-ad35-64c02127f7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:32.046229 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d74ad5-b8eb-4462-ad35-64c02127f7f7 admin admin] PATH_INFO: `/v3/users/f75f5a48784f459a8a09acecedce2860` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:32.047739 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d74ad5-b8eb-4462-ad35-64c02127f7f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f75f5a48784f459a8a09acecedce2860)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:32.050321 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d74ad5-b8eb-4462-ad35-64c02127f7f7 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:32.417458 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-61d74ad5-b8eb-4462-ad35-64c02127f7f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f75f5a48784f459a8a09acecedce2860'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:32.539177 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-61d74ad5-b8eb-4462-ad35-64c02127f7f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f75f5a48784f459a8a09acecedce2860'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:32.566676 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-61d74ad5-b8eb-4462-ad35-64c02127f7f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f75f5a48784f459a8a09acecedce2860'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:32.580353 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-61d74ad5-b8eb-4462-ad35-64c02127f7f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f75f5a48784f459a8a09acecedce2860'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:32.580353 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-61d74ad5-b8eb-4462-ad35-64c02127f7f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f75f5a48784f459a8a09acecedce2860'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:32.661054 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 950/1869] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:11:31 2022] DELETE /identity/v3/users/f75f5a48784f459a8a09acecedce2860 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:34.423746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d2c14-b10f-4cd6-958a-abe99a03c747 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:34.425498 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-318d2c14-b10f-4cd6-958a-abe99a03c747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:34.449250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d2c14-b10f-4cd6-958a-abe99a03c747 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:34.896404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858553b8-3a0f-446a-abcc-a7a9ed4ba416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:34.899184 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858553b8-3a0f-446a-abcc-a7a9ed4ba416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:34.899911 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858553b8-3a0f-446a-abcc-a7a9ed4ba416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:34.901661 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858553b8-3a0f-446a-abcc-a7a9ed4ba416 admin admin] PATH_INFO: `/v3/projects/e29247965d154055b597b8096650b681` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:34.906146 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858553b8-3a0f-446a-abcc-a7a9ed4ba416 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e29247965d154055b597b8096650b681)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:34.912335 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858553b8-3a0f-446a-abcc-a7a9ed4ba416 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:35.165903 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-858553b8-3a0f-446a-abcc-a7a9ed4ba416 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e29247965d154055b597b8096650b681', 'request_id': 'req-858553b8-3a0f-446a-abcc-a7a9ed4ba416'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:35.191011 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-858553b8-3a0f-446a-abcc-a7a9ed4ba416 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e29247965d154055b597b8096650b681', 'request_id': 'req-858553b8-3a0f-446a-abcc-a7a9ed4ba416'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:35.206123 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d74ad5-b8eb-4462-ad35-64c02127f7f7 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:35.211242 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-61d74ad5-b8eb-4462-ad35-64c02127f7f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:35.241786 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-858553b8-3a0f-446a-abcc-a7a9ed4ba416 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e29247965d154055b597b8096650b681', 'request_id': 'req-858553b8-3a0f-446a-abcc-a7a9ed4ba416'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:35.257704 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d74ad5-b8eb-4462-ad35-64c02127f7f7 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:35.283710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:35.407603 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-858553b8-3a0f-446a-abcc-a7a9ed4ba416 admin admin] The token cache is being invalidate because project e29247965d154055b597b8096650b681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:11:35.416286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-858553b8-3a0f-446a-abcc-a7a9ed4ba416 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:35.417865 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-858553b8-3a0f-446a-abcc-a7a9ed4ba416 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:35.427036 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 920/1870] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:11:34 2022] DELETE /identity/v3/projects/e29247965d154055b597b8096650b681 => generated 0 bytes in 998 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:11:35.430194 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ddf30-cc19-4e78-8404-8195830e1432 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:35.434433 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ddf30-cc19-4e78-8404-8195830e1432 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:35.435076 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ddf30-cc19-4e78-8404-8195830e1432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:35.473795 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc99abf-ce61-405d-80f3-b43051a7c3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:35.475634 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc99abf-ce61-405d-80f3-b43051a7c3d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:35.476413 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc99abf-ce61-405d-80f3-b43051a7c3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:35.477116 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc99abf-ce61-405d-80f3-b43051a7c3d9 admin admin] PATH_INFO: `/v3/users/c3a3bc94306141bbbf647b8a5ea484be` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:35.497939 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc99abf-ce61-405d-80f3-b43051a7c3d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3a3bc94306141bbbf647b8a5ea484be)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:35.498155 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-c63ddf30-cc19-4e78-8404-8195830e1432 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:35.500451 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-c63ddf30-cc19-4e78-8404-8195830e1432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:35.500673 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc99abf-ce61-405d-80f3-b43051a7c3d9 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:35.519038 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 921/1871] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:11:35.537637 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf7d46-82a4-406c-8934-c82388232cf0 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:35.538385 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf7d46-82a4-406c-8934-c82388232cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:35.538970 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf7d46-82a4-406c-8934-c82388232cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:35.582434 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-4ccf7d46-82a4-406c-8934-c82388232cf0 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:35.585606 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-4ccf7d46-82a4-406c-8934-c82388232cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:35.600538 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 922/1872] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:11:35.607457 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf7d46-82a4-406c-8934-c82388232cf0 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:35.643093 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf7d46-82a4-406c-8934-c82388232cf0 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:35.656800 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3cfe3-9c51-4a7b-96c5-701e6f23b378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:35.658993 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3cfe3-9c51-4a7b-96c5-701e6f23b378 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:35.659551 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3cfe3-9c51-4a7b-96c5-701e6f23b378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:35.661313 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3cfe3-9c51-4a7b-96c5-701e6f23b378 admin admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:35.662469 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed3cfe3-9c51-4a7b-96c5-701e6f23b378 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:11:35.663041 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed3cfe3-9c51-4a7b-96c5-701e6f23b378 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:35.665827 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed3cfe3-9c51-4a7b-96c5-701e6f23b378 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:35.687897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 923/1873] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:11:35.694019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3cfe3-9c51-4a7b-96c5-701e6f23b378 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:35.710232 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3cfe3-9c51-4a7b-96c5-701e6f23b378 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:35.731168 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8beb7-0182-4d14-acdc-3dbe4c0f71e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:35.731168 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8beb7-0182-4d14-acdc-3dbe4c0f71e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:35.731560 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8beb7-0182-4d14-acdc-3dbe4c0f71e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:35.731719 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8beb7-0182-4d14-acdc-3dbe4c0f71e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:35.732483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8beb7-0182-4d14-acdc-3dbe4c0f71e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:35.737462 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8beb7-0182-4d14-acdc-3dbe4c0f71e0 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:35.815097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-ddc99abf-ce61-405d-80f3-b43051a7c3d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3a3bc94306141bbbf647b8a5ea484be'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:35.932627 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-ddc99abf-ce61-405d-80f3-b43051a7c3d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3a3bc94306141bbbf647b8a5ea484be'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:35.941762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 924/1874] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:11:35 2022] POST /identity/v3/projects => generated 379 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:11:35.945530 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-ddc99abf-ce61-405d-80f3-b43051a7c3d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3a3bc94306141bbbf647b8a5ea484be'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:35.946680 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-ddc99abf-ce61-405d-80f3-b43051a7c3d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3a3bc94306141bbbf647b8a5ea484be'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:35.947420 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8beb7-0182-4d14-acdc-3dbe4c0f71e0 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:35.947899 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-ddc99abf-ce61-405d-80f3-b43051a7c3d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3a3bc94306141bbbf647b8a5ea484be'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:35.954995 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-d3d8beb7-0182-4d14-acdc-3dbe4c0f71e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:35.985537 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:36.084128 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 951/1875] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:11:35 2022] DELETE /identity/v3/users/c3a3bc94306141bbbf647b8a5ea484be => generated 0 bytes in 880 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:36.111091 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d7cb2-1581-401b-83f7-e5f5c8d7f395 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:36.124436 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d7cb2-1581-401b-83f7-e5f5c8d7f395 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:36.125007 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d7cb2-1581-401b-83f7-e5f5c8d7f395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:36.175542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8beb7-0182-4d14-acdc-3dbe4c0f71e0 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:36.191230 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-639d7cb2-1581-401b-83f7-e5f5c8d7f395 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:36.197751 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-639d7cb2-1581-401b-83f7-e5f5c8d7f395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:36.409476 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1663e-4f8c-4800-9b7f-d16ed498a16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:36.413296 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1663e-4f8c-4800-9b7f-d16ed498a16d admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:36.415423 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1663e-4f8c-4800-9b7f-d16ed498a16d admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:36.415948 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1663e-4f8c-4800-9b7f-d16ed498a16d admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:36.417346 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1663e-4f8c-4800-9b7f-d16ed498a16d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:36.425952 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1663e-4f8c-4800-9b7f-d16ed498a16d admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:36.488618 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 952/1876] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:11:36.505044 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d7cb2-1581-401b-83f7-e5f5c8d7f395 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:36.507548 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-639d7cb2-1581-401b-83f7-e5f5c8d7f395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:36.607718 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 925/1877] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:11:35 2022] POST /identity/v3/users => generated 290 bytes in 661 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:11:36.612614 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1663e-4f8c-4800-9b7f-d16ed498a16d admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:36.631798 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1663e-4f8c-4800-9b7f-d16ed498a16d admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:36.635562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:36.638940 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa9fcc-7e5c-41b2-af61-3292397fab8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:36.640478 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa9fcc-7e5c-41b2-af61-3292397fab8d admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:36.641383 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa9fcc-7e5c-41b2-af61-3292397fab8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:36.641898 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa9fcc-7e5c-41b2-af61-3292397fab8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:36.643161 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa9fcc-7e5c-41b2-af61-3292397fab8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:36.646007 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa9fcc-7e5c-41b2-af61-3292397fab8d admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:36.662681 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 926/1878] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:11:36.667096 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa9fcc-7e5c-41b2-af61-3292397fab8d admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:36.680955 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa9fcc-7e5c-41b2-af61-3292397fab8d admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:36.689022 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8167086-3cd3-4501-99e4-644076e948e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:36.690081 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8167086-3cd3-4501-99e4-644076e948e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:36.690698 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8167086-3cd3-4501-99e4-644076e948e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:36.691077 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8167086-3cd3-4501-99e4-644076e948e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:36.692967 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8167086-3cd3-4501-99e4-644076e948e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:36.695036 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8167086-3cd3-4501-99e4-644076e948e0 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:36.714666 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 927/1879] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:11:36.719634 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8167086-3cd3-4501-99e4-644076e948e0 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:36.733875 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d7cb2-1581-401b-83f7-e5f5c8d7f395 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:36.735779 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8167086-3cd3-4501-99e4-644076e948e0 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:36.744203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3ab5b-a7d9-42ff-a3cb-07d82e94a316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:36.745365 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3ab5b-a7d9-42ff-a3cb-07d82e94a316 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:36.745750 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3ab5b-a7d9-42ff-a3cb-07d82e94a316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:36.746125 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3ab5b-a7d9-42ff-a3cb-07d82e94a316 admin admin] PATH_INFO: `/v3/projects/97aa92b5f6d0462b908992bdd7f51d7e/users/26c441f4faf548bd8b31078fb66021c0/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:36.752746 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89cbaa-290e-487c-a059-69896d2ba691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:36.760994 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89cbaa-290e-487c-a059-69896d2ba691 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:36.761515 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89cbaa-290e-487c-a059-69896d2ba691 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:36.768341 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89cbaa-290e-487c-a059-69896d2ba691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:36.794881 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89cbaa-290e-487c-a059-69896d2ba691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:36.818908 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89cbaa-290e-487c-a059-69896d2ba691 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:36.819547 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3ab5b-a7d9-42ff-a3cb-07d82e94a316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97aa92b5f6d0462b908992bdd7f51d7e, user_id=26c441f4faf548bd8b31078fb66021c0, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:36.819696 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 953/1880] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:11:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:11:36.824626 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3ab5b-a7d9-42ff-a3cb-07d82e94a316 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:36.981429 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 928/1881] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:11:36 2022] PUT /identity/v3/projects/97aa92b5f6d0462b908992bdd7f51d7e/users/26c441f4faf548bd8b31078fb66021c0/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:36.996043 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a555d3-c33c-4a1a-a629-c5b823065585 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:36.996454 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a555d3-c33c-4a1a-a629-c5b823065585 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:36.997131 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a555d3-c33c-4a1a-a629-c5b823065585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:37.101588 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-47a555d3-c33c-4a1a-a629-c5b823065585 None None] MFA Rules not processed for user `26c441f4faf548bd8b31078fb66021c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:37.104818 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-47a555d3-c33c-4a1a-a629-c5b823065585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:37.304992 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 954/1882] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:11:37.305553 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3ab5b-a7d9-42ff-a3cb-07d82e94a316 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:37.490790 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3ab5b-a7d9-42ff-a3cb-07d82e94a316 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:37.501216 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78c191-8452-41b3-a4cb-ca6fc21f84a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:37.502374 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78c191-8452-41b3-a4cb-ca6fc21f84a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:37.502888 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78c191-8452-41b3-a4cb-ca6fc21f84a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:37.503595 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78c191-8452-41b3-a4cb-ca6fc21f84a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:37.506517 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc78c191-8452-41b3-a4cb-ca6fc21f84a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:37.510582 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc78c191-8452-41b3-a4cb-ca6fc21f84a8 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:37.533717 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:37.668567 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 929/1883] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:11:37 2022] POST /identity/v3/projects => generated 383 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:11:37.675817 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a555d3-c33c-4a1a-a629-c5b823065585 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:37.710125 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a555d3-c33c-4a1a-a629-c5b823065585 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:37.803909 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e344325-cf1f-48d1-b664-33e0f20fac0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:37.804607 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e344325-cf1f-48d1-b664-33e0f20fac0d admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:37.804889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e344325-cf1f-48d1-b664-33e0f20fac0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:37.805269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e344325-cf1f-48d1-b664-33e0f20fac0d admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:37.806246 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e344325-cf1f-48d1-b664-33e0f20fac0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:37.808500 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e344325-cf1f-48d1-b664-33e0f20fac0d admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:37.930707 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78c191-8452-41b3-a4cb-ca6fc21f84a8 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:37.933749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-dc78c191-8452-41b3-a4cb-ca6fc21f84a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:37.965842 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78c191-8452-41b3-a4cb-ca6fc21f84a8 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:37.980376 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796ad7e-021b-47ab-90ec-754c84a7445e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:37.982688 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796ad7e-021b-47ab-90ec-754c84a7445e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:37.983620 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796ad7e-021b-47ab-90ec-754c84a7445e admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:37.984251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796ad7e-021b-47ab-90ec-754c84a7445e admin admin] PATH_INFO: `/v3/projects/6aebbff5d44f4f1ab016e1ca9dbd669d` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:37.986679 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796ad7e-021b-47ab-90ec-754c84a7445e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aebbff5d44f4f1ab016e1ca9dbd669d)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:37.995797 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796ad7e-021b-47ab-90ec-754c84a7445e admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:38.001540 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 955/1884] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:11:37 2022] POST /identity/v3/users => generated 298 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:11:38.006401 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e344325-cf1f-48d1-b664-33e0f20fac0d admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:38.018940 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e344325-cf1f-48d1-b664-33e0f20fac0d admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:38.028945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9b321-7ff4-4bdd-aafa-a732f25f7088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:38.029636 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9b321-7ff4-4bdd-aafa-a732f25f7088 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:38.035204 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9b321-7ff4-4bdd-aafa-a732f25f7088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:38.035204 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9b321-7ff4-4bdd-aafa-a732f25f7088 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:38.035204 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb9b321-7ff4-4bdd-aafa-a732f25f7088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:38.035204 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb9b321-7ff4-4bdd-aafa-a732f25f7088 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:38.054738 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 956/1885] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:11:38.059392 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9b321-7ff4-4bdd-aafa-a732f25f7088 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:38.074785 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9b321-7ff4-4bdd-aafa-a732f25f7088 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:38.094753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46e19c-7f7c-4215-957a-4d665b452750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:38.103097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46e19c-7f7c-4215-957a-4d665b452750 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:38.103097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46e19c-7f7c-4215-957a-4d665b452750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:38.103097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46e19c-7f7c-4215-957a-4d665b452750 admin admin] PATH_INFO: `/v3/projects/ad17c3bdb2a64672ba943bd7e22cba67/users/c1799ad11374488ca4fdfb33545b90c2/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:38.123030 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46e19c-7f7c-4215-957a-4d665b452750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad17c3bdb2a64672ba943bd7e22cba67, user_id=c1799ad11374488ca4fdfb33545b90c2, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:38.126529 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46e19c-7f7c-4215-957a-4d665b452750 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:38.249828 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 957/1886] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:11:38 2022] PUT /identity/v3/projects/ad17c3bdb2a64672ba943bd7e22cba67/users/c1799ad11374488ca4fdfb33545b90c2/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:11:38.255733 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46e19c-7f7c-4215-957a-4d665b452750 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:38.265163 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5796ad7e-021b-47ab-90ec-754c84a7445e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aebbff5d44f4f1ab016e1ca9dbd669d', 'request_id': 'req-5796ad7e-021b-47ab-90ec-754c84a7445e'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:38.290340 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5796ad7e-021b-47ab-90ec-754c84a7445e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aebbff5d44f4f1ab016e1ca9dbd669d', 'request_id': 'req-5796ad7e-021b-47ab-90ec-754c84a7445e'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:38.298436 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5796ad7e-021b-47ab-90ec-754c84a7445e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aebbff5d44f4f1ab016e1ca9dbd669d', 'request_id': 'req-5796ad7e-021b-47ab-90ec-754c84a7445e'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:38.302423 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:38.365197 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46e19c-7f7c-4215-957a-4d665b452750 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:38.408621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5796ad7e-021b-47ab-90ec-754c84a7445e admin admin] The token cache is being invalidate because project 6aebbff5d44f4f1ab016e1ca9dbd669d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:11:38.409344 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5796ad7e-021b-47ab-90ec-754c84a7445e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:38.416319 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5796ad7e-021b-47ab-90ec-754c84a7445e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:38.416319 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 930/1887] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:11:37 2022] DELETE /identity/v3/projects/6aebbff5d44f4f1ab016e1ca9dbd669d => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:11:38.419689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796ad7e-021b-47ab-90ec-754c84a7445e admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:38.422035 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-5796ad7e-021b-47ab-90ec-754c84a7445e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:38.517967 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97085eb8-7935-4dd1-9a32-fedb12af855e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:38.519396 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97085eb8-7935-4dd1-9a32-fedb12af855e admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:38.521143 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97085eb8-7935-4dd1-9a32-fedb12af855e admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:38.521143 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97085eb8-7935-4dd1-9a32-fedb12af855e admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:38.521686 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97085eb8-7935-4dd1-9a32-fedb12af855e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:38.527608 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97085eb8-7935-4dd1-9a32-fedb12af855e admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:38.559303 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 958/1888] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:11:38.567468 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97085eb8-7935-4dd1-9a32-fedb12af855e admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:38.569219 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796ad7e-021b-47ab-90ec-754c84a7445e admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:38.571498 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-97085eb8-7935-4dd1-9a32-fedb12af855e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:38.576038 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4525eb-9843-4381-9bb9-2890ce4ddb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:38.588268 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4525eb-9843-4381-9bb9-2890ce4ddb58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:38.592238 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4525eb-9843-4381-9bb9-2890ce4ddb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:38.592238 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4525eb-9843-4381-9bb9-2890ce4ddb58 admin admin] PATH_INFO: `/v3/users/7c49c642e5294ca2944d9ffbd36a015b` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:38.592915 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97085eb8-7935-4dd1-9a32-fedb12af855e admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:38.595451 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4525eb-9843-4381-9bb9-2890ce4ddb58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c49c642e5294ca2944d9ffbd36a015b)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:38.601208 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0ca06-6764-400c-b59c-5f7a1c3c28b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:38.601921 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0ca06-6764-400c-b59c-5f7a1c3c28b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:38.602206 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0ca06-6764-400c-b59c-5f7a1c3c28b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:38.602484 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0ca06-6764-400c-b59c-5f7a1c3c28b1 admin admin] PATH_INFO: `/v3/projects/ad17c3bdb2a64672ba943bd7e22cba67/users/c1799ad11374488ca4fdfb33545b90c2/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:38.602695 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4525eb-9843-4381-9bb9-2890ce4ddb58 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:38.606622 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0ca06-6764-400c-b59c-5f7a1c3c28b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad17c3bdb2a64672ba943bd7e22cba67, user_id=c1799ad11374488ca4fdfb33545b90c2, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:38.610319 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0ca06-6764-400c-b59c-5f7a1c3c28b1 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:38.628471 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 959/1889] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:11:38 2022] PUT /identity/v3/projects/ad17c3bdb2a64672ba943bd7e22cba67/users/c1799ad11374488ca4fdfb33545b90c2/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:11:38.642159 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efe952-a8f1-43dd-8337-674c8a161084 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:38.642159 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efe952-a8f1-43dd-8337-674c8a161084 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:38.642742 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efe952-a8f1-43dd-8337-674c8a161084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:38.687551 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-39efe952-a8f1-43dd-8337-674c8a161084 None None] MFA Rules not processed for user `c1799ad11374488ca4fdfb33545b90c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:38.688975 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-39efe952-a8f1-43dd-8337-674c8a161084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:38.830430 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 960/1890] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:11:38.853733 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39efe952-a8f1-43dd-8337-674c8a161084 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:38.856729 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-39efe952-a8f1-43dd-8337-674c8a161084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:38.895473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-cb4525eb-9843-4381-9bb9-2890ce4ddb58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c49c642e5294ca2944d9ffbd36a015b'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:38.911851 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-cb4525eb-9843-4381-9bb9-2890ce4ddb58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c49c642e5294ca2944d9ffbd36a015b'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:38.912937 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-cb4525eb-9843-4381-9bb9-2890ce4ddb58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c49c642e5294ca2944d9ffbd36a015b'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:38.941169 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:38.990220 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39efe952-a8f1-43dd-8337-674c8a161084 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:38.995639 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-cb4525eb-9843-4381-9bb9-2890ce4ddb58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c49c642e5294ca2944d9ffbd36a015b'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:38.999519 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0a930-f945-48b2-af00-d528875b2a69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:39.000807 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0a930-f945-48b2-af00-d528875b2a69 service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:39.001332 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0a930-f945-48b2-af00-d528875b2a69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:39.001840 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0a930-f945-48b2-af00-d528875b2a69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:39.005518 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-7dd0a930-f945-48b2-af00-d528875b2a69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:39.009534 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=81,keystone:INSERT=3,keystone:DELETE=16 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:39.017418 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-cb4525eb-9843-4381-9bb9-2890ce4ddb58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c49c642e5294ca2944d9ffbd36a015b'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:39.026030 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 931/1891] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:11:38 2022] DELETE /identity/v3/users/7c49c642e5294ca2944d9ffbd36a015b => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:39.034338 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0a930-f945-48b2-af00-d528875b2a69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:39.037677 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0a930-f945-48b2-af00-d528875b2a69 service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:39.050335 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 961/1892] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:11:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:11:39.232256 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4525eb-9843-4381-9bb9-2890ce4ddb58 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:39.234644 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-cb4525eb-9843-4381-9bb9-2890ce4ddb58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:39.372734 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4525eb-9843-4381-9bb9-2890ce4ddb58 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:39.387657 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa50ab-e9fe-4e17-a348-78cfe36b2028 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:39.390832 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa50ab-e9fe-4e17-a348-78cfe36b2028 service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:39.393320 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa50ab-e9fe-4e17-a348-78cfe36b2028 service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:39.403693 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa50ab-e9fe-4e17-a348-78cfe36b2028 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:39.404446 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-defa50ab-e9fe-4e17-a348-78cfe36b2028 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:39.543454 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa50ab-e9fe-4e17-a348-78cfe36b2028 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:39.550459 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa50ab-e9fe-4e17-a348-78cfe36b2028 service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:39.572322 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 932/1893] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:11:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:11:39.760942 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0a930-f945-48b2-af00-d528875b2a69 service cinder] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:39.763219 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-7dd0a930-f945-48b2-af00-d528875b2a69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:39.874901 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0a930-f945-48b2-af00-d528875b2a69 service cinder] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:39.962090 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d19215-b9c5-414f-8494-d5f96e3fd1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:39.962808 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d19215-b9c5-414f-8494-d5f96e3fd1c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:39.963211 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d19215-b9c5-414f-8494-d5f96e3fd1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:39.963501 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d19215-b9c5-414f-8494-d5f96e3fd1c3 admin admin] PATH_INFO: `/v3/projects/908db5b092354c188989905463a2c592` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:39.966232 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d19215-b9c5-414f-8494-d5f96e3fd1c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=908db5b092354c188989905463a2c592)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:39.968438 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d19215-b9c5-414f-8494-d5f96e3fd1c3 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:40.205469 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-74d19215-b9c5-414f-8494-d5f96e3fd1c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '908db5b092354c188989905463a2c592', 'request_id': 'req-74d19215-b9c5-414f-8494-d5f96e3fd1c3'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:40.292537 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-74d19215-b9c5-414f-8494-d5f96e3fd1c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '908db5b092354c188989905463a2c592', 'request_id': 'req-74d19215-b9c5-414f-8494-d5f96e3fd1c3'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:40.300305 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-74d19215-b9c5-414f-8494-d5f96e3fd1c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '908db5b092354c188989905463a2c592', 'request_id': 'req-74d19215-b9c5-414f-8494-d5f96e3fd1c3'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:40.318927 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-74d19215-b9c5-414f-8494-d5f96e3fd1c3 admin admin] The token cache is being invalidate because project 908db5b092354c188989905463a2c592 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:11:40.319444 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-74d19215-b9c5-414f-8494-d5f96e3fd1c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:40.320789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-74d19215-b9c5-414f-8494-d5f96e3fd1c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:40.323585 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 962/1894] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:11:39 2022] DELETE /identity/v3/projects/908db5b092354c188989905463a2c592 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:40.331164 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82665db-f399-44f4-9f6e-be69cfc6043b None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:40.334574 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82665db-f399-44f4-9f6e-be69cfc6043b None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:40.334574 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82665db-f399-44f4-9f6e-be69cfc6043b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:40.367421 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-f82665db-f399-44f4-9f6e-be69cfc6043b None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:40.369666 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-f82665db-f399-44f4-9f6e-be69cfc6043b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:40.466162 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 933/1895] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:11:40.475772 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ac0bc-be5a-4875-96c7-1aad6bf62e26 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:40.476051 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ac0bc-be5a-4875-96c7-1aad6bf62e26 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:40.476412 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ac0bc-be5a-4875-96c7-1aad6bf62e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:40.505535 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-d83ac0bc-be5a-4875-96c7-1aad6bf62e26 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:40.507654 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-d83ac0bc-be5a-4875-96c7-1aad6bf62e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:40.519573 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 963/1896] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:11:40.529121 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82665db-f399-44f4-9f6e-be69cfc6043b None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:40.549645 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82665db-f399-44f4-9f6e-be69cfc6043b None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:40.555515 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a97b8-df3e-430d-9c95-47e6dd3fae5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:40.556264 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a97b8-df3e-430d-9c95-47e6dd3fae5c admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:40.556558 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a97b8-df3e-430d-9c95-47e6dd3fae5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:40.557754 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a97b8-df3e-430d-9c95-47e6dd3fae5c admin admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:40.558742 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a97b8-df3e-430d-9c95-47e6dd3fae5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:11:40.559006 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a97b8-df3e-430d-9c95-47e6dd3fae5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:40.567234 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a97b8-df3e-430d-9c95-47e6dd3fae5c admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:40.590609 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 934/1897] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:11:40.596105 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ac0bc-be5a-4875-96c7-1aad6bf62e26 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:40.614726 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ac0bc-be5a-4875-96c7-1aad6bf62e26 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:40.623329 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b6b4b-1767-42de-8183-6c850811ea82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:40.637934 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b6b4b-1767-42de-8183-6c850811ea82 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:40.637934 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b6b4b-1767-42de-8183-6c850811ea82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:40.637934 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b6b4b-1767-42de-8183-6c850811ea82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:40.637934 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b6b4b-1767-42de-8183-6c850811ea82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:40.637934 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b6b4b-1767-42de-8183-6c850811ea82 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:40.642110 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:40.869173 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 964/1898] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:11:40 2022] POST /identity/v3/projects => generated 381 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:11:40.871303 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a97b8-df3e-430d-9c95-47e6dd3fae5c admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:40.905991 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a97b8-df3e-430d-9c95-47e6dd3fae5c admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:41.002515 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:41.002515 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8df6b-3de6-4a39-9d06-e0f2e0492480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:41.002515 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8df6b-3de6-4a39-9d06-e0f2e0492480 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:41.002515 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8df6b-3de6-4a39-9d06-e0f2e0492480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:41.003633 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8df6b-3de6-4a39-9d06-e0f2e0492480 admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:41.003633 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8df6b-3de6-4a39-9d06-e0f2e0492480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:41.003633 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8df6b-3de6-4a39-9d06-e0f2e0492480 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:41.262532 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 935/1899] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:11:40 2022] POST /identity/v3/users => generated 291 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:11:41.269460 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b6b4b-1767-42de-8183-6c850811ea82 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:41.292005 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b6b4b-1767-42de-8183-6c850811ea82 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:41.299682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90445a-d0cc-4c51-83b4-7850affc6564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:41.300462 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90445a-d0cc-4c51-83b4-7850affc6564 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:41.300829 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90445a-d0cc-4c51-83b4-7850affc6564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:41.301983 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90445a-d0cc-4c51-83b4-7850affc6564 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:41.302644 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea90445a-d0cc-4c51-83b4-7850affc6564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:41.304790 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea90445a-d0cc-4c51-83b4-7850affc6564 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:41.318703 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 965/1900] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:11:41.323289 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8df6b-3de6-4a39-9d06-e0f2e0492480 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:41.333906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8df6b-3de6-4a39-9d06-e0f2e0492480 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:41.338862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb6549-6170-448c-bcf5-924eb4ac350f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:41.339503 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb6549-6170-448c-bcf5-924eb4ac350f admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:41.339851 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb6549-6170-448c-bcf5-924eb4ac350f admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:41.340059 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb6549-6170-448c-bcf5-924eb4ac350f admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:41.340811 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb6549-6170-448c-bcf5-924eb4ac350f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:41.342422 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb6549-6170-448c-bcf5-924eb4ac350f admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:41.354972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 936/1901] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:11:41.363654 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90445a-d0cc-4c51-83b4-7850affc6564 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:41.376919 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90445a-d0cc-4c51-83b4-7850affc6564 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:41.383022 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ec694-9a8e-4aad-b9d4-5a4512836995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:41.383961 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ec694-9a8e-4aad-b9d4-5a4512836995 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:41.384281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ec694-9a8e-4aad-b9d4-5a4512836995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:41.384568 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ec694-9a8e-4aad-b9d4-5a4512836995 admin admin] PATH_INFO: `/v3/projects/1129a5340ac945678e0473de910c5890/users/9907e4a4fc7840a8a10899e0f65a5f66/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:41.409253 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ec694-9a8e-4aad-b9d4-5a4512836995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1129a5340ac945678e0473de910c5890, user_id=9907e4a4fc7840a8a10899e0f65a5f66, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:41.412760 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ec694-9a8e-4aad-b9d4-5a4512836995 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:41.562555 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 966/1902] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:11:41 2022] PUT /identity/v3/projects/1129a5340ac945678e0473de910c5890/users/9907e4a4fc7840a8a10899e0f65a5f66/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:41.588106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7ecb4-baea-4cc8-9db2-2456fb75b367 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:41.588776 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7ecb4-baea-4cc8-9db2-2456fb75b367 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:41.589348 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7ecb4-baea-4cc8-9db2-2456fb75b367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:41.648944 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-e0f7ecb4-baea-4cc8-9db2-2456fb75b367 None None] MFA Rules not processed for user `9907e4a4fc7840a8a10899e0f65a5f66`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:41.651390 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-e0f7ecb4-baea-4cc8-9db2-2456fb75b367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:41.776873 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 937/1903] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:11:41.795382 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ec694-9a8e-4aad-b9d4-5a4512836995 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:41.882947 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ec694-9a8e-4aad-b9d4-5a4512836995 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:41.891870 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62e4e1-1988-4178-9fdb-2ca6ff0ba7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:41.892989 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62e4e1-1988-4178-9fdb-2ca6ff0ba7a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:41.893505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62e4e1-1988-4178-9fdb-2ca6ff0ba7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:41.894134 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62e4e1-1988-4178-9fdb-2ca6ff0ba7a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:41.895821 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d62e4e1-1988-4178-9fdb-2ca6ff0ba7a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:41.899014 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d62e4e1-1988-4178-9fdb-2ca6ff0ba7a2 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:42.053160 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 967/1904] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:11:41 2022] POST /identity/v3/projects => generated 379 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:11:42.057288 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f7ecb4-baea-4cc8-9db2-2456fb75b367 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:42.071477 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f7ecb4-baea-4cc8-9db2-2456fb75b367 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:42.169622 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62205710-8df4-48be-a0d6-ad9b4af35fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:42.176801 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62205710-8df4-48be-a0d6-ad9b4af35fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:42.176801 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62205710-8df4-48be-a0d6-ad9b4af35fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:42.176801 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62205710-8df4-48be-a0d6-ad9b4af35fe1 admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:42.177312 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62205710-8df4-48be-a0d6-ad9b4af35fe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:42.179768 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62205710-8df4-48be-a0d6-ad9b4af35fe1 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:42.323972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 938/1905] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:11:42 2022] POST /identity/v3/users => generated 296 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:11:42.328290 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62e4e1-1988-4178-9fdb-2ca6ff0ba7a2 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:42.341078 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62e4e1-1988-4178-9fdb-2ca6ff0ba7a2 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:42.346148 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387ae2f-7b34-44a2-840e-c77bd7880115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:42.346796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387ae2f-7b34-44a2-840e-c77bd7880115 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:42.347078 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387ae2f-7b34-44a2-840e-c77bd7880115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:42.347456 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387ae2f-7b34-44a2-840e-c77bd7880115 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:42.348793 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387ae2f-7b34-44a2-840e-c77bd7880115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:42.350497 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387ae2f-7b34-44a2-840e-c77bd7880115 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:42.364373 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 968/1906] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:11:42.390767 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62205710-8df4-48be-a0d6-ad9b4af35fe1 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:42.402055 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62205710-8df4-48be-a0d6-ad9b4af35fe1 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:42.408078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9501c4-d0da-45a5-a123-c1859cee2583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:42.408811 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9501c4-d0da-45a5-a123-c1859cee2583 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:42.409091 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9501c4-d0da-45a5-a123-c1859cee2583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:42.409369 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9501c4-d0da-45a5-a123-c1859cee2583 admin admin] PATH_INFO: `/v3/projects/ee8827db257d4f68a8b312ce23f80296/users/44ceda716f594f15af10a239f8704b95/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:42.431970 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9501c4-d0da-45a5-a123-c1859cee2583 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee8827db257d4f68a8b312ce23f80296, user_id=44ceda716f594f15af10a239f8704b95, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:42.434964 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9501c4-d0da-45a5-a123-c1859cee2583 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:42.551554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 939/1907] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:11:42 2022] PUT /identity/v3/projects/ee8827db257d4f68a8b312ce23f80296/users/44ceda716f594f15af10a239f8704b95/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:42.558441 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387ae2f-7b34-44a2-840e-c77bd7880115 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:42.582928 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387ae2f-7b34-44a2-840e-c77bd7880115 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:42.672510 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3139d47-6690-4d37-a2fa-53f0eed4f9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:42.673165 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3139d47-6690-4d37-a2fa-53f0eed4f9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:42.673594 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3139d47-6690-4d37-a2fa-53f0eed4f9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:42.673884 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3139d47-6690-4d37-a2fa-53f0eed4f9e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:42.674612 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3139d47-6690-4d37-a2fa-53f0eed4f9e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:42.677492 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3139d47-6690-4d37-a2fa-53f0eed4f9e5 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:42.691369 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 969/1908] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:11:42.698697 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9501c4-d0da-45a5-a123-c1859cee2583 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:42.714132 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9501c4-d0da-45a5-a123-c1859cee2583 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:42.719551 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8973f-99a6-4a66-8355-937ee34b804f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:42.719981 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8973f-99a6-4a66-8355-937ee34b804f admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:42.720396 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8973f-99a6-4a66-8355-937ee34b804f admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:42.720690 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8973f-99a6-4a66-8355-937ee34b804f admin admin] PATH_INFO: `/v3/projects/ee8827db257d4f68a8b312ce23f80296/users/44ceda716f594f15af10a239f8704b95/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:42.723126 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a8973f-99a6-4a66-8355-937ee34b804f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee8827db257d4f68a8b312ce23f80296, user_id=44ceda716f594f15af10a239f8704b95, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:42.725943 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a8973f-99a6-4a66-8355-937ee34b804f admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:42.728641 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:42.738268 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 940/1909] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:11:42 2022] PUT /identity/v3/projects/ee8827db257d4f68a8b312ce23f80296/users/44ceda716f594f15af10a239f8704b95/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:42.750057 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d7adf-ca9c-4311-bf56-60c4719773f1 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:42.750354 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d7adf-ca9c-4311-bf56-60c4719773f1 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:42.750644 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d7adf-ca9c-4311-bf56-60c4719773f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:42.791035 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-d85d7adf-ca9c-4311-bf56-60c4719773f1 None None] MFA Rules not processed for user `44ceda716f594f15af10a239f8704b95`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:42.792404 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-d85d7adf-ca9c-4311-bf56-60c4719773f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:42.802003 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:42.943254 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 970/1910] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:42 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:11:42.962767 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8973f-99a6-4a66-8355-937ee34b804f admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:42.964681 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-b4a8973f-99a6-4a66-8355-937ee34b804f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:43.042509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8973f-99a6-4a66-8355-937ee34b804f admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:43.049984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e3c92-cba8-414f-9e39-3c9580f5d44e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:43.055028 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e3c92-cba8-414f-9e39-3c9580f5d44e service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:43.055028 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e3c92-cba8-414f-9e39-3c9580f5d44e service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:43.055028 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e3c92-cba8-414f-9e39-3c9580f5d44e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:43.071386 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e3c92-cba8-414f-9e39-3c9580f5d44e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:43.073907 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e3c92-cba8-414f-9e39-3c9580f5d44e service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:43.090469 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 941/1911] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:11:42 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:11:43.476833 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d7adf-ca9c-4311-bf56-60c4719773f1 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:43.495498 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d7adf-ca9c-4311-bf56-60c4719773f1 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:43.501747 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb5402-7bee-48ab-b6bc-af05c578f4e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:43.502950 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb5402-7bee-48ab-b6bc-af05c578f4e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:43.503356 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb5402-7bee-48ab-b6bc-af05c578f4e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:43.503774 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb5402-7bee-48ab-b6bc-af05c578f4e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:43.581241 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb5402-7bee-48ab-b6bc-af05c578f4e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:43.584476 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb5402-7bee-48ab-b6bc-af05c578f4e6 service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:43.596328 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 971/1912] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:11:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:11:44.428864 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e3c92-cba8-414f-9e39-3c9580f5d44e service cinder] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:44.431155 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-693e3c92-cba8-414f-9e39-3c9580f5d44e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:44.533721 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e3c92-cba8-414f-9e39-3c9580f5d44e service cinder] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:44.542988 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceaa4ed-4482-4a94-b784-e689e5e3f1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:44.543779 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceaa4ed-4482-4a94-b784-e689e5e3f1c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:44.544268 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceaa4ed-4482-4a94-b784-e689e5e3f1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:44.544807 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceaa4ed-4482-4a94-b784-e689e5e3f1c7 admin admin] PATH_INFO: `/v3/users/26c441f4faf548bd8b31078fb66021c0` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:44.547167 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceaa4ed-4482-4a94-b784-e689e5e3f1c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26c441f4faf548bd8b31078fb66021c0)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:44.551759 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceaa4ed-4482-4a94-b784-e689e5e3f1c7 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:44.826041 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-cceaa4ed-4482-4a94-b784-e689e5e3f1c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26c441f4faf548bd8b31078fb66021c0'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:44.842623 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-cceaa4ed-4482-4a94-b784-e689e5e3f1c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26c441f4faf548bd8b31078fb66021c0'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:44.843719 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-cceaa4ed-4482-4a94-b784-e689e5e3f1c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26c441f4faf548bd8b31078fb66021c0'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:44.932984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-cceaa4ed-4482-4a94-b784-e689e5e3f1c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26c441f4faf548bd8b31078fb66021c0'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:44.960101 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-cceaa4ed-4482-4a94-b784-e689e5e3f1c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26c441f4faf548bd8b31078fb66021c0'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:44.972420 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 942/1913] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:11:44 2022] DELETE /identity/v3/users/26c441f4faf548bd8b31078fb66021c0 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:44.979147 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c9c99-4ce6-4165-b8a6-34ec257f215e None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:44.979784 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c9c99-4ce6-4165-b8a6-34ec257f215e None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:44.979784 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c9c99-4ce6-4165-b8a6-34ec257f215e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:45.007636 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-4b7c9c99-4ce6-4165-b8a6-34ec257f215e None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:45.009639 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-4b7c9c99-4ce6-4165-b8a6-34ec257f215e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:45.142110 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 972/1914] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:11:45.162089 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceaa4ed-4482-4a94-b784-e689e5e3f1c7 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:45.164797 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-cceaa4ed-4482-4a94-b784-e689e5e3f1c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:45.209818 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:45.368697 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceaa4ed-4482-4a94-b784-e689e5e3f1c7 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:45.376505 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e636f03-6334-46ff-a83d-d9118ad192e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:45.377377 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e636f03-6334-46ff-a83d-d9118ad192e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:45.377777 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e636f03-6334-46ff-a83d-d9118ad192e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:45.378331 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e636f03-6334-46ff-a83d-d9118ad192e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:45.397489 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e636f03-6334-46ff-a83d-d9118ad192e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:45.399509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e636f03-6334-46ff-a83d-d9118ad192e6 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:45.423487 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 943/1915] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:11:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:11:46.518998 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c9c99-4ce6-4165-b8a6-34ec257f215e None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:46.553505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-4b7c9c99-4ce6-4165-b8a6-34ec257f215e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:46.578178 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c9c99-4ce6-4165-b8a6-34ec257f215e None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:46.601845 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c07d14-0d23-4135-a710-5e3d9551addf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:46.602533 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c07d14-0d23-4135-a710-5e3d9551addf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:46.608227 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c07d14-0d23-4135-a710-5e3d9551addf admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:46.608227 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c07d14-0d23-4135-a710-5e3d9551addf admin admin] PATH_INFO: `/v3/projects/97aa92b5f6d0462b908992bdd7f51d7e` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:46.615219 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c07d14-0d23-4135-a710-5e3d9551addf admin admin] RBAC: Authorizing `identity:delete_project(project_id=97aa92b5f6d0462b908992bdd7f51d7e)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:46.621749 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c07d14-0d23-4135-a710-5e3d9551addf admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:46.892272 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:46.912351 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-18c07d14-0d23-4135-a710-5e3d9551addf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97aa92b5f6d0462b908992bdd7f51d7e', 'request_id': 'req-18c07d14-0d23-4135-a710-5e3d9551addf'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:47.040129 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-18c07d14-0d23-4135-a710-5e3d9551addf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97aa92b5f6d0462b908992bdd7f51d7e', 'request_id': 'req-18c07d14-0d23-4135-a710-5e3d9551addf'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:47.075647 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-18c07d14-0d23-4135-a710-5e3d9551addf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97aa92b5f6d0462b908992bdd7f51d7e', 'request_id': 'req-18c07d14-0d23-4135-a710-5e3d9551addf'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:47.099143 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-18c07d14-0d23-4135-a710-5e3d9551addf admin admin] The token cache is being invalidate because project 97aa92b5f6d0462b908992bdd7f51d7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:11:47.100077 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-18c07d14-0d23-4135-a710-5e3d9551addf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:47.101123 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-18c07d14-0d23-4135-a710-5e3d9551addf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:47.105128 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 973/1916] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:11:46 2022] DELETE /identity/v3/projects/97aa92b5f6d0462b908992bdd7f51d7e => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:47.112646 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e636f03-6334-46ff-a83d-d9118ad192e6 service neutron] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:47.132195 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e636f03-6334-46ff-a83d-d9118ad192e6 service neutron] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:47.232094 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c7b24-53f3-4826-bb38-439e48c62c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:47.233795 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c7b24-53f3-4826-bb38-439e48c62c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:47.234362 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c7b24-53f3-4826-bb38-439e48c62c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:47.235286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c7b24-53f3-4826-bb38-439e48c62c60 admin admin] PATH_INFO: `/v3/users/c1799ad11374488ca4fdfb33545b90c2` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:47.238298 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c7b24-53f3-4826-bb38-439e48c62c60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1799ad11374488ca4fdfb33545b90c2)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:47.245280 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c7b24-53f3-4826-bb38-439e48c62c60 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:47.527024 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-0d1c7b24-53f3-4826-bb38-439e48c62c60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1799ad11374488ca4fdfb33545b90c2'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:47.542698 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-0d1c7b24-53f3-4826-bb38-439e48c62c60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1799ad11374488ca4fdfb33545b90c2'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:47.543895 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-0d1c7b24-53f3-4826-bb38-439e48c62c60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1799ad11374488ca4fdfb33545b90c2'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:47.658789 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-0d1c7b24-53f3-4826-bb38-439e48c62c60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1799ad11374488ca4fdfb33545b90c2'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:47.686627 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-0d1c7b24-53f3-4826-bb38-439e48c62c60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1799ad11374488ca4fdfb33545b90c2'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:47.709605 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 944/1917] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:11:47 2022] DELETE /identity/v3/users/c1799ad11374488ca4fdfb33545b90c2 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:48.331907 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c07d14-0d23-4135-a710-5e3d9551addf admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:48.335953 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-18c07d14-0d23-4135-a710-5e3d9551addf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:48.374051 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c07d14-0d23-4135-a710-5e3d9551addf admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:48.516756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad5fae-42ae-491b-a8a6-7278c856f009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:48.517541 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad5fae-42ae-491b-a8a6-7278c856f009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:48.517822 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad5fae-42ae-491b-a8a6-7278c856f009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:48.518100 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad5fae-42ae-491b-a8a6-7278c856f009 admin admin] PATH_INFO: `/v3/projects/ad17c3bdb2a64672ba943bd7e22cba67` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:48.519450 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad5fae-42ae-491b-a8a6-7278c856f009 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad17c3bdb2a64672ba943bd7e22cba67)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:48.522576 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad5fae-42ae-491b-a8a6-7278c856f009 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:48.761269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-92ad5fae-42ae-491b-a8a6-7278c856f009 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad17c3bdb2a64672ba943bd7e22cba67', 'request_id': 'req-92ad5fae-42ae-491b-a8a6-7278c856f009'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:48.865559 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-92ad5fae-42ae-491b-a8a6-7278c856f009 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad17c3bdb2a64672ba943bd7e22cba67', 'request_id': 'req-92ad5fae-42ae-491b-a8a6-7278c856f009'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:48.879797 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-92ad5fae-42ae-491b-a8a6-7278c856f009 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad17c3bdb2a64672ba943bd7e22cba67', 'request_id': 'req-92ad5fae-42ae-491b-a8a6-7278c856f009'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:48.931065 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-92ad5fae-42ae-491b-a8a6-7278c856f009 admin admin] The token cache is being invalidate because project ad17c3bdb2a64672ba943bd7e22cba67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:11:48.936891 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-92ad5fae-42ae-491b-a8a6-7278c856f009 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:48.936891 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-92ad5fae-42ae-491b-a8a6-7278c856f009 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:48.936891 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 974/1918] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:11:48 2022] DELETE /identity/v3/projects/ad17c3bdb2a64672ba943bd7e22cba67 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:11:48.947440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81057614-5eff-42dc-8e38-b7faaac92167 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:48.948288 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81057614-5eff-42dc-8e38-b7faaac92167 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:48.948763 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81057614-5eff-42dc-8e38-b7faaac92167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:48.990680 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-81057614-5eff-42dc-8e38-b7faaac92167 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:48.992683 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-81057614-5eff-42dc-8e38-b7faaac92167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:49.070766 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:49.107019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 945/1919] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:11:49.115405 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a78d3-0174-4fda-bb49-a9332fc34277 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:49.115733 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a78d3-0174-4fda-bb49-a9332fc34277 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:49.115955 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a78d3-0174-4fda-bb49-a9332fc34277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:49.153608 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-c89a78d3-0174-4fda-bb49-a9332fc34277 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:49.154928 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-c89a78d3-0174-4fda-bb49-a9332fc34277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:49.165945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 975/1920] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:11:49.171276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81057614-5eff-42dc-8e38-b7faaac92167 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:49.184455 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81057614-5eff-42dc-8e38-b7faaac92167 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:49.190190 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950d911-a157-4500-a25a-077c30e819f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:49.190849 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950d911-a157-4500-a25a-077c30e819f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:49.191125 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950d911-a157-4500-a25a-077c30e819f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:49.191397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950d911-a157-4500-a25a-077c30e819f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:49.193247 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950d911-a157-4500-a25a-077c30e819f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:11:49.193707 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950d911-a157-4500-a25a-077c30e819f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:49.196812 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950d911-a157-4500-a25a-077c30e819f5 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:49.212910 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 946/1921] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:11:49.218594 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a78d3-0174-4fda-bb49-a9332fc34277 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:49.229966 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a78d3-0174-4fda-bb49-a9332fc34277 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:49.235113 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f900ea6-55a4-49f5-a096-7216bab21e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:49.236470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f900ea6-55a4-49f5-a096-7216bab21e35 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:49.236753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f900ea6-55a4-49f5-a096-7216bab21e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:49.237019 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f900ea6-55a4-49f5-a096-7216bab21e35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:49.237803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f900ea6-55a4-49f5-a096-7216bab21e35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:49.240958 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f900ea6-55a4-49f5-a096-7216bab21e35 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:49.336933 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 976/1922] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:11:49 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:11:49.342646 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950d911-a157-4500-a25a-077c30e819f5 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:49.361143 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950d911-a157-4500-a25a-077c30e819f5 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:49.463244 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636a8e7-3a2e-417c-b76c-5a7d30185407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:49.463889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636a8e7-3a2e-417c-b76c-5a7d30185407 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:49.464292 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636a8e7-3a2e-417c-b76c-5a7d30185407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:49.464483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636a8e7-3a2e-417c-b76c-5a7d30185407 admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:49.465161 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636a8e7-3a2e-417c-b76c-5a7d30185407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:49.467107 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636a8e7-3a2e-417c-b76c-5a7d30185407 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:49.591567 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 947/1923] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:11:49 2022] POST /identity/v3/users => generated 289 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:11:49.600128 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f900ea6-55a4-49f5-a096-7216bab21e35 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:49.615483 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f900ea6-55a4-49f5-a096-7216bab21e35 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:49.620760 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110c2ca-b378-45f3-98ba-d93a011ad9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:49.621298 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110c2ca-b378-45f3-98ba-d93a011ad9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:49.621733 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110c2ca-b378-45f3-98ba-d93a011ad9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:49.621896 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110c2ca-b378-45f3-98ba-d93a011ad9d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:49.623383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110c2ca-b378-45f3-98ba-d93a011ad9d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:49.624351 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110c2ca-b378-45f3-98ba-d93a011ad9d1 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:49.636937 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 977/1924] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:11:49.641150 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636a8e7-3a2e-417c-b76c-5a7d30185407 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:49.653589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636a8e7-3a2e-417c-b76c-5a7d30185407 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:49.660591 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527d594-fc05-4d14-8968-084dc5bb86ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:49.661331 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527d594-fc05-4d14-8968-084dc5bb86ea admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:49.661777 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527d594-fc05-4d14-8968-084dc5bb86ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:49.662282 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527d594-fc05-4d14-8968-084dc5bb86ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:49.663649 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527d594-fc05-4d14-8968-084dc5bb86ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:49.667327 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527d594-fc05-4d14-8968-084dc5bb86ea admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:49.696155 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 948/1925] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:11:49.698657 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110c2ca-b378-45f3-98ba-d93a011ad9d1 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:49.723740 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110c2ca-b378-45f3-98ba-d93a011ad9d1 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:49.735235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ed816-e964-4044-9a8b-3f41f2424340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:49.738994 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ed816-e964-4044-9a8b-3f41f2424340 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:49.738994 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ed816-e964-4044-9a8b-3f41f2424340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:49.738994 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ed816-e964-4044-9a8b-3f41f2424340 admin admin] PATH_INFO: `/v3/projects/577b7f2411704e28aad4fca193ad9e35/users/536fff7426be49a9839124f628341c25/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:49.773253 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ed816-e964-4044-9a8b-3f41f2424340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=577b7f2411704e28aad4fca193ad9e35, user_id=536fff7426be49a9839124f628341c25, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:49.780491 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ed816-e964-4044-9a8b-3f41f2424340 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:49.783816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:49.854941 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 978/1926] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:11:49 2022] PUT /identity/v3/projects/577b7f2411704e28aad4fca193ad9e35/users/536fff7426be49a9839124f628341c25/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:49.875121 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303be7f-595d-4604-ad53-936b7a281763 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:49.875300 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303be7f-595d-4604-ad53-936b7a281763 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:49.875594 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303be7f-595d-4604-ad53-936b7a281763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:49.931486 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-8303be7f-595d-4604-ad53-936b7a281763 None None] MFA Rules not processed for user `536fff7426be49a9839124f628341c25`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:49.933849 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-8303be7f-595d-4604-ad53-936b7a281763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:50.112771 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 949/1927] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:11:50.120311 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ed816-e964-4044-9a8b-3f41f2424340 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:50.271184 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ed816-e964-4044-9a8b-3f41f2424340 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:50.276203 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeec563-9930-416d-a59d-b11c54ad49c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:50.277083 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeec563-9930-416d-a59d-b11c54ad49c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:50.277367 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeec563-9930-416d-a59d-b11c54ad49c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:50.277652 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeec563-9930-416d-a59d-b11c54ad49c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:50.278356 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeec563-9930-416d-a59d-b11c54ad49c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:50.280584 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeec563-9930-416d-a59d-b11c54ad49c2 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:50.397882 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 979/1928] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:11:50 2022] POST /identity/v3/projects => generated 377 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:11:50.403594 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303be7f-595d-4604-ad53-936b7a281763 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:50.425080 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303be7f-595d-4604-ad53-936b7a281763 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:50.472217 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:50.516554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a11a38-e710-4a28-a078-85fd672579b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:50.517333 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a11a38-e710-4a28-a078-85fd672579b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:50.518214 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a11a38-e710-4a28-a078-85fd672579b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:50.518214 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a11a38-e710-4a28-a078-85fd672579b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:50.519446 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a11a38-e710-4a28-a078-85fd672579b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:50.522818 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a11a38-e710-4a28-a078-85fd672579b2 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:50.639728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 950/1929] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:11:50 2022] POST /identity/v3/users => generated 289 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:11:50.645238 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeec563-9930-416d-a59d-b11c54ad49c2 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:50.668436 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeec563-9930-416d-a59d-b11c54ad49c2 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:50.678193 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba6d5d-ee7d-44b3-8960-f0434be62ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:50.679292 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba6d5d-ee7d-44b3-8960-f0434be62ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:50.679805 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba6d5d-ee7d-44b3-8960-f0434be62ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:50.680321 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba6d5d-ee7d-44b3-8960-f0434be62ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:50.682260 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba6d5d-ee7d-44b3-8960-f0434be62ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:50.685688 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba6d5d-ee7d-44b3-8960-f0434be62ef8 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:50.704117 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 980/1930] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:11:50.710478 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a11a38-e710-4a28-a078-85fd672579b2 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:50.721648 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a11a38-e710-4a28-a078-85fd672579b2 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:50.728068 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3a5ec-c716-4860-9763-b19ff4ccd80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:50.728867 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3a5ec-c716-4860-9763-b19ff4ccd80a admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:50.729124 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3a5ec-c716-4860-9763-b19ff4ccd80a admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:50.729484 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3a5ec-c716-4860-9763-b19ff4ccd80a admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:50.730312 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b3a5ec-c716-4860-9763-b19ff4ccd80a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:50.731999 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b3a5ec-c716-4860-9763-b19ff4ccd80a admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:50.744746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 951/1931] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:11:50.749257 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a46ee-90b4-4e64-b927-235467b7f365 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:50.754151 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a46ee-90b4-4e64-b927-235467b7f365 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:50.754151 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a46ee-90b4-4e64-b927-235467b7f365 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:50.754401 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3a5ec-c716-4860-9763-b19ff4ccd80a admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:50.754493 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 981/1932] 10.222.0.20 () {54 vars in 921 bytes} [Tue Aug 2 09:11:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:11:50.762330 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272daaca-4be8-47d7-93d6-5b999b2bed88 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:50.762605 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272daaca-4be8-47d7-93d6-5b999b2bed88 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:50.762887 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272daaca-4be8-47d7-93d6-5b999b2bed88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:50.766965 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3a5ec-c716-4860-9763-b19ff4ccd80a admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:50.776550 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a484df-ab6d-402f-906f-58b5feaf5691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:50.777831 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a484df-ab6d-402f-906f-58b5feaf5691 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:50.778455 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a484df-ab6d-402f-906f-58b5feaf5691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:50.779187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a484df-ab6d-402f-906f-58b5feaf5691 admin admin] PATH_INFO: `/v3/projects/d7e58b69049247e59c8a60464bd74101/users/08739057613642f99402db90356e0b8d/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:50.786282 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-272daaca-4be8-47d7-93d6-5b999b2bed88 None None] MFA Rules not processed for user `aa8cac76aa21415d8ab0a2524a7049d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:50.788108 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-272daaca-4be8-47d7-93d6-5b999b2bed88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:50.813388 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a484df-ab6d-402f-906f-58b5feaf5691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7e58b69049247e59c8a60464bd74101, user_id=08739057613642f99402db90356e0b8d, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:50.819686 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a484df-ab6d-402f-906f-58b5feaf5691 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:50.872603 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 982/1933] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Aug 2 09:11:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:11:50.894205 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272daaca-4be8-47d7-93d6-5b999b2bed88 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:50.897821 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-272daaca-4be8-47d7-93d6-5b999b2bed88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:50.923338 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272daaca-4be8-47d7-93d6-5b999b2bed88 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:50.932592 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ec233-aacf-4180-a477-7b1d22d100d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cac76aa21415d8ab0a2524a7049d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:50.933537 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ec233-aacf-4180-a477-7b1d22d100d9 service placement] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:50.933953 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ec233-aacf-4180-a477-7b1d22d100d9 service placement] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:50.934359 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ec233-aacf-4180-a477-7b1d22d100d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:50.949736 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ec233-aacf-4180-a477-7b1d22d100d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:50.951595 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ec233-aacf-4180-a477-7b1d22d100d9 service placement] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:50.953570 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 952/1934] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:11:50 2022] PUT /identity/v3/projects/d7e58b69049247e59c8a60464bd74101/users/08739057613642f99402db90356e0b8d/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:50.964925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 983/1935] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:11:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:11:50.966255 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bd2f0-017f-48c6-8721-b5dfb003bcab None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:50.966548 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bd2f0-017f-48c6-8721-b5dfb003bcab None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:50.966836 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bd2f0-017f-48c6-8721-b5dfb003bcab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:51.002872 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-a40bd2f0-017f-48c6-8721-b5dfb003bcab None None] MFA Rules not processed for user `08739057613642f99402db90356e0b8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:51.004220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-a40bd2f0-017f-48c6-8721-b5dfb003bcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:51.117124 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 953/1936] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:11:51.121892 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ec233-aacf-4180-a477-7b1d22d100d9 service placement] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:51.133902 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ec233-aacf-4180-a477-7b1d22d100d9 service placement] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:51.200811 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:51.219333 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71d299-e2c0-4622-bcf9-e380a9263ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:51.220202 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71d299-e2c0-4622-bcf9-e380a9263ede admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:51.220642 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71d299-e2c0-4622-bcf9-e380a9263ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:51.221051 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71d299-e2c0-4622-bcf9-e380a9263ede admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:51.222264 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71d299-e2c0-4622-bcf9-e380a9263ede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:51.225441 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71d299-e2c0-4622-bcf9-e380a9263ede admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:51.364012 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 984/1937] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:11:51 2022] POST /identity/v3/projects => generated 375 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:11:51.369172 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bd2f0-017f-48c6-8721-b5dfb003bcab None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:51.382407 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bd2f0-017f-48c6-8721-b5dfb003bcab None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:51.472040 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44c93b-0130-485d-bb57-0d20cc6dbbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:51.472767 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44c93b-0130-485d-bb57-0d20cc6dbbe1 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:51.473604 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44c93b-0130-485d-bb57-0d20cc6dbbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:51.473955 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44c93b-0130-485d-bb57-0d20cc6dbbe1 admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:51.474690 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44c93b-0130-485d-bb57-0d20cc6dbbe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:51.477059 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44c93b-0130-485d-bb57-0d20cc6dbbe1 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:51.563010 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 954/1938] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:11:51 2022] POST /identity/v3/users => generated 294 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:11:51.567532 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71d299-e2c0-4622-bcf9-e380a9263ede admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:51.591650 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71d299-e2c0-4622-bcf9-e380a9263ede admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:51.591650 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3246f-8fed-446f-940c-6e705d4c24c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:51.591650 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3246f-8fed-446f-940c-6e705d4c24c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:51.591650 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3246f-8fed-446f-940c-6e705d4c24c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:51.592278 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3246f-8fed-446f-940c-6e705d4c24c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:51.592278 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3246f-8fed-446f-940c-6e705d4c24c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:51.592278 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3246f-8fed-446f-940c-6e705d4c24c5 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:51.603482 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 985/1939] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:11:51.608745 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44c93b-0130-485d-bb57-0d20cc6dbbe1 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:51.628281 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44c93b-0130-485d-bb57-0d20cc6dbbe1 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:51.638377 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e49d47-e161-4237-a5c2-b092eeea4d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:51.639579 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e49d47-e161-4237-a5c2-b092eeea4d09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:51.640086 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e49d47-e161-4237-a5c2-b092eeea4d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:51.640657 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e49d47-e161-4237-a5c2-b092eeea4d09 admin admin] PATH_INFO: `/v3/projects/75a2070e18524382b0f0283018973eaf/users/b4d3193f2790432baea30a812617e482/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:51.646043 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:51.672700 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e49d47-e161-4237-a5c2-b092eeea4d09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75a2070e18524382b0f0283018973eaf, user_id=b4d3193f2790432baea30a812617e482, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:51.678799 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e49d47-e161-4237-a5c2-b092eeea4d09 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:51.697885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb1de2-4942-4bff-a1a4-bd40d40b2182 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:51.698461 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb1de2-4942-4bff-a1a4-bd40d40b2182 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:51.698835 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb1de2-4942-4bff-a1a4-bd40d40b2182 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:51.700984 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 986/1940] 10.222.0.20 () {54 vars in 921 bytes} [Tue Aug 2 09:11:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:11:51.743509 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc37164-4958-4d98-a4be-9a74f6186530 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:51.743908 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc37164-4958-4d98-a4be-9a74f6186530 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:51.744315 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc37164-4958-4d98-a4be-9a74f6186530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:51.769216 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-8dc37164-4958-4d98-a4be-9a74f6186530 None None] MFA Rules not processed for user `aa8cac76aa21415d8ab0a2524a7049d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:51.774771 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-8dc37164-4958-4d98-a4be-9a74f6186530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:51.846829 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 987/1941] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Aug 2 09:11:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:11:51.858509 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc37164-4958-4d98-a4be-9a74f6186530 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:51.870331 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc37164-4958-4d98-a4be-9a74f6186530 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:51.876937 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0605ba8-e92f-4392-871d-a6583ec8d987 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cac76aa21415d8ab0a2524a7049d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:51.877964 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0605ba8-e92f-4392-871d-a6583ec8d987 service placement] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:51.878371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0605ba8-e92f-4392-871d-a6583ec8d987 service placement] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:51.878703 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0605ba8-e92f-4392-871d-a6583ec8d987 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:51.888998 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0605ba8-e92f-4392-871d-a6583ec8d987 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:51.890634 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0605ba8-e92f-4392-871d-a6583ec8d987 service placement] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:51.903152 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 988/1942] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:11:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:11:51.946906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 955/1943] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:11:51 2022] PUT /identity/v3/projects/75a2070e18524382b0f0283018973eaf/users/b4d3193f2790432baea30a812617e482/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:51.954861 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0605ba8-e92f-4392-871d-a6583ec8d987 service placement] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:51.968209 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0605ba8-e92f-4392-871d-a6583ec8d987 service placement] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:52.009009 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e49d47-e161-4237-a5c2-b092eeea4d09 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:52.013257 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-27e49d47-e161-4237-a5c2-b092eeea4d09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:52.068141 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4572c4e-b676-4949-8db1-7c9c801340f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:52.069274 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4572c4e-b676-4949-8db1-7c9c801340f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:52.069658 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4572c4e-b676-4949-8db1-7c9c801340f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:52.070039 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4572c4e-b676-4949-8db1-7c9c801340f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:52.071620 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4572c4e-b676-4949-8db1-7c9c801340f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:52.073134 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4572c4e-b676-4949-8db1-7c9c801340f0 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:52.087730 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 989/1944] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:11:52.092626 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4572c4e-b676-4949-8db1-7c9c801340f0 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:52.105084 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4572c4e-b676-4949-8db1-7c9c801340f0 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:52.110663 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98afd09-732a-4eae-8bb6-8e71c94462fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:52.111524 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98afd09-732a-4eae-8bb6-8e71c94462fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:52.111890 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98afd09-732a-4eae-8bb6-8e71c94462fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:52.112310 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98afd09-732a-4eae-8bb6-8e71c94462fa admin admin] PATH_INFO: `/v3/projects/75a2070e18524382b0f0283018973eaf/users/b4d3193f2790432baea30a812617e482/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:52.116424 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98afd09-732a-4eae-8bb6-8e71c94462fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=75a2070e18524382b0f0283018973eaf, user_id=b4d3193f2790432baea30a812617e482, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:52.121328 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98afd09-732a-4eae-8bb6-8e71c94462fa admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:52.122961 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e49d47-e161-4237-a5c2-b092eeea4d09 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:52.128582 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656d172-89fc-4cb6-a6ce-2b3d61eacac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:52.130111 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656d172-89fc-4cb6-a6ce-2b3d61eacac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:52.130541 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656d172-89fc-4cb6-a6ce-2b3d61eacac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:52.130706 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656d172-89fc-4cb6-a6ce-2b3d61eacac6 admin admin] PATH_INFO: `/v3/users/c10ab81a47204dc4a09ac62e4989e978` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:52.131939 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656d172-89fc-4cb6-a6ce-2b3d61eacac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c10ab81a47204dc4a09ac62e4989e978)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:52.133992 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656d172-89fc-4cb6-a6ce-2b3d61eacac6 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:52.141676 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 990/1945] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:11:52 2022] PUT /identity/v3/projects/75a2070e18524382b0f0283018973eaf/users/b4d3193f2790432baea30a812617e482/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:52.153470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3fae48-d161-4755-a313-ffe4f7f4fc59 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:52.153859 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3fae48-d161-4755-a313-ffe4f7f4fc59 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:52.154216 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3fae48-d161-4755-a313-ffe4f7f4fc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:52.189143 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-ad3fae48-d161-4755-a313-ffe4f7f4fc59 None None] MFA Rules not processed for user `b4d3193f2790432baea30a812617e482`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:52.190477 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-ad3fae48-d161-4755-a313-ffe4f7f4fc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:52.215177 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:52.312621 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 991/1946] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:11:52.327381 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3fae48-d161-4755-a313-ffe4f7f4fc59 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:52.329758 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-ad3fae48-d161-4755-a313-ffe4f7f4fc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:52.433057 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4656d172-89fc-4cb6-a6ce-2b3d61eacac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c10ab81a47204dc4a09ac62e4989e978'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:52.446311 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4656d172-89fc-4cb6-a6ce-2b3d61eacac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c10ab81a47204dc4a09ac62e4989e978'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:52.448360 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4656d172-89fc-4cb6-a6ce-2b3d61eacac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c10ab81a47204dc4a09ac62e4989e978'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:52.455235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3fae48-d161-4755-a313-ffe4f7f4fc59 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:52.462726 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47ef1f-0595-422a-838d-025906457731 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:52.463846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47ef1f-0595-422a-838d-025906457731 service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:52.464865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47ef1f-0595-422a-838d-025906457731 service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:52.465387 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47ef1f-0595-422a-838d-025906457731 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:52.469252 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-da47ef1f-0595-422a-838d-025906457731 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:52.543418 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4656d172-89fc-4cb6-a6ce-2b3d61eacac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c10ab81a47204dc4a09ac62e4989e978'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:52.553607 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47ef1f-0595-422a-838d-025906457731 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:52.555285 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47ef1f-0595-422a-838d-025906457731 service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:52.564904 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4656d172-89fc-4cb6-a6ce-2b3d61eacac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c10ab81a47204dc4a09ac62e4989e978'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:52.571015 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 992/1947] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:11:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:11:52.577018 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 956/1948] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:11:52 2022] DELETE /identity/v3/users/c10ab81a47204dc4a09ac62e4989e978 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:52.937322 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47ef1f-0595-422a-838d-025906457731 service cinder] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:52.940149 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-da47ef1f-0595-422a-838d-025906457731 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:53.090329 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47ef1f-0595-422a-838d-025906457731 service cinder] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:53.116030 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:53.220569 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5c72d-85c0-449a-a0ec-4d5e502d3424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:53.221794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5c72d-85c0-449a-a0ec-4d5e502d3424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:53.222269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5c72d-85c0-449a-a0ec-4d5e502d3424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:53.223025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5c72d-85c0-449a-a0ec-4d5e502d3424 admin admin] PATH_INFO: `/v3/projects/5c4996c2e1f948eba6f54698eb8eb988` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:53.225122 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5c72d-85c0-449a-a0ec-4d5e502d3424 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c4996c2e1f948eba6f54698eb8eb988)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:53.230240 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5c72d-85c0-449a-a0ec-4d5e502d3424 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:53.513913 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-82a5c72d-85c0-449a-a0ec-4d5e502d3424 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c4996c2e1f948eba6f54698eb8eb988', 'request_id': 'req-82a5c72d-85c0-449a-a0ec-4d5e502d3424'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:53.609420 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-82a5c72d-85c0-449a-a0ec-4d5e502d3424 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c4996c2e1f948eba6f54698eb8eb988', 'request_id': 'req-82a5c72d-85c0-449a-a0ec-4d5e502d3424'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:53.633422 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-82a5c72d-85c0-449a-a0ec-4d5e502d3424 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c4996c2e1f948eba6f54698eb8eb988', 'request_id': 'req-82a5c72d-85c0-449a-a0ec-4d5e502d3424'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:53.652996 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-82a5c72d-85c0-449a-a0ec-4d5e502d3424 admin admin] The token cache is being invalidate because project 5c4996c2e1f948eba6f54698eb8eb988 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:11:53.653255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-82a5c72d-85c0-449a-a0ec-4d5e502d3424 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:53.654076 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-82a5c72d-85c0-449a-a0ec-4d5e502d3424 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:53.656807 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 993/1949] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:11:52 2022] DELETE /identity/v3/projects/5c4996c2e1f948eba6f54698eb8eb988 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:53.661399 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656d172-89fc-4cb6-a6ce-2b3d61eacac6 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:53.676609 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656d172-89fc-4cb6-a6ce-2b3d61eacac6 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:53.852411 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125903bb-cc52-4540-886c-9f30eaa1743b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:53.853321 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125903bb-cc52-4540-886c-9f30eaa1743b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:53.853695 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125903bb-cc52-4540-886c-9f30eaa1743b admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:53.854062 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125903bb-cc52-4540-886c-9f30eaa1743b admin admin] PATH_INFO: `/v3/users/9c6c6660ed3841768652beee041d1dbd` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:53.855983 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125903bb-cc52-4540-886c-9f30eaa1743b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c6c6660ed3841768652beee041d1dbd)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:53.858365 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125903bb-cc52-4540-886c-9f30eaa1743b admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:53.862019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:54.107122 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-125903bb-cc52-4540-886c-9f30eaa1743b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c6c6660ed3841768652beee041d1dbd'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:54.120710 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-125903bb-cc52-4540-886c-9f30eaa1743b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c6c6660ed3841768652beee041d1dbd'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:54.121657 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-125903bb-cc52-4540-886c-9f30eaa1743b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c6c6660ed3841768652beee041d1dbd'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:54.211897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-125903bb-cc52-4540-886c-9f30eaa1743b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c6c6660ed3841768652beee041d1dbd'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:54.227338 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-125903bb-cc52-4540-886c-9f30eaa1743b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c6c6660ed3841768652beee041d1dbd'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:54.237242 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 957/1950] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:11:53 2022] DELETE /identity/v3/users/9c6c6660ed3841768652beee041d1dbd => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:11:54.654840 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5c72d-85c0-449a-a0ec-4d5e502d3424 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:54.656777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-82a5c72d-85c0-449a-a0ec-4d5e502d3424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:54.715192 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5c72d-85c0-449a-a0ec-4d5e502d3424 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:54.807252 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80b907-48d5-4a2b-b437-d12a28e8edec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:54.807918 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80b907-48d5-4a2b-b437-d12a28e8edec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:54.809907 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80b907-48d5-4a2b-b437-d12a28e8edec admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:54.809907 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80b907-48d5-4a2b-b437-d12a28e8edec admin admin] PATH_INFO: `/v3/projects/66df5c2e75df4980a216e3fb3ad335d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:54.810362 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c80b907-48d5-4a2b-b437-d12a28e8edec admin admin] RBAC: Authorizing `identity:delete_project(project_id=66df5c2e75df4980a216e3fb3ad335d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:54.812614 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c80b907-48d5-4a2b-b437-d12a28e8edec admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:54.998691 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-5c80b907-48d5-4a2b-b437-d12a28e8edec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66df5c2e75df4980a216e3fb3ad335d8', 'request_id': 'req-5c80b907-48d5-4a2b-b437-d12a28e8edec'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:55.002196 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:55.018586 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125903bb-cc52-4540-886c-9f30eaa1743b admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:55.021084 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-125903bb-cc52-4540-886c-9f30eaa1743b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:55.126707 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125903bb-cc52-4540-886c-9f30eaa1743b admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:55.156384 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-5c80b907-48d5-4a2b-b437-d12a28e8edec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66df5c2e75df4980a216e3fb3ad335d8', 'request_id': 'req-5c80b907-48d5-4a2b-b437-d12a28e8edec'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:55.166640 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-5c80b907-48d5-4a2b-b437-d12a28e8edec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66df5c2e75df4980a216e3fb3ad335d8', 'request_id': 'req-5c80b907-48d5-4a2b-b437-d12a28e8edec'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:55.183379 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-5c80b907-48d5-4a2b-b437-d12a28e8edec admin admin] The token cache is being invalidate because project 66df5c2e75df4980a216e3fb3ad335d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:11:55.183695 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-5c80b907-48d5-4a2b-b437-d12a28e8edec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:55.184432 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-5c80b907-48d5-4a2b-b437-d12a28e8edec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:55.186532 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 994/1951] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:11:54 2022] DELETE /identity/v3/projects/66df5c2e75df4980a216e3fb3ad335d8 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:11:55.194559 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bc28c-cd8c-4316-81c7-b6102e29e214 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:55.195090 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bc28c-cd8c-4316-81c7-b6102e29e214 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:55.195575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bc28c-cd8c-4316-81c7-b6102e29e214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:55.211051 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9d457-c8e0-4059-ae62-862009447987 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:55.212124 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9d457-c8e0-4059-ae62-862009447987 service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:55.212641 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9d457-c8e0-4059-ae62-862009447987 service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:55.213088 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9d457-c8e0-4059-ae62-862009447987 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:55.216452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-23c9d457-c8e0-4059-ae62-862009447987 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:55.228563 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-372bc28c-cd8c-4316-81c7-b6102e29e214 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:55.230729 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-372bc28c-cd8c-4316-81c7-b6102e29e214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:55.339689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:55.357834 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9d457-c8e0-4059-ae62-862009447987 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:55.361137 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9d457-c8e0-4059-ae62-862009447987 service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:55.376935 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 995/1952] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:11:55.377262 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 958/1953] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:11:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:11:55.381234 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d93831-5da8-4cbb-9b2e-a66430b0b917 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:55.381738 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d93831-5da8-4cbb-9b2e-a66430b0b917 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:55.382237 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d93831-5da8-4cbb-9b2e-a66430b0b917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:55.416773 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-34d93831-5da8-4cbb-9b2e-a66430b0b917 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:55.419154 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-34d93831-5da8-4cbb-9b2e-a66430b0b917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:55.443879 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 996/1954] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:11:55.465088 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9d457-c8e0-4059-ae62-862009447987 service cinder] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:55.475645 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9d457-c8e0-4059-ae62-862009447987 service cinder] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:55.494517 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf1889-9c41-45fa-87e9-d5cc2b2d5f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:55.494517 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf1889-9c41-45fa-87e9-d5cc2b2d5f60 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:55.494959 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf1889-9c41-45fa-87e9-d5cc2b2d5f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:55.497486 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf1889-9c41-45fa-87e9-d5cc2b2d5f60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:55.498621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf1889-9c41-45fa-87e9-d5cc2b2d5f60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:11:55.499011 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf1889-9c41-45fa-87e9-d5cc2b2d5f60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:55.500873 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf1889-9c41-45fa-87e9-d5cc2b2d5f60 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:55.530603 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 959/1955] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:11:55.536750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d93831-5da8-4cbb-9b2e-a66430b0b917 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:55.558614 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d93831-5da8-4cbb-9b2e-a66430b0b917 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:55.566068 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2893071-d135-48d6-8f14-feab0c99f54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:55.571053 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2893071-d135-48d6-8f14-feab0c99f54e admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:55.583442 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2893071-d135-48d6-8f14-feab0c99f54e admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:55.584068 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2893071-d135-48d6-8f14-feab0c99f54e admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:55.585513 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2893071-d135-48d6-8f14-feab0c99f54e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:55.594725 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2893071-d135-48d6-8f14-feab0c99f54e admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:55.723656 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 997/1956] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:11:55 2022] POST /identity/v3/projects => generated 369 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:11:55.730013 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf1889-9c41-45fa-87e9-d5cc2b2d5f60 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:55.755913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf1889-9c41-45fa-87e9-d5cc2b2d5f60 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:55.894157 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796da8ca-3b1e-4895-85e6-4d047bd5d195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:55.895910 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796da8ca-3b1e-4895-85e6-4d047bd5d195 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:55.896288 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796da8ca-3b1e-4895-85e6-4d047bd5d195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:55.896910 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796da8ca-3b1e-4895-85e6-4d047bd5d195 admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:55.900589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796da8ca-3b1e-4895-85e6-4d047bd5d195 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:55.901970 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796da8ca-3b1e-4895-85e6-4d047bd5d195 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:56.041223 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 960/1957] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:11:55 2022] POST /identity/v3/users => generated 285 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:11:56.049300 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2893071-d135-48d6-8f14-feab0c99f54e admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:56.066043 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2893071-d135-48d6-8f14-feab0c99f54e admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:56.074482 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853ed36-a3e2-4168-a4a0-75d397767d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:56.075575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853ed36-a3e2-4168-a4a0-75d397767d0d admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:56.076139 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853ed36-a3e2-4168-a4a0-75d397767d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:56.076716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853ed36-a3e2-4168-a4a0-75d397767d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:56.078156 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853ed36-a3e2-4168-a4a0-75d397767d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:56.081311 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853ed36-a3e2-4168-a4a0-75d397767d0d admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:56.104557 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 998/1958] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:11:56.105613 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796da8ca-3b1e-4895-85e6-4d047bd5d195 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:56.119497 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796da8ca-3b1e-4895-85e6-4d047bd5d195 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:56.133632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2d788-d886-400c-9a31-b48402a8fe42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:56.133632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2d788-d886-400c-9a31-b48402a8fe42 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:56.133632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2d788-d886-400c-9a31-b48402a8fe42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:56.134267 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2d788-d886-400c-9a31-b48402a8fe42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:56.136079 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2d788-d886-400c-9a31-b48402a8fe42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:56.138420 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2d788-d886-400c-9a31-b48402a8fe42 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:56.171171 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 961/1959] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:11:56.172272 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853ed36-a3e2-4168-a4a0-75d397767d0d admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:56.211523 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853ed36-a3e2-4168-a4a0-75d397767d0d admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:56.225959 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16976f6-c968-4e4f-9c87-443a33e5a900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:56.227272 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16976f6-c968-4e4f-9c87-443a33e5a900 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:56.227777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16976f6-c968-4e4f-9c87-443a33e5a900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:56.228126 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16976f6-c968-4e4f-9c87-443a33e5a900 admin admin] PATH_INFO: `/v3/projects/179b66ad7e8b403d83049c67810fdcc4/users/baedd061340740fc89f75a3e4a7629bd/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:56.267680 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16976f6-c968-4e4f-9c87-443a33e5a900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=179b66ad7e8b403d83049c67810fdcc4, user_id=baedd061340740fc89f75a3e4a7629bd, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:56.278432 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16976f6-c968-4e4f-9c87-443a33e5a900 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:56.403162 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 999/1960] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:11:56 2022] PUT /identity/v3/projects/179b66ad7e8b403d83049c67810fdcc4/users/baedd061340740fc89f75a3e4a7629bd/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:11:56.424895 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5c801-abb2-4e5d-9442-3d87f1da6931 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:56.426146 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5c801-abb2-4e5d-9442-3d87f1da6931 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:56.426146 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5c801-abb2-4e5d-9442-3d87f1da6931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:56.505028 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-1ed5c801-abb2-4e5d-9442-3d87f1da6931 None None] MFA Rules not processed for user `baedd061340740fc89f75a3e4a7629bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:56.507804 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-1ed5c801-abb2-4e5d-9442-3d87f1da6931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:56.658737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 962/1961] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:11:56.685243 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16976f6-c968-4e4f-9c87-443a33e5a900 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:56.697774 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-a16976f6-c968-4e4f-9c87-443a33e5a900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:56.809298 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16976f6-c968-4e4f-9c87-443a33e5a900 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:56.815730 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fd904-139e-4989-a38f-abe70f2cbd44 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca8afe2c10f4db58716aacfd373504b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:56.817334 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fd904-139e-4989-a38f-abe70f2cbd44 service glance] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:56.818570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fd904-139e-4989-a38f-abe70f2cbd44 service glance] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:56.818893 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fd904-139e-4989-a38f-abe70f2cbd44 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:56.842223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fd904-139e-4989-a38f-abe70f2cbd44 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:56.845872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fd904-139e-4989-a38f-abe70f2cbd44 service glance] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:56.877677 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1000/1962] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:11:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:11:58.502236 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5c801-abb2-4e5d-9442-3d87f1da6931 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:58.506927 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-1ed5c801-abb2-4e5d-9442-3d87f1da6931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:58.605883 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:58.612360 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5c801-abb2-4e5d-9442-3d87f1da6931 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:58.618805 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62e0b4-75f9-4587-a133-1a0ab8f71491 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:58.628418 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62e0b4-75f9-4587-a133-1a0ab8f71491 service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:58.628418 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62e0b4-75f9-4587-a133-1a0ab8f71491 service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:58.628418 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62e0b4-75f9-4587-a133-1a0ab8f71491 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:58.628418 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-1f62e0b4-75f9-4587-a133-1a0ab8f71491 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:58.734478 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fd904-139e-4989-a38f-abe70f2cbd44 service glance] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:58.743449 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-d33fd904-139e-4989-a38f-abe70f2cbd44 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:58.759261 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62e0b4-75f9-4587-a133-1a0ab8f71491 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:58.763046 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62e0b4-75f9-4587-a133-1a0ab8f71491 service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:58.782909 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 963/1963] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:11:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:11:58.787367 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:58.889974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fd904-139e-4989-a38f-abe70f2cbd44 service glance] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:58.901328 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff18f62-e43a-4287-ac43-e1cd93067337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:58.902789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff18f62-e43a-4287-ac43-e1cd93067337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:58.903759 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff18f62-e43a-4287-ac43-e1cd93067337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:58.904899 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff18f62-e43a-4287-ac43-e1cd93067337 admin admin] PATH_INFO: `/v3/users/9907e4a4fc7840a8a10899e0f65a5f66` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:58.908107 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff18f62-e43a-4287-ac43-e1cd93067337 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9907e4a4fc7840a8a10899e0f65a5f66)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:58.913104 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff18f62-e43a-4287-ac43-e1cd93067337 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:59.231701 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-3ff18f62-e43a-4287-ac43-e1cd93067337 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9907e4a4fc7840a8a10899e0f65a5f66'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:59.355772 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-3ff18f62-e43a-4287-ac43-e1cd93067337 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9907e4a4fc7840a8a10899e0f65a5f66'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:59.387372 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-3ff18f62-e43a-4287-ac43-e1cd93067337 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9907e4a4fc7840a8a10899e0f65a5f66'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:59.392505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-3ff18f62-e43a-4287-ac43-e1cd93067337 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9907e4a4fc7840a8a10899e0f65a5f66'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:59.392505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-3ff18f62-e43a-4287-ac43-e1cd93067337 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9907e4a4fc7840a8a10899e0f65a5f66'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:11:59.454751 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1001/1964] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:11:58 2022] DELETE /identity/v3/users/9907e4a4fc7840a8a10899e0f65a5f66 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:11:59.460813 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cd861-f2dc-46f6-82f0-14fef7273f39 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:59.461288 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cd861-f2dc-46f6-82f0-14fef7273f39 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:59.461583 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cd861-f2dc-46f6-82f0-14fef7273f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:59.486031 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-db5cd861-f2dc-46f6-82f0-14fef7273f39 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:11:59.487504 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-db5cd861-f2dc-46f6-82f0-14fef7273f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:59.642641 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 964/1965] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:11:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:11:59.665320 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff18f62-e43a-4287-ac43-e1cd93067337 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:11:59.667139 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-3ff18f62-e43a-4287-ac43-e1cd93067337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:11:59.776884 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff18f62-e43a-4287-ac43-e1cd93067337 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:11:59.789808 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd764d6-4309-43ca-93fc-3e7b9fa66b70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:11:59.790919 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd764d6-4309-43ca-93fc-3e7b9fa66b70 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:11:59.791424 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd764d6-4309-43ca-93fc-3e7b9fa66b70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:11:59.791988 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd764d6-4309-43ca-93fc-3e7b9fa66b70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:11:59.807787 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd764d6-4309-43ca-93fc-3e7b9fa66b70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:11:59.820190 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd764d6-4309-43ca-93fc-3e7b9fa66b70 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:11:59.824264 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1002/1966] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:11:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:12:00.230692 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5cd861-f2dc-46f6-82f0-14fef7273f39 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:00.233302 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-db5cd861-f2dc-46f6-82f0-14fef7273f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:00.256036 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5cd861-f2dc-46f6-82f0-14fef7273f39 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:00.274767 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd81163-4116-4537-b5d8-a6860808b40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:00.276422 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd81163-4116-4537-b5d8-a6860808b40b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:00.277750 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd81163-4116-4537-b5d8-a6860808b40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:00.277750 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd81163-4116-4537-b5d8-a6860808b40b admin admin] PATH_INFO: `/v3/users/ed8d0b552b03417c9db1f5fc2bef05b2` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:00.279749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd81163-4116-4537-b5d8-a6860808b40b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed8d0b552b03417c9db1f5fc2bef05b2)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:00.284186 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd81163-4116-4537-b5d8-a6860808b40b admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:00.485592 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd764d6-4309-43ca-93fc-3e7b9fa66b70 service neutron] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:00.487079 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-9dd764d6-4309-43ca-93fc-3e7b9fa66b70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:00.510473 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd764d6-4309-43ca-93fc-3e7b9fa66b70 service neutron] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:00.516086 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80880eb1-4a45-4fd1-808f-eb9a37ded857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:00.517406 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80880eb1-4a45-4fd1-808f-eb9a37ded857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:00.517981 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80880eb1-4a45-4fd1-808f-eb9a37ded857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:00.518563 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80880eb1-4a45-4fd1-808f-eb9a37ded857 admin admin] PATH_INFO: `/v3/projects/1129a5340ac945678e0473de910c5890` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:00.522940 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80880eb1-4a45-4fd1-808f-eb9a37ded857 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1129a5340ac945678e0473de910c5890)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:00.526058 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80880eb1-4a45-4fd1-808f-eb9a37ded857 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:00.603496 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4bd81163-4116-4537-b5d8-a6860808b40b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed8d0b552b03417c9db1f5fc2bef05b2'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:00.612860 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4bd81163-4116-4537-b5d8-a6860808b40b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed8d0b552b03417c9db1f5fc2bef05b2'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:00.614838 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4bd81163-4116-4537-b5d8-a6860808b40b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed8d0b552b03417c9db1f5fc2bef05b2'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:00.686867 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4bd81163-4116-4537-b5d8-a6860808b40b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed8d0b552b03417c9db1f5fc2bef05b2'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:00.718278 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:00.731106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4bd81163-4116-4537-b5d8-a6860808b40b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed8d0b552b03417c9db1f5fc2bef05b2'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:00.733709 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-80880eb1-4a45-4fd1-808f-eb9a37ded857 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1129a5340ac945678e0473de910c5890', 'request_id': 'req-80880eb1-4a45-4fd1-808f-eb9a37ded857'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:00.742925 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 965/1967] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:12:00 2022] DELETE /identity/v3/users/ed8d0b552b03417c9db1f5fc2bef05b2 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:12:00.817832 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-80880eb1-4a45-4fd1-808f-eb9a37ded857 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1129a5340ac945678e0473de910c5890', 'request_id': 'req-80880eb1-4a45-4fd1-808f-eb9a37ded857'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:00.827947 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-80880eb1-4a45-4fd1-808f-eb9a37ded857 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1129a5340ac945678e0473de910c5890', 'request_id': 'req-80880eb1-4a45-4fd1-808f-eb9a37ded857'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:00.850116 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-80880eb1-4a45-4fd1-808f-eb9a37ded857 admin admin] The token cache is being invalidate because project 1129a5340ac945678e0473de910c5890 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:12:00.850790 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-80880eb1-4a45-4fd1-808f-eb9a37ded857 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:00.851566 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-80880eb1-4a45-4fd1-808f-eb9a37ded857 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:00.853400 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1003/1968] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:12:00 2022] DELETE /identity/v3/projects/1129a5340ac945678e0473de910c5890 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:12:00.858735 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd81163-4116-4537-b5d8-a6860808b40b admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:00.861414 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-4bd81163-4116-4537-b5d8-a6860808b40b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:00.880388 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:01.009738 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd81163-4116-4537-b5d8-a6860808b40b admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:01.022381 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa1bbb-3285-40da-a3e3-00ce02ca384a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:01.023252 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa1bbb-3285-40da-a3e3-00ce02ca384a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:01.023670 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa1bbb-3285-40da-a3e3-00ce02ca384a admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:01.024302 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa1bbb-3285-40da-a3e3-00ce02ca384a admin admin] PATH_INFO: `/v3/users/44ceda716f594f15af10a239f8704b95` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:01.026139 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa1bbb-3285-40da-a3e3-00ce02ca384a admin admin] RBAC: Authorizing `identity:delete_user(user_id=44ceda716f594f15af10a239f8704b95)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:01.028431 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa1bbb-3285-40da-a3e3-00ce02ca384a admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:01.133747 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80880eb1-4a45-4fd1-808f-eb9a37ded857 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:01.136909 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-80880eb1-4a45-4fd1-808f-eb9a37ded857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:01.261850 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80880eb1-4a45-4fd1-808f-eb9a37ded857 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:01.270161 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091e424-80f8-41c6-883e-63943097a047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:01.277579 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091e424-80f8-41c6-883e-63943097a047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:01.278880 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091e424-80f8-41c6-883e-63943097a047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:01.279241 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091e424-80f8-41c6-883e-63943097a047 admin admin] PATH_INFO: `/v3/projects/53df83f23dcf439aae2c867c57df57e0` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:01.280889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7091e424-80f8-41c6-883e-63943097a047 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53df83f23dcf439aae2c867c57df57e0)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:01.283502 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7091e424-80f8-41c6-883e-63943097a047 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:01.313938 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-f7aa1bbb-3285-40da-a3e3-00ce02ca384a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44ceda716f594f15af10a239f8704b95'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:01.325258 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-f7aa1bbb-3285-40da-a3e3-00ce02ca384a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44ceda716f594f15af10a239f8704b95'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:01.326401 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-f7aa1bbb-3285-40da-a3e3-00ce02ca384a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44ceda716f594f15af10a239f8704b95'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:01.444001 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-7091e424-80f8-41c6-883e-63943097a047 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53df83f23dcf439aae2c867c57df57e0', 'request_id': 'req-7091e424-80f8-41c6-883e-63943097a047'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:01.446851 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-f7aa1bbb-3285-40da-a3e3-00ce02ca384a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44ceda716f594f15af10a239f8704b95'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:01.468420 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-f7aa1bbb-3285-40da-a3e3-00ce02ca384a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44ceda716f594f15af10a239f8704b95'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:01.479162 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 966/1969] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:12:00 2022] DELETE /identity/v3/users/44ceda716f594f15af10a239f8704b95 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:12:01.515616 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-7091e424-80f8-41c6-883e-63943097a047 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53df83f23dcf439aae2c867c57df57e0', 'request_id': 'req-7091e424-80f8-41c6-883e-63943097a047'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:01.524529 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-7091e424-80f8-41c6-883e-63943097a047 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53df83f23dcf439aae2c867c57df57e0', 'request_id': 'req-7091e424-80f8-41c6-883e-63943097a047'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:01.548945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-7091e424-80f8-41c6-883e-63943097a047 admin admin] The token cache is being invalidate because project 53df83f23dcf439aae2c867c57df57e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:12:01.549835 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-7091e424-80f8-41c6-883e-63943097a047 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:01.555025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-7091e424-80f8-41c6-883e-63943097a047 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:01.561666 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1004/1970] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:12:01 2022] DELETE /identity/v3/projects/53df83f23dcf439aae2c867c57df57e0 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:12:01.569992 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781e7e8-60e4-403c-abf6-3e8d0d198b83 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:01.570506 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781e7e8-60e4-403c-abf6-3e8d0d198b83 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:01.570932 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781e7e8-60e4-403c-abf6-3e8d0d198b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:01.595992 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-f781e7e8-60e4-403c-abf6-3e8d0d198b83 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:01.597280 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-f781e7e8-60e4-403c-abf6-3e8d0d198b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:01.672288 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 967/1971] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:12:01.686040 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7a614-56c9-4a11-a721-dda4d89ab171 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:01.686478 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7a614-56c9-4a11-a721-dda4d89ab171 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:01.686874 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7a614-56c9-4a11-a721-dda4d89ab171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:01.713599 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-1bc7a614-56c9-4a11-a721-dda4d89ab171 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:01.716291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-1bc7a614-56c9-4a11-a721-dda4d89ab171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:01.726603 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1005/1972] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:12:01.731446 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781e7e8-60e4-403c-abf6-3e8d0d198b83 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:01.743449 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781e7e8-60e4-403c-abf6-3e8d0d198b83 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:01.754623 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020c952-9be4-43b7-aace-2fd335edefc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:01.755602 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020c952-9be4-43b7-aace-2fd335edefc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:01.756064 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020c952-9be4-43b7-aace-2fd335edefc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:01.756500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020c952-9be4-43b7-aace-2fd335edefc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:01.757327 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020c952-9be4-43b7-aace-2fd335edefc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:12:01.757730 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020c952-9be4-43b7-aace-2fd335edefc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:01.759822 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020c952-9be4-43b7-aace-2fd335edefc9 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:01.781714 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 968/1973] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:12:01.783627 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7a614-56c9-4a11-a721-dda4d89ab171 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:01.797515 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7a614-56c9-4a11-a721-dda4d89ab171 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:01.803764 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f46eb-2186-431a-876d-6d8b04b93033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:01.804993 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f46eb-2186-431a-876d-6d8b04b93033 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:01.805613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f46eb-2186-431a-876d-6d8b04b93033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:01.805613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f46eb-2186-431a-876d-6d8b04b93033 admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:01.806694 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f46eb-2186-431a-876d-6d8b04b93033 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:01.810034 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f46eb-2186-431a-876d-6d8b04b93033 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:01.952358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1006/1974] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:12:01 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:12:01.957641 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020c952-9be4-43b7-aace-2fd335edefc9 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:01.974930 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020c952-9be4-43b7-aace-2fd335edefc9 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:01.990068 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:02.046991 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f10ab9-1341-494f-bd5f-859683a15df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:02.047621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f10ab9-1341-494f-bd5f-859683a15df0 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:02.047905 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f10ab9-1341-494f-bd5f-859683a15df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:02.048205 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f10ab9-1341-494f-bd5f-859683a15df0 admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:02.048977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f10ab9-1341-494f-bd5f-859683a15df0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:02.051533 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f10ab9-1341-494f-bd5f-859683a15df0 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:02.209055 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f46eb-2186-431a-876d-6d8b04b93033 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:02.212482 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-c72f46eb-2186-431a-876d-6d8b04b93033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:02.226074 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 969/1975] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:12:01 2022] POST /identity/v3/users => generated 289 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:12:02.232234 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f10ab9-1341-494f-bd5f-859683a15df0 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:02.246613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f46eb-2186-431a-876d-6d8b04b93033 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:02.251423 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f10ab9-1341-494f-bd5f-859683a15df0 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:02.258119 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3e5c2-c1cf-4de5-9a9a-3d2389de949c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:02.258714 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defbd4f2-7d03-40d3-baf1-a557b9320ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:02.258936 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3e5c2-c1cf-4de5-9a9a-3d2389de949c admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:02.259084 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3e5c2-c1cf-4de5-9a9a-3d2389de949c admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:02.259318 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3e5c2-c1cf-4de5-9a9a-3d2389de949c admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:02.259970 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbd4f2-7d03-40d3-baf1-a557b9320ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:02.260132 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3e5c2-c1cf-4de5-9a9a-3d2389de949c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:02.260698 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbd4f2-7d03-40d3-baf1-a557b9320ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:02.261286 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbd4f2-7d03-40d3-baf1-a557b9320ec4 admin admin] PATH_INFO: `/v3/projects/ee8827db257d4f68a8b312ce23f80296` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:02.262040 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3e5c2-c1cf-4de5-9a9a-3d2389de949c admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:02.275046 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 970/1976] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:12:02.283370 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defbd4f2-7d03-40d3-baf1-a557b9320ec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee8827db257d4f68a8b312ce23f80296)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:02.287979 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defbd4f2-7d03-40d3-baf1-a557b9320ec4 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:02.292710 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3e5c2-c1cf-4de5-9a9a-3d2389de949c admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:02.332600 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3e5c2-c1cf-4de5-9a9a-3d2389de949c admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:02.345323 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3bd85-3755-4902-a451-2d08ae3b2e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:02.350029 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3bd85-3755-4902-a451-2d08ae3b2e77 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:02.350029 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3bd85-3755-4902-a451-2d08ae3b2e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:02.350837 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3bd85-3755-4902-a451-2d08ae3b2e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:02.352136 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:02.355023 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3bd85-3755-4902-a451-2d08ae3b2e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:02.359092 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3bd85-3755-4902-a451-2d08ae3b2e77 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:02.379284 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 971/1977] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:12:02.384585 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3bd85-3755-4902-a451-2d08ae3b2e77 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:02.402608 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3bd85-3755-4902-a451-2d08ae3b2e77 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:02.416298 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec40dda-d644-4fcd-898b-4a92fd52ea87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:02.417574 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec40dda-d644-4fcd-898b-4a92fd52ea87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:02.417999 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec40dda-d644-4fcd-898b-4a92fd52ea87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:02.418413 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec40dda-d644-4fcd-898b-4a92fd52ea87 admin admin] PATH_INFO: `/v3/projects/696f75fb6c494cfab9deb3d36c3ad599/users/3bccd348dd13473e82ca33c42b840383/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:02.447182 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec40dda-d644-4fcd-898b-4a92fd52ea87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=696f75fb6c494cfab9deb3d36c3ad599, user_id=3bccd348dd13473e82ca33c42b840383, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:02.450832 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec40dda-d644-4fcd-898b-4a92fd52ea87 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:02.558270 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 972/1978] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:12:02 2022] PUT /identity/v3/projects/696f75fb6c494cfab9deb3d36c3ad599/users/3bccd348dd13473e82ca33c42b840383/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:12:02.567067 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17ad88-84e9-42a5-9224-42489169c27c None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:02.567398 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17ad88-84e9-42a5-9224-42489169c27c None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:02.567789 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17ad88-84e9-42a5-9224-42489169c27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:02.594548 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-defbd4f2-7d03-40d3-baf1-a557b9320ec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee8827db257d4f68a8b312ce23f80296', 'request_id': 'req-defbd4f2-7d03-40d3-baf1-a557b9320ec4'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:02.597738 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-0a17ad88-84e9-42a5-9224-42489169c27c None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:02.599122 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-0a17ad88-84e9-42a5-9224-42489169c27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:02.702991 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 973/1979] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:12:02.710282 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-defbd4f2-7d03-40d3-baf1-a557b9320ec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee8827db257d4f68a8b312ce23f80296', 'request_id': 'req-defbd4f2-7d03-40d3-baf1-a557b9320ec4'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:02.718090 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17ad88-84e9-42a5-9224-42489169c27c None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:02.720899 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-defbd4f2-7d03-40d3-baf1-a557b9320ec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee8827db257d4f68a8b312ce23f80296', 'request_id': 'req-defbd4f2-7d03-40d3-baf1-a557b9320ec4'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:02.721185 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-0a17ad88-84e9-42a5-9224-42489169c27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:02.735632 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-defbd4f2-7d03-40d3-baf1-a557b9320ec4 admin admin] The token cache is being invalidate because project ee8827db257d4f68a8b312ce23f80296 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:12:02.736291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-defbd4f2-7d03-40d3-baf1-a557b9320ec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:02.737041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-defbd4f2-7d03-40d3-baf1-a557b9320ec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:02.738943 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1007/1980] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:12:02 2022] DELETE /identity/v3/projects/ee8827db257d4f68a8b312ce23f80296 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:12:02.746589 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1b3d0-807e-4411-912c-d2b943dd3385 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:02.747297 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1b3d0-807e-4411-912c-d2b943dd3385 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:02.747887 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1b3d0-807e-4411-912c-d2b943dd3385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:02.792876 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-21d1b3d0-807e-4411-912c-d2b943dd3385 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:02.795683 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-21d1b3d0-807e-4411-912c-d2b943dd3385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:02.812656 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1008/1981] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:12:02.827057 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a9bc1-47bb-49dc-a67b-69902e0ffd3a None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:02.827569 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a9bc1-47bb-49dc-a67b-69902e0ffd3a None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:02.832695 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a9bc1-47bb-49dc-a67b-69902e0ffd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:02.833498 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17ad88-84e9-42a5-9224-42489169c27c None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:02.841456 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0353bd-3719-4c08-9548-359b45722f4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:02.842933 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0353bd-3719-4c08-9548-359b45722f4c service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:02.843776 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0353bd-3719-4c08-9548-359b45722f4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:02.844762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0353bd-3719-4c08-9548-359b45722f4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:02.853662 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-fe0353bd-3719-4c08-9548-359b45722f4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:02.889229 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-538a9bc1-47bb-49dc-a67b-69902e0ffd3a None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:02.891635 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-538a9bc1-47bb-49dc-a67b-69902e0ffd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:02.930218 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0353bd-3719-4c08-9548-359b45722f4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:02.945550 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0353bd-3719-4c08-9548-359b45722f4c service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:02.951701 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1009/1982] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:12:02.953786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a9bc1-47bb-49dc-a67b-69902e0ffd3a None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:02.966607 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 974/1983] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:12:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:12:02.974092 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a9bc1-47bb-49dc-a67b-69902e0ffd3a None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:02.983848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8d04c-e324-41c3-81c0-abfa02908037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:02.985036 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8d04c-e324-41c3-81c0-abfa02908037 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:02.985562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8d04c-e324-41c3-81c0-abfa02908037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:02.986062 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8d04c-e324-41c3-81c0-abfa02908037 admin admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:02.987421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8d04c-e324-41c3-81c0-abfa02908037 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:12:02.988034 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8d04c-e324-41c3-81c0-abfa02908037 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:02.991121 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8d04c-e324-41c3-81c0-abfa02908037 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:03.012881 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1010/1984] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:12:03.018315 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0353bd-3719-4c08-9548-359b45722f4c service neutron] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:03.027803 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:03.034506 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0353bd-3719-4c08-9548-359b45722f4c service neutron] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:03.040017 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c1be1-38f8-42e9-9001-155c0905a899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:03.040832 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c1be1-38f8-42e9-9001-155c0905a899 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:03.041117 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c1be1-38f8-42e9-9001-155c0905a899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:03.041433 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c1be1-38f8-42e9-9001-155c0905a899 admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:03.042846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c1be1-38f8-42e9-9001-155c0905a899 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:03.045220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c1be1-38f8-42e9-9001-155c0905a899 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:03.172209 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 975/1985] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:12:03 2022] POST /identity/v3/projects => generated 409 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:12:03.175280 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8d04c-e324-41c3-81c0-abfa02908037 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:03.187414 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8d04c-e324-41c3-81c0-abfa02908037 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:03.290758 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a9ec2-4e89-4af6-ae65-c6eb8be1185f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:03.292064 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a9ec2-4e89-4af6-ae65-c6eb8be1185f admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:03.293371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a9ec2-4e89-4af6-ae65-c6eb8be1185f admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:03.293860 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a9ec2-4e89-4af6-ae65-c6eb8be1185f admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:03.295363 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a9ec2-4e89-4af6-ae65-c6eb8be1185f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:03.302019 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a9ec2-4e89-4af6-ae65-c6eb8be1185f admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:03.460808 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1011/1986] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:12:03 2022] POST /identity/v3/users => generated 305 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:12:03.466421 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c1be1-38f8-42e9-9001-155c0905a899 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:03.478959 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c1be1-38f8-42e9-9001-155c0905a899 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:03.483860 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7662e2-bd42-4aae-9269-064550228fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:03.484937 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7662e2-bd42-4aae-9269-064550228fcc admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:03.484937 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7662e2-bd42-4aae-9269-064550228fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:03.485295 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7662e2-bd42-4aae-9269-064550228fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:03.485885 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7662e2-bd42-4aae-9269-064550228fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:03.487502 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7662e2-bd42-4aae-9269-064550228fcc admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:03.498238 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 976/1987] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:12:03.502483 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a9ec2-4e89-4af6-ae65-c6eb8be1185f admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:03.513029 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a9ec2-4e89-4af6-ae65-c6eb8be1185f admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:03.517831 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbec808-c021-4588-9cc1-3407fde1ba65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:03.518465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbec808-c021-4588-9cc1-3407fde1ba65 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:03.518743 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbec808-c021-4588-9cc1-3407fde1ba65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:03.519043 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbec808-c021-4588-9cc1-3407fde1ba65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:03.520369 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbec808-c021-4588-9cc1-3407fde1ba65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:03.521985 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbec808-c021-4588-9cc1-3407fde1ba65 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:03.533233 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1012/1988] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:12:03.538156 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7662e2-bd42-4aae-9269-064550228fcc admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:03.548636 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7662e2-bd42-4aae-9269-064550228fcc admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:03.553256 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5251e-aafd-4112-b6bb-b10fc05c7305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:03.553940 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5251e-aafd-4112-b6bb-b10fc05c7305 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:03.554219 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5251e-aafd-4112-b6bb-b10fc05c7305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:03.554496 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5251e-aafd-4112-b6bb-b10fc05c7305 admin admin] PATH_INFO: `/v3/projects/54528e4f02c34a5abd55b1c26d88ae1b/users/a3b2ca02000a4fc5bb1a6e756c4d41ed/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:03.570972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5251e-aafd-4112-b6bb-b10fc05c7305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54528e4f02c34a5abd55b1c26d88ae1b, user_id=a3b2ca02000a4fc5bb1a6e756c4d41ed, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:03.573646 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5251e-aafd-4112-b6bb-b10fc05c7305 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:03.697885 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 977/1989] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:12:03 2022] PUT /identity/v3/projects/54528e4f02c34a5abd55b1c26d88ae1b/users/a3b2ca02000a4fc5bb1a6e756c4d41ed/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:12:03.718881 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481b3ba-4fb8-45d2-b7b8-777fda765002 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:03.719181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481b3ba-4fb8-45d2-b7b8-777fda765002 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:03.719490 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481b3ba-4fb8-45d2-b7b8-777fda765002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:03.770361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-9481b3ba-4fb8-45d2-b7b8-777fda765002 None None] MFA Rules not processed for user `a3b2ca02000a4fc5bb1a6e756c4d41ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:03.772235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-9481b3ba-4fb8-45d2-b7b8-777fda765002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:03.846736 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:03.877854 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1013/1990] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:03 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:12:03.883371 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5251e-aafd-4112-b6bb-b10fc05c7305 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:03.959135 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5251e-aafd-4112-b6bb-b10fc05c7305 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:03.967580 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fdd40a-9a5b-4101-aaad-387262816f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:03.968277 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdd40a-9a5b-4101-aaad-387262816f0f admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:03.968618 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdd40a-9a5b-4101-aaad-387262816f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:03.969024 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdd40a-9a5b-4101-aaad-387262816f0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:03.969801 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fdd40a-9a5b-4101-aaad-387262816f0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:03.971824 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fdd40a-9a5b-4101-aaad-387262816f0f admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:04.180200 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 978/1991] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:12:03 2022] POST /identity/v3/projects => generated 409 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:12:04.184275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481b3ba-4fb8-45d2-b7b8-777fda765002 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:04.196132 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481b3ba-4fb8-45d2-b7b8-777fda765002 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:04.260613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88593fd-24b2-4e22-be2a-467d6eb1b6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:04.261279 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88593fd-24b2-4e22-be2a-467d6eb1b6c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:04.261545 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88593fd-24b2-4e22-be2a-467d6eb1b6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:04.261963 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88593fd-24b2-4e22-be2a-467d6eb1b6c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:04.262508 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88593fd-24b2-4e22-be2a-467d6eb1b6c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:04.264689 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88593fd-24b2-4e22-be2a-467d6eb1b6c1 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:04.422532 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1014/1992] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:12:04 2022] POST /identity/v3/users => generated 311 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:12:04.422737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fdd40a-9a5b-4101-aaad-387262816f0f admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:04.423718 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-88fdd40a-9a5b-4101-aaad-387262816f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:04.426652 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88593fd-24b2-4e22-be2a-467d6eb1b6c1 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:04.443598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fdd40a-9a5b-4101-aaad-387262816f0f admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:04.450018 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88593fd-24b2-4e22-be2a-467d6eb1b6c1 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:04.456043 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556dfdf-4819-4cd3-9268-b572bff2bdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:04.457430 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf1e64-acf3-4800-81d3-03e404fa0e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:04.457687 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556dfdf-4819-4cd3-9268-b572bff2bdca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:04.462693 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556dfdf-4819-4cd3-9268-b572bff2bdca admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:04.462882 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf1e64-acf3-4800-81d3-03e404fa0e4b admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:04.462975 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556dfdf-4819-4cd3-9268-b572bff2bdca admin admin] PATH_INFO: `/v3/users/536fff7426be49a9839124f628341c25` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:04.463050 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf1e64-acf3-4800-81d3-03e404fa0e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:04.463050 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf1e64-acf3-4800-81d3-03e404fa0e4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:04.463050 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf1e64-acf3-4800-81d3-03e404fa0e4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:04.463050 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf1e64-acf3-4800-81d3-03e404fa0e4b admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:04.463307 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556dfdf-4819-4cd3-9268-b572bff2bdca admin admin] RBAC: Authorizing `identity:delete_user(user_id=536fff7426be49a9839124f628341c25)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:04.465804 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556dfdf-4819-4cd3-9268-b572bff2bdca admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:04.474368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1015/1993] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:12:04.486261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf1e64-acf3-4800-81d3-03e404fa0e4b admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:04.492518 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf1e64-acf3-4800-81d3-03e404fa0e4b admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:04.497743 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a87405-21e8-449c-9696-5250a59069cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:04.498562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a87405-21e8-449c-9696-5250a59069cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:04.498925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a87405-21e8-449c-9696-5250a59069cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:04.499272 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a87405-21e8-449c-9696-5250a59069cb admin admin] PATH_INFO: `/v3/projects/82fbbb51116c48a1adb3a981b1920991/users/7a5ee373081f47c28cba1baae9908c8c/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:04.518751 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a87405-21e8-449c-9696-5250a59069cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=82fbbb51116c48a1adb3a981b1920991, user_id=7a5ee373081f47c28cba1baae9908c8c, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:04.523342 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a87405-21e8-449c-9696-5250a59069cb admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:04.667995 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1016/1994] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:12:04 2022] PUT /identity/v3/projects/82fbbb51116c48a1adb3a981b1920991/users/7a5ee373081f47c28cba1baae9908c8c/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:12:04.671683 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a87405-21e8-449c-9696-5250a59069cb admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:04.757238 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a87405-21e8-449c-9696-5250a59069cb admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:04.762290 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f03392-d8e2-4d3d-ae5b-9731c3d8ab29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:04.765946 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f03392-d8e2-4d3d-ae5b-9731c3d8ab29 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:04.765946 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f03392-d8e2-4d3d-ae5b-9731c3d8ab29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:04.765946 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f03392-d8e2-4d3d-ae5b-9731c3d8ab29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:04.765946 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f03392-d8e2-4d3d-ae5b-9731c3d8ab29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:04.765946 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f03392-d8e2-4d3d-ae5b-9731c3d8ab29 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:04.778377 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1017/1995] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:12:04.783082 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f03392-d8e2-4d3d-ae5b-9731c3d8ab29 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:04.799546 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f03392-d8e2-4d3d-ae5b-9731c3d8ab29 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:04.811973 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc59350-a389-4c65-b3e6-13bb415d9fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:04.811973 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc59350-a389-4c65-b3e6-13bb415d9fd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:04.811973 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc59350-a389-4c65-b3e6-13bb415d9fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:04.811973 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc59350-a389-4c65-b3e6-13bb415d9fd2 admin admin] PATH_INFO: `/v3/projects/82fbbb51116c48a1adb3a981b1920991/users/7a5ee373081f47c28cba1baae9908c8c/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:04.812951 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc59350-a389-4c65-b3e6-13bb415d9fd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82fbbb51116c48a1adb3a981b1920991, user_id=7a5ee373081f47c28cba1baae9908c8c, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:04.813479 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc59350-a389-4c65-b3e6-13bb415d9fd2 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:04.815466 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-d556dfdf-4819-4cd3-9268-b572bff2bdca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '536fff7426be49a9839124f628341c25'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:04.824510 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-d556dfdf-4819-4cd3-9268-b572bff2bdca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '536fff7426be49a9839124f628341c25'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:04.825616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-d556dfdf-4819-4cd3-9268-b572bff2bdca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '536fff7426be49a9839124f628341c25'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:04.838017 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1018/1996] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:12:04 2022] PUT /identity/v3/projects/82fbbb51116c48a1adb3a981b1920991/users/7a5ee373081f47c28cba1baae9908c8c/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:12:04.852839 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9057f8-c713-4b1d-8829-e95fb7186a5b None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:04.853592 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9057f8-c713-4b1d-8829-e95fb7186a5b None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:04.854632 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9057f8-c713-4b1d-8829-e95fb7186a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:04.912320 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-0b9057f8-c713-4b1d-8829-e95fb7186a5b None None] MFA Rules not processed for user `7a5ee373081f47c28cba1baae9908c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:04.914944 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-0b9057f8-c713-4b1d-8829-e95fb7186a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:04.929001 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-d556dfdf-4819-4cd3-9268-b572bff2bdca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '536fff7426be49a9839124f628341c25'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:04.959554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-d556dfdf-4819-4cd3-9268-b572bff2bdca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '536fff7426be49a9839124f628341c25'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:04.980542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 979/1997] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:12:04 2022] DELETE /identity/v3/users/536fff7426be49a9839124f628341c25 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:12:04.996504 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1e273-0ba6-4c0f-9b6b-dc2b57df8df1 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:05.000981 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1e273-0ba6-4c0f-9b6b-dc2b57df8df1 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:05.000981 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1e273-0ba6-4c0f-9b6b-dc2b57df8df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:05.014612 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:05.052362 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-b8c1e273-0ba6-4c0f-9b6b-dc2b57df8df1 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:05.054203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-b8c1e273-0ba6-4c0f-9b6b-dc2b57df8df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:05.089081 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:05.109773 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1019/1998] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:04 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:12:05.138661 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9057f8-c713-4b1d-8829-e95fb7186a5b None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:05.138661 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-0b9057f8-c713-4b1d-8829-e95fb7186a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:05.178681 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 980/1999] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:12:05.203884 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1e273-0ba6-4c0f-9b6b-dc2b57df8df1 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:05.209216 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-b8c1e273-0ba6-4c0f-9b6b-dc2b57df8df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:05.325696 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9057f8-c713-4b1d-8829-e95fb7186a5b None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:05.368667 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1e273-0ba6-4c0f-9b6b-dc2b57df8df1 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:05.376062 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a167ea-fc28-4a77-95b0-c7fe28d1756f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:05.378085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a167ea-fc28-4a77-95b0-c7fe28d1756f service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:05.378085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a167ea-fc28-4a77-95b0-c7fe28d1756f service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:05.378399 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a167ea-fc28-4a77-95b0-c7fe28d1756f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:05.397407 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a167ea-fc28-4a77-95b0-c7fe28d1756f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:05.403976 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a167ea-fc28-4a77-95b0-c7fe28d1756f service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:05.427915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 981/2000] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:12:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:12:05.429735 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618893c-5e6f-4b88-bc41-09cdd4dd5813 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:05.430467 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618893c-5e6f-4b88-bc41-09cdd4dd5813 service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:05.430748 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618893c-5e6f-4b88-bc41-09cdd4dd5813 service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:05.431043 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618893c-5e6f-4b88-bc41-09cdd4dd5813 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:05.538203 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618893c-5e6f-4b88-bc41-09cdd4dd5813 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:05.539931 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618893c-5e6f-4b88-bc41-09cdd4dd5813 service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:05.569842 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1020/2001] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:12:05 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:12:06.132270 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a167ea-fc28-4a77-95b0-c7fe28d1756f service neutron] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:06.134548 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-a3a167ea-fc28-4a77-95b0-c7fe28d1756f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:06.164712 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a167ea-fc28-4a77-95b0-c7fe28d1756f service neutron] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:06.177482 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09909e-be63-4433-b559-802170733da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:06.178254 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09909e-be63-4433-b559-802170733da9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:06.178588 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09909e-be63-4433-b559-802170733da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:06.178880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09909e-be63-4433-b559-802170733da9 admin admin] PATH_INFO: `/v3/projects/577b7f2411704e28aad4fca193ad9e35` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:06.180653 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09909e-be63-4433-b559-802170733da9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=577b7f2411704e28aad4fca193ad9e35)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:06.184298 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09909e-be63-4433-b559-802170733da9 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:06.275630 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618893c-5e6f-4b88-bc41-09cdd4dd5813 service cinder] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:06.278083 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-d618893c-5e6f-4b88-bc41-09cdd4dd5813 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:06.298817 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618893c-5e6f-4b88-bc41-09cdd4dd5813 service cinder] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:06.303274 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd1bef-8311-4bff-8ac3-c5ff5dbc0705 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:06.303965 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd1bef-8311-4bff-8ac3-c5ff5dbc0705 service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:06.304294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd1bef-8311-4bff-8ac3-c5ff5dbc0705 service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:06.305218 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd1bef-8311-4bff-8ac3-c5ff5dbc0705 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:06.328195 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-c1bd1bef-8311-4bff-8ac3-c5ff5dbc0705 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:06.420574 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd1bef-8311-4bff-8ac3-c5ff5dbc0705 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:06.422285 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd1bef-8311-4bff-8ac3-c5ff5dbc0705 service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:06.431401 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-0f09909e-be63-4433-b559-802170733da9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '577b7f2411704e28aad4fca193ad9e35', 'request_id': 'req-0f09909e-be63-4433-b559-802170733da9'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:06.435826 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1021/2002] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:12:06 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:12:06.444513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-0f09909e-be63-4433-b559-802170733da9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '577b7f2411704e28aad4fca193ad9e35', 'request_id': 'req-0f09909e-be63-4433-b559-802170733da9'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:06.487920 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-0f09909e-be63-4433-b559-802170733da9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '577b7f2411704e28aad4fca193ad9e35', 'request_id': 'req-0f09909e-be63-4433-b559-802170733da9'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:06.604892 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-0f09909e-be63-4433-b559-802170733da9 admin admin] The token cache is being invalidate because project 577b7f2411704e28aad4fca193ad9e35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:12:06.605290 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-0f09909e-be63-4433-b559-802170733da9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:06.606108 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-0f09909e-be63-4433-b559-802170733da9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:06.608768 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 982/2003] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:12:06 2022] DELETE /identity/v3/projects/577b7f2411704e28aad4fca193ad9e35 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:12:06.615492 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd1bef-8311-4bff-8ac3-c5ff5dbc0705 service cinder] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:06.639869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:06.648236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd1bef-8311-4bff-8ac3-c5ff5dbc0705 service cinder] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:06.834256 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c80e6-70d5-48ab-95b6-cb4965170d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:06.836279 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c80e6-70d5-48ab-95b6-cb4965170d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:06.836627 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c80e6-70d5-48ab-95b6-cb4965170d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:06.837953 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c80e6-70d5-48ab-95b6-cb4965170d6f admin admin] PATH_INFO: `/v3/users/08739057613642f99402db90356e0b8d` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:06.840887 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c80e6-70d5-48ab-95b6-cb4965170d6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=08739057613642f99402db90356e0b8d)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:06.846812 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c80e6-70d5-48ab-95b6-cb4965170d6f admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:07.145443 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-358c80e6-70d5-48ab-95b6-cb4965170d6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08739057613642f99402db90356e0b8d'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:07.412717 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-358c80e6-70d5-48ab-95b6-cb4965170d6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08739057613642f99402db90356e0b8d'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:07.424725 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-358c80e6-70d5-48ab-95b6-cb4965170d6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08739057613642f99402db90356e0b8d'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:07.425495 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-358c80e6-70d5-48ab-95b6-cb4965170d6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08739057613642f99402db90356e0b8d'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:07.426156 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-358c80e6-70d5-48ab-95b6-cb4965170d6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08739057613642f99402db90356e0b8d'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:07.457551 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1022/2004] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:12:06 2022] DELETE /identity/v3/users/08739057613642f99402db90356e0b8d => generated 0 bytes in 839 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:12:08.119875 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09909e-be63-4433-b559-802170733da9 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:08.122391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-0f09909e-be63-4433-b559-802170733da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:08.149402 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09909e-be63-4433-b559-802170733da9 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:08.214048 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:08.271558 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f7e56-86f2-4723-8fbc-332a18955864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:08.272635 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f7e56-86f2-4723-8fbc-332a18955864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:08.273100 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f7e56-86f2-4723-8fbc-332a18955864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:08.273555 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f7e56-86f2-4723-8fbc-332a18955864 admin admin] PATH_INFO: `/v3/projects/d7e58b69049247e59c8a60464bd74101` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:08.275880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f7e56-86f2-4723-8fbc-332a18955864 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7e58b69049247e59c8a60464bd74101)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:08.279502 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f7e56-86f2-4723-8fbc-332a18955864 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:08.468562 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-898f7e56-86f2-4723-8fbc-332a18955864 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7e58b69049247e59c8a60464bd74101', 'request_id': 'req-898f7e56-86f2-4723-8fbc-332a18955864'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:08.479049 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-898f7e56-86f2-4723-8fbc-332a18955864 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7e58b69049247e59c8a60464bd74101', 'request_id': 'req-898f7e56-86f2-4723-8fbc-332a18955864'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:08.489144 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-898f7e56-86f2-4723-8fbc-332a18955864 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7e58b69049247e59c8a60464bd74101', 'request_id': 'req-898f7e56-86f2-4723-8fbc-332a18955864'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:08.591917 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-898f7e56-86f2-4723-8fbc-332a18955864 admin admin] The token cache is being invalidate because project d7e58b69049247e59c8a60464bd74101 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:12:08.592400 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-898f7e56-86f2-4723-8fbc-332a18955864 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:08.593479 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-898f7e56-86f2-4723-8fbc-332a18955864 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:08.599774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 983/2005] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:12:08 2022] DELETE /identity/v3/projects/d7e58b69049247e59c8a60464bd74101 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:12:08.601310 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c80e6-70d5-48ab-95b6-cb4965170d6f admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:08.602936 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-358c80e6-70d5-48ab-95b6-cb4965170d6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:08.622671 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c80e6-70d5-48ab-95b6-cb4965170d6f admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:08.681538 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:08.742257 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51b205-de6b-4d0e-a6ed-7032e6fb532a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:08.743409 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51b205-de6b-4d0e-a6ed-7032e6fb532a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:08.743906 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51b205-de6b-4d0e-a6ed-7032e6fb532a admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:08.744455 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51b205-de6b-4d0e-a6ed-7032e6fb532a admin admin] PATH_INFO: `/v3/users/b4d3193f2790432baea30a812617e482` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:08.746967 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51b205-de6b-4d0e-a6ed-7032e6fb532a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4d3193f2790432baea30a812617e482)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:08.753094 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51b205-de6b-4d0e-a6ed-7032e6fb532a admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:09.039575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-6e51b205-de6b-4d0e-a6ed-7032e6fb532a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4d3193f2790432baea30a812617e482'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:09.166828 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-6e51b205-de6b-4d0e-a6ed-7032e6fb532a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4d3193f2790432baea30a812617e482'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:09.186802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-6e51b205-de6b-4d0e-a6ed-7032e6fb532a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4d3193f2790432baea30a812617e482'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:09.189412 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-6e51b205-de6b-4d0e-a6ed-7032e6fb532a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4d3193f2790432baea30a812617e482'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:09.190609 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-6e51b205-de6b-4d0e-a6ed-7032e6fb532a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4d3193f2790432baea30a812617e482'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:09.223212 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1023/2006] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:12:08 2022] DELETE /identity/v3/users/b4d3193f2790432baea30a812617e482 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:12:10.178883 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f7e56-86f2-4723-8fbc-332a18955864 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:10.181551 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-898f7e56-86f2-4723-8fbc-332a18955864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:10.233199 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f7e56-86f2-4723-8fbc-332a18955864 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:10.388830 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a3b2f-8cc8-4110-b4a7-3a954b9ebf57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:10.390062 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a3b2f-8cc8-4110-b4a7-3a954b9ebf57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:10.390713 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a3b2f-8cc8-4110-b4a7-3a954b9ebf57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:10.391471 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a3b2f-8cc8-4110-b4a7-3a954b9ebf57 admin admin] PATH_INFO: `/v3/projects/75a2070e18524382b0f0283018973eaf` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:10.394003 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a3b2f-8cc8-4110-b4a7-3a954b9ebf57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75a2070e18524382b0f0283018973eaf)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:10.398582 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a3b2f-8cc8-4110-b4a7-3a954b9ebf57 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:10.559758 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-a25a3b2f-8cc8-4110-b4a7-3a954b9ebf57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75a2070e18524382b0f0283018973eaf', 'request_id': 'req-a25a3b2f-8cc8-4110-b4a7-3a954b9ebf57'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:10.569577 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-a25a3b2f-8cc8-4110-b4a7-3a954b9ebf57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75a2070e18524382b0f0283018973eaf', 'request_id': 'req-a25a3b2f-8cc8-4110-b4a7-3a954b9ebf57'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:10.574579 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:10.580355 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-a25a3b2f-8cc8-4110-b4a7-3a954b9ebf57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75a2070e18524382b0f0283018973eaf', 'request_id': 'req-a25a3b2f-8cc8-4110-b4a7-3a954b9ebf57'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:10.698316 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-a25a3b2f-8cc8-4110-b4a7-3a954b9ebf57 admin admin] The token cache is being invalidate because project 75a2070e18524382b0f0283018973eaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:12:10.699017 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-a25a3b2f-8cc8-4110-b4a7-3a954b9ebf57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:10.700432 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-a25a3b2f-8cc8-4110-b4a7-3a954b9ebf57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:10.702483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 984/2007] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:12:10 2022] DELETE /identity/v3/projects/75a2070e18524382b0f0283018973eaf => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:12:12.669594 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e888c-1a92-47ed-bb8a-92fb9530c637 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:12.670354 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e888c-1a92-47ed-bb8a-92fb9530c637 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:12.670354 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e888c-1a92-47ed-bb8a-92fb9530c637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:12.706494 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-fa3e888c-1a92-47ed-bb8a-92fb9530c637 None None] MFA Rules not processed for user `3bccd348dd13473e82ca33c42b840383`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:12.708511 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-fa3e888c-1a92-47ed-bb8a-92fb9530c637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:12.822664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1024/2008] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:12:12.843220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a3b2f-8cc8-4110-b4a7-3a954b9ebf57 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:12.845413 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-a25a3b2f-8cc8-4110-b4a7-3a954b9ebf57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:13.046529 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a3b2f-8cc8-4110-b4a7-3a954b9ebf57 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:13.094986 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab6cd6-9805-48c3-a79f-7ffadb5caacb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:13.095996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab6cd6-9805-48c3-a79f-7ffadb5caacb service nova] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:13.096482 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab6cd6-9805-48c3-a79f-7ffadb5caacb service nova] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:13.096961 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab6cd6-9805-48c3-a79f-7ffadb5caacb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:13.125577 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab6cd6-9805-48c3-a79f-7ffadb5caacb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:13.129594 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab6cd6-9805-48c3-a79f-7ffadb5caacb service nova] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:13.164900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 985/2009] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:12:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:12:14.669892 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e888c-1a92-47ed-bb8a-92fb9530c637 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:14.672601 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-fa3e888c-1a92-47ed-bb8a-92fb9530c637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:14.753299 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:14.790470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e888c-1a92-47ed-bb8a-92fb9530c637 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:14.799434 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed4bb5-b480-436e-a11e-a7ae56a1c6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:14.800636 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed4bb5-b480-436e-a11e-a7ae56a1c6bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:14.801189 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed4bb5-b480-436e-a11e-a7ae56a1c6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:14.801673 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed4bb5-b480-436e-a11e-a7ae56a1c6bc admin admin] PATH_INFO: `/v3/users/0d7f6c687b324b3ea9f1f9bcb640f70b` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:14.803297 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed4bb5-b480-436e-a11e-a7ae56a1c6bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d7f6c687b324b3ea9f1f9bcb640f70b)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:14.805822 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed4bb5-b480-436e-a11e-a7ae56a1c6bc admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:15.123137 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-58ed4bb5-b480-436e-a11e-a7ae56a1c6bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d7f6c687b324b3ea9f1f9bcb640f70b'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:15.274530 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-58ed4bb5-b480-436e-a11e-a7ae56a1c6bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d7f6c687b324b3ea9f1f9bcb640f70b'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:15.291682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-58ed4bb5-b480-436e-a11e-a7ae56a1c6bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d7f6c687b324b3ea9f1f9bcb640f70b'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:15.294151 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-58ed4bb5-b480-436e-a11e-a7ae56a1c6bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d7f6c687b324b3ea9f1f9bcb640f70b'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:15.294913 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-58ed4bb5-b480-436e-a11e-a7ae56a1c6bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d7f6c687b324b3ea9f1f9bcb640f70b'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:15.331179 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1025/2010] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:12:14 2022] DELETE /identity/v3/users/0d7f6c687b324b3ea9f1f9bcb640f70b => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:12:15.335270 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63447f43-d137-4b0f-b958-e77e338354a6 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:15.335270 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63447f43-d137-4b0f-b958-e77e338354a6 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:15.335270 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63447f43-d137-4b0f-b958-e77e338354a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:15.393396 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-63447f43-d137-4b0f-b958-e77e338354a6 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:15.393396 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-63447f43-d137-4b0f-b958-e77e338354a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:15.492324 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 986/2011] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:12:15.504307 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed4bb5-b480-436e-a11e-a7ae56a1c6bc admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:15.506110 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-58ed4bb5-b480-436e-a11e-a7ae56a1c6bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:15.659150 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed4bb5-b480-436e-a11e-a7ae56a1c6bc admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:15.667475 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa0876-735a-4c48-bbca-d35772963bac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:15.669638 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa0876-735a-4c48-bbca-d35772963bac service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:15.670337 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa0876-735a-4c48-bbca-d35772963bac service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:15.671918 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa0876-735a-4c48-bbca-d35772963bac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:15.713807 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa0876-735a-4c48-bbca-d35772963bac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:15.717197 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa0876-735a-4c48-bbca-d35772963bac service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:15.748103 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1026/2012] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:12:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:12:16.793967 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63447f43-d137-4b0f-b958-e77e338354a6 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:16.797876 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-63447f43-d137-4b0f-b958-e77e338354a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:16.839236 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63447f43-d137-4b0f-b958-e77e338354a6 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:16.858354 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ed014-d205-4444-a8dd-de2714955ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:16.863989 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ed014-d205-4444-a8dd-de2714955ac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:16.865063 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ed014-d205-4444-a8dd-de2714955ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:16.866383 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ed014-d205-4444-a8dd-de2714955ac6 admin admin] PATH_INFO: `/v3/projects/31d97df5519b4b18a976288e4b06414b` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:16.872080 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ed014-d205-4444-a8dd-de2714955ac6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31d97df5519b4b18a976288e4b06414b)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:16.878581 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ed014-d205-4444-a8dd-de2714955ac6 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:17.234882 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4a1ed014-d205-4444-a8dd-de2714955ac6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31d97df5519b4b18a976288e4b06414b', 'request_id': 'req-4a1ed014-d205-4444-a8dd-de2714955ac6'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:17.265827 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4a1ed014-d205-4444-a8dd-de2714955ac6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31d97df5519b4b18a976288e4b06414b', 'request_id': 'req-4a1ed014-d205-4444-a8dd-de2714955ac6'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:17.290729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4a1ed014-d205-4444-a8dd-de2714955ac6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31d97df5519b4b18a976288e4b06414b', 'request_id': 'req-4a1ed014-d205-4444-a8dd-de2714955ac6'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:17.414780 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:17.428394 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4a1ed014-d205-4444-a8dd-de2714955ac6 admin admin] The token cache is being invalidate because project 31d97df5519b4b18a976288e4b06414b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:12:17.429308 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4a1ed014-d205-4444-a8dd-de2714955ac6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:17.432842 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4a1ed014-d205-4444-a8dd-de2714955ac6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:17.445273 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8ebe3-b20d-4259-bfd8-3ac47640f921 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:17.446100 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8ebe3-b20d-4259-bfd8-3ac47640f921 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:17.446483 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8ebe3-b20d-4259-bfd8-3ac47640f921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:17.452750 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 987/2013] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:12:16 2022] DELETE /identity/v3/projects/31d97df5519b4b18a976288e4b06414b => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:12:17.492025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-63c8ebe3-b20d-4259-bfd8-3ac47640f921 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:17.498547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-63c8ebe3-b20d-4259-bfd8-3ac47640f921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:17.743737 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1027/2014] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:12:17.754478 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d4801-476b-4bd8-a516-c1c6937b811c None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:17.755226 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d4801-476b-4bd8-a516-c1c6937b811c None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:17.756098 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d4801-476b-4bd8-a516-c1c6937b811c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:17.791782 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-312d4801-476b-4bd8-a516-c1c6937b811c None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:17.794975 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-312d4801-476b-4bd8-a516-c1c6937b811c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:17.809122 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 988/2015] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:12:17.816806 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8ebe3-b20d-4259-bfd8-3ac47640f921 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:17.837925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8ebe3-b20d-4259-bfd8-3ac47640f921 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:17.846525 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdbf51-66c4-4027-ba5a-306605c05181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:17.850009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdbf51-66c4-4027-ba5a-306605c05181 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:17.850451 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdbf51-66c4-4027-ba5a-306605c05181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:17.850960 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdbf51-66c4-4027-ba5a-306605c05181 admin admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:17.852422 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bdbf51-66c4-4027-ba5a-306605c05181 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:12:17.853384 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bdbf51-66c4-4027-ba5a-306605c05181 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:17.856497 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bdbf51-66c4-4027-ba5a-306605c05181 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:17.860461 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3854288-bf07-4d40-b1c1-6236db45f041 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:17.860461 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3854288-bf07-4d40-b1c1-6236db45f041 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:17.860461 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3854288-bf07-4d40-b1c1-6236db45f041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:17.860991 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:17.884101 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1028/2016] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:12:17.889814 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdbf51-66c4-4027-ba5a-306605c05181 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:17.903073 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-e3854288-bf07-4d40-b1c1-6236db45f041 None None] MFA Rules not processed for user `3bccd348dd13473e82ca33c42b840383`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:17.906786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdbf51-66c4-4027-ba5a-306605c05181 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:17.907291 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-e3854288-bf07-4d40-b1c1-6236db45f041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:17.916496 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd0161-b2e3-41e8-9d63-8949ea95e0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:17.917346 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd0161-b2e3-41e8-9d63-8949ea95e0f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:17.917634 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd0161-b2e3-41e8-9d63-8949ea95e0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:17.923407 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd0161-b2e3-41e8-9d63-8949ea95e0f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:17.923407 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd0161-b2e3-41e8-9d63-8949ea95e0f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:17.923407 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd0161-b2e3-41e8-9d63-8949ea95e0f5 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:18.051265 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 989/2017] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:12:18.093152 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1029/2018] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:12:17 2022] POST /identity/v3/projects => generated 361 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:12:18.094808 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3854288-bf07-4d40-b1c1-6236db45f041 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:18.130077 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3854288-bf07-4d40-b1c1-6236db45f041 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:18.294809 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf43a75-6dd9-4b2e-a566-bf34007ebff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:18.295815 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf43a75-6dd9-4b2e-a566-bf34007ebff4 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:18.297082 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf43a75-6dd9-4b2e-a566-bf34007ebff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:18.297528 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf43a75-6dd9-4b2e-a566-bf34007ebff4 admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:18.299976 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf43a75-6dd9-4b2e-a566-bf34007ebff4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:18.302827 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf43a75-6dd9-4b2e-a566-bf34007ebff4 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:18.435099 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 990/2019] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:12:18 2022] POST /identity/v3/users => generated 281 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:12:18.441705 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd0161-b2e3-41e8-9d63-8949ea95e0f5 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:18.461723 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd0161-b2e3-41e8-9d63-8949ea95e0f5 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:18.474729 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd1470-8290-4722-a057-e393ae04a450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:18.476123 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd1470-8290-4722-a057-e393ae04a450 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:18.476960 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd1470-8290-4722-a057-e393ae04a450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:18.477533 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd1470-8290-4722-a057-e393ae04a450 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:18.479056 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd1470-8290-4722-a057-e393ae04a450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:18.482554 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd1470-8290-4722-a057-e393ae04a450 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:18.508598 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1030/2020] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:12:18.511374 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf43a75-6dd9-4b2e-a566-bf34007ebff4 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:18.533424 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf43a75-6dd9-4b2e-a566-bf34007ebff4 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:18.542977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b07bc5-0b58-4edb-b0a1-47d8a370d465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:18.544103 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b07bc5-0b58-4edb-b0a1-47d8a370d465 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:18.545135 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b07bc5-0b58-4edb-b0a1-47d8a370d465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:18.545814 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b07bc5-0b58-4edb-b0a1-47d8a370d465 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:18.547608 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b07bc5-0b58-4edb-b0a1-47d8a370d465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:18.553353 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b07bc5-0b58-4edb-b0a1-47d8a370d465 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:18.574599 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 991/2021] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:12:18.579595 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd1470-8290-4722-a057-e393ae04a450 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:18.591457 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd1470-8290-4722-a057-e393ae04a450 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:18.597121 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69abea9-5c82-49eb-b360-e102287ac4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:18.598616 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69abea9-5c82-49eb-b360-e102287ac4c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:18.598918 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69abea9-5c82-49eb-b360-e102287ac4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:18.599219 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69abea9-5c82-49eb-b360-e102287ac4c9 admin admin] PATH_INFO: `/v3/projects/2e104fa2d4574556aef622c74f47ed77/users/f1064d64ef1f413c8876e59eaeb5406c/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:18.620877 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69abea9-5c82-49eb-b360-e102287ac4c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e104fa2d4574556aef622c74f47ed77, user_id=f1064d64ef1f413c8876e59eaeb5406c, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:18.623300 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69abea9-5c82-49eb-b360-e102287ac4c9 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:18.822489 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1031/2022] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:12:18 2022] PUT /identity/v3/projects/2e104fa2d4574556aef622c74f47ed77/users/f1064d64ef1f413c8876e59eaeb5406c/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:12:18.834675 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69841d-9628-476b-a966-b1f258cee311 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:18.835387 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69841d-9628-476b-a966-b1f258cee311 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:18.835387 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69841d-9628-476b-a966-b1f258cee311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:18.877591 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-7c69841d-9628-476b-a966-b1f258cee311 None None] MFA Rules not processed for user `f1064d64ef1f413c8876e59eaeb5406c`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:18.879643 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-7c69841d-9628-476b-a966-b1f258cee311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:18.974889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 992/2023] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:12:19.030940 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69abea9-5c82-49eb-b360-e102287ac4c9 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:19.032836 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-c69abea9-5c82-49eb-b360-e102287ac4c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:19.101346 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69abea9-5c82-49eb-b360-e102287ac4c9 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:19.105428 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479fab0c-f10b-40e4-8509-4199ff319606 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:19.106222 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fab0c-f10b-40e4-8509-4199ff319606 service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:19.106383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fab0c-f10b-40e4-8509-4199ff319606 service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:19.106628 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fab0c-f10b-40e4-8509-4199ff319606 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:19.120241 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479fab0c-f10b-40e4-8509-4199ff319606 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:19.125874 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479fab0c-f10b-40e4-8509-4199ff319606 service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:19.136840 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1032/2024] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:12:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:12:19.157726 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69841d-9628-476b-a966-b1f258cee311 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:19.165301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:19.178448 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479fab0c-f10b-40e4-8509-4199ff319606 service cinder] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:19.182094 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-479fab0c-f10b-40e4-8509-4199ff319606 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:19.286093 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69841d-9628-476b-a966-b1f258cee311 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:19.295548 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df48929-ee25-4fcf-8c1e-9dff78b14e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:19.297110 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df48929-ee25-4fcf-8c1e-9dff78b14e4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:19.297749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df48929-ee25-4fcf-8c1e-9dff78b14e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:19.298386 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df48929-ee25-4fcf-8c1e-9dff78b14e4b admin admin] PATH_INFO: `/v3/users/f1064d64ef1f413c8876e59eaeb5406c` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:19.301846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df48929-ee25-4fcf-8c1e-9dff78b14e4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1064d64ef1f413c8876e59eaeb5406c)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:19.307152 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df48929-ee25-4fcf-8c1e-9dff78b14e4b admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:19.362122 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479fab0c-f10b-40e4-8509-4199ff319606 service cinder] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:19.388868 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3153c-0c35-4ec2-afba-bdc5dc2b8191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:19.389280 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3153c-0c35-4ec2-afba-bdc5dc2b8191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:19.389590 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3153c-0c35-4ec2-afba-bdc5dc2b8191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:19.389880 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3153c-0c35-4ec2-afba-bdc5dc2b8191 admin admin] PATH_INFO: `/v3/users/a3b2ca02000a4fc5bb1a6e756c4d41ed` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:19.391249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3153c-0c35-4ec2-afba-bdc5dc2b8191 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3b2ca02000a4fc5bb1a6e756c4d41ed)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:19.394350 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3153c-0c35-4ec2-afba-bdc5dc2b8191 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:19.653746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-6df48929-ee25-4fcf-8c1e-9dff78b14e4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1064d64ef1f413c8876e59eaeb5406c'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:19.662827 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-6df48929-ee25-4fcf-8c1e-9dff78b14e4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1064d64ef1f413c8876e59eaeb5406c'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:19.664322 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-6df48929-ee25-4fcf-8c1e-9dff78b14e4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1064d64ef1f413c8876e59eaeb5406c'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:19.723807 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:19.733440 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-cdb3153c-0c35-4ec2-afba-bdc5dc2b8191 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3b2ca02000a4fc5bb1a6e756c4d41ed'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:19.772502 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-6df48929-ee25-4fcf-8c1e-9dff78b14e4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1064d64ef1f413c8876e59eaeb5406c'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:19.796448 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-6df48929-ee25-4fcf-8c1e-9dff78b14e4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1064d64ef1f413c8876e59eaeb5406c'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:19.809470 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 993/2025] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:12:19 2022] DELETE /identity/v3/users/f1064d64ef1f413c8876e59eaeb5406c => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:12:19.820538 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7624f8b-689e-4338-9b55-521ee1c40808 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:19.821405 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7624f8b-689e-4338-9b55-521ee1c40808 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:19.821917 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7624f8b-689e-4338-9b55-521ee1c40808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:19.858120 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-c7624f8b-689e-4338-9b55-521ee1c40808 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:19.860785 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-c7624f8b-689e-4338-9b55-521ee1c40808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:19.956595 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-cdb3153c-0c35-4ec2-afba-bdc5dc2b8191 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3b2ca02000a4fc5bb1a6e756c4d41ed'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:19.963977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 994/2026] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:12:19.970719 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-cdb3153c-0c35-4ec2-afba-bdc5dc2b8191 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3b2ca02000a4fc5bb1a6e756c4d41ed'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:19.971164 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-cdb3153c-0c35-4ec2-afba-bdc5dc2b8191 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3b2ca02000a4fc5bb1a6e756c4d41ed'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:19.973220 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-cdb3153c-0c35-4ec2-afba-bdc5dc2b8191 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3b2ca02000a4fc5bb1a6e756c4d41ed'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:19.978244 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7624f8b-689e-4338-9b55-521ee1c40808 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:19.980222 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-c7624f8b-689e-4338-9b55-521ee1c40808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:19.998036 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1033/2027] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:12:19 2022] DELETE /identity/v3/users/a3b2ca02000a4fc5bb1a6e756c4d41ed => generated 0 bytes in 821 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:12:20.003729 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e8f98-29c7-451f-8630-09058de467e3 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:20.012820 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e8f98-29c7-451f-8630-09058de467e3 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:20.012820 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e8f98-29c7-451f-8630-09058de467e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:20.030799 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:20.038935 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-cb6e8f98-29c7-451f-8630-09058de467e3 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:20.047245 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-cb6e8f98-29c7-451f-8630-09058de467e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:20.116733 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7624f8b-689e-4338-9b55-521ee1c40808 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:20.185101 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1034/2028] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:12:20.205547 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716213f-9408-4040-a83d-ed7d15b47e55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:20.206774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716213f-9408-4040-a83d-ed7d15b47e55 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:20.207275 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716213f-9408-4040-a83d-ed7d15b47e55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:20.207843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716213f-9408-4040-a83d-ed7d15b47e55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:20.211817 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-c716213f-9408-4040-a83d-ed7d15b47e55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:20.238602 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716213f-9408-4040-a83d-ed7d15b47e55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:20.242330 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716213f-9408-4040-a83d-ed7d15b47e55 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:20.243964 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e8f98-29c7-451f-8630-09058de467e3 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:20.246696 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-cb6e8f98-29c7-451f-8630-09058de467e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:20.266503 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 995/2029] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:12:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:12:20.281751 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e8f98-29c7-451f-8630-09058de467e3 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:20.298169 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706e512-8df9-46b9-a99f-4acedf4a5fc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:20.302154 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706e512-8df9-46b9-a99f-4acedf4a5fc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:20.302705 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706e512-8df9-46b9-a99f-4acedf4a5fc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:20.303190 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706e512-8df9-46b9-a99f-4acedf4a5fc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:20.326571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706e512-8df9-46b9-a99f-4acedf4a5fc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:20.330114 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706e512-8df9-46b9-a99f-4acedf4a5fc5 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:20.373127 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1035/2030] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:12:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:12:21.341077 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716213f-9408-4040-a83d-ed7d15b47e55 service neutron] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:21.345523 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-c716213f-9408-4040-a83d-ed7d15b47e55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:21.370746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716213f-9408-4040-a83d-ed7d15b47e55 service neutron] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:21.379523 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7547b-1816-4636-9f2f-cec6e4e13604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:21.380787 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7547b-1816-4636-9f2f-cec6e4e13604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:21.381289 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7547b-1816-4636-9f2f-cec6e4e13604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:21.395698 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7547b-1816-4636-9f2f-cec6e4e13604 admin admin] PATH_INFO: `/v3/projects/2e104fa2d4574556aef622c74f47ed77` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:21.395912 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706e512-8df9-46b9-a99f-4acedf4a5fc5 service neutron] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:21.397120 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e7547b-1816-4636-9f2f-cec6e4e13604 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e104fa2d4574556aef622c74f47ed77)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:21.398737 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-e706e512-8df9-46b9-a99f-4acedf4a5fc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:21.402795 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e7547b-1816-4636-9f2f-cec6e4e13604 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:21.445249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706e512-8df9-46b9-a99f-4acedf4a5fc5 service neutron] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:21.462349 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a4281-9e1f-43c6-bfa5-750492dcc806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:21.463574 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a4281-9e1f-43c6-bfa5-750492dcc806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:21.464220 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a4281-9e1f-43c6-bfa5-750492dcc806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:21.465156 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a4281-9e1f-43c6-bfa5-750492dcc806 admin admin] PATH_INFO: `/v3/projects/54528e4f02c34a5abd55b1c26d88ae1b` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:21.467810 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a4281-9e1f-43c6-bfa5-750492dcc806 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54528e4f02c34a5abd55b1c26d88ae1b)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:21.470825 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a4281-9e1f-43c6-bfa5-750492dcc806 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:21.556260 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-85e7547b-1816-4636-9f2f-cec6e4e13604 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e104fa2d4574556aef622c74f47ed77', 'request_id': 'req-85e7547b-1816-4636-9f2f-cec6e4e13604'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:21.565797 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-85e7547b-1816-4636-9f2f-cec6e4e13604 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e104fa2d4574556aef622c74f47ed77', 'request_id': 'req-85e7547b-1816-4636-9f2f-cec6e4e13604'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:21.587883 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-85e7547b-1816-4636-9f2f-cec6e4e13604 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e104fa2d4574556aef622c74f47ed77', 'request_id': 'req-85e7547b-1816-4636-9f2f-cec6e4e13604'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:21.662852 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-2f3a4281-9e1f-43c6-bfa5-750492dcc806 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54528e4f02c34a5abd55b1c26d88ae1b', 'request_id': 'req-2f3a4281-9e1f-43c6-bfa5-750492dcc806'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:21.710426 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-85e7547b-1816-4636-9f2f-cec6e4e13604 admin admin] The token cache is being invalidate because project 2e104fa2d4574556aef622c74f47ed77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:12:21.711212 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-85e7547b-1816-4636-9f2f-cec6e4e13604 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:21.712649 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-85e7547b-1816-4636-9f2f-cec6e4e13604 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:21.715313 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 996/2031] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:12:21 2022] DELETE /identity/v3/projects/2e104fa2d4574556aef622c74f47ed77 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:12:21.723527 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c9ade-5260-4284-ab0c-ec5ac34a0210 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:21.723986 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c9ade-5260-4284-ab0c-ec5ac34a0210 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:21.724143 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c9ade-5260-4284-ab0c-ec5ac34a0210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:21.764547 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-eb8c9ade-5260-4284-ab0c-ec5ac34a0210 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:21.764547 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-eb8c9ade-5260-4284-ab0c-ec5ac34a0210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:21.902026 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 997/2032] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:12:21.917790 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41773121-6b98-4eb6-9a85-a48aabfdb089 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:21.918191 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41773121-6b98-4eb6-9a85-a48aabfdb089 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:21.918557 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41773121-6b98-4eb6-9a85-a48aabfdb089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:21.938023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-2f3a4281-9e1f-43c6-bfa5-750492dcc806 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54528e4f02c34a5abd55b1c26d88ae1b', 'request_id': 'req-2f3a4281-9e1f-43c6-bfa5-750492dcc806'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:21.938562 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:21.948031 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-41773121-6b98-4eb6-9a85-a48aabfdb089 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:21.950173 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-41773121-6b98-4eb6-9a85-a48aabfdb089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:21.950734 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-2f3a4281-9e1f-43c6-bfa5-750492dcc806 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54528e4f02c34a5abd55b1c26d88ae1b', 'request_id': 'req-2f3a4281-9e1f-43c6-bfa5-750492dcc806'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:21.966683 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 998/2033] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:12:21.974280 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41773121-6b98-4eb6-9a85-a48aabfdb089 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:21.991953 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41773121-6b98-4eb6-9a85-a48aabfdb089 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:21.993961 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-2f3a4281-9e1f-43c6-bfa5-750492dcc806 admin admin] The token cache is being invalidate because project 54528e4f02c34a5abd55b1c26d88ae1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:12:21.994601 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-2f3a4281-9e1f-43c6-bfa5-750492dcc806 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:21.995872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-2f3a4281-9e1f-43c6-bfa5-750492dcc806 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:21.998713 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d8170-5f58-46a9-b245-3fd0c29cff98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:21.999183 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1036/2034] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:12:21 2022] DELETE /identity/v3/projects/54528e4f02c34a5abd55b1c26d88ae1b => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:12:22.001364 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d8170-5f58-46a9-b245-3fd0c29cff98 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:22.001364 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d8170-5f58-46a9-b245-3fd0c29cff98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:22.001364 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d8170-5f58-46a9-b245-3fd0c29cff98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:22.001364 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d8170-5f58-46a9-b245-3fd0c29cff98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:12:22.008248 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d8170-5f58-46a9-b245-3fd0c29cff98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:22.008248 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d8170-5f58-46a9-b245-3fd0c29cff98 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:22.010521 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a4281-9e1f-43c6-bfa5-750492dcc806 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:22.012739 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-2f3a4281-9e1f-43c6-bfa5-750492dcc806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:22.036526 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 999/2035] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:12:22.038362 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a4281-9e1f-43c6-bfa5-750492dcc806 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:22.039734 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d8170-5f58-46a9-b245-3fd0c29cff98 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:22.047677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-550d8170-5f58-46a9-b245-3fd0c29cff98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:22.060383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd42ec-0f4e-457e-a63c-8d32c712941a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:22.060685 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd42ec-0f4e-457e-a63c-8d32c712941a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:22.061036 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd42ec-0f4e-457e-a63c-8d32c712941a admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:22.061409 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd42ec-0f4e-457e-a63c-8d32c712941a admin admin] PATH_INFO: `/v3/users/7a5ee373081f47c28cba1baae9908c8c` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:22.063034 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd42ec-0f4e-457e-a63c-8d32c712941a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a5ee373081f47c28cba1baae9908c8c)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:22.065477 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd42ec-0f4e-457e-a63c-8d32c712941a admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:22.073379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d8170-5f58-46a9-b245-3fd0c29cff98 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:22.079962 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec8f5f-2bf0-463e-bb26-01eb3da64faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:22.081227 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec8f5f-2bf0-463e-bb26-01eb3da64faf admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:22.081646 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec8f5f-2bf0-463e-bb26-01eb3da64faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:22.083025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec8f5f-2bf0-463e-bb26-01eb3da64faf admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:22.084828 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec8f5f-2bf0-463e-bb26-01eb3da64faf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:22.091205 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec8f5f-2bf0-463e-bb26-01eb3da64faf admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:22.107998 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:22.253053 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1000/2036] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:12:22 2022] POST /identity/v3/projects => generated 373 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:12:22.258619 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec8f5f-2bf0-463e-bb26-01eb3da64faf admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:22.368748 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec8f5f-2bf0-463e-bb26-01eb3da64faf admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:22.377180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5dbf14-2eb5-4f53-9f65-c9833dfcf943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:22.378220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5dbf14-2eb5-4f53-9f65-c9833dfcf943 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:22.378715 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5dbf14-2eb5-4f53-9f65-c9833dfcf943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:22.379614 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5dbf14-2eb5-4f53-9f65-c9833dfcf943 admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:22.381007 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5dbf14-2eb5-4f53-9f65-c9833dfcf943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:22.384599 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5dbf14-2eb5-4f53-9f65-c9833dfcf943 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:22.391461 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-c9bd42ec-0f4e-457e-a63c-8d32c712941a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a5ee373081f47c28cba1baae9908c8c'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:22.497482 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-c9bd42ec-0f4e-457e-a63c-8d32c712941a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a5ee373081f47c28cba1baae9908c8c'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:22.513310 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-c9bd42ec-0f4e-457e-a63c-8d32c712941a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a5ee373081f47c28cba1baae9908c8c'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:22.514466 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-c9bd42ec-0f4e-457e-a63c-8d32c712941a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a5ee373081f47c28cba1baae9908c8c'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:22.515503 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-c9bd42ec-0f4e-457e-a63c-8d32c712941a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a5ee373081f47c28cba1baae9908c8c'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:22.541680 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1001/2037] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:12:22 2022] POST /identity/v3/users => generated 287 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:12:22.552718 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5dbf14-2eb5-4f53-9f65-c9833dfcf943 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:22.552718 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-cc5dbf14-2eb5-4f53-9f65-c9833dfcf943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:22.553072 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1037/2038] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:12:22 2022] DELETE /identity/v3/users/7a5ee373081f47c28cba1baae9908c8c => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:12:22.562221 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5dbf14-2eb5-4f53-9f65-c9833dfcf943 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:22.665832 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b560bc0-db35-472b-ab59-f7c6bf2bbf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:22.666684 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b560bc0-db35-472b-ab59-f7c6bf2bbf61 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:22.667475 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b560bc0-db35-472b-ab59-f7c6bf2bbf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:22.667706 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b560bc0-db35-472b-ab59-f7c6bf2bbf61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:22.669727 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b560bc0-db35-472b-ab59-f7c6bf2bbf61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:22.672266 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b560bc0-db35-472b-ab59-f7c6bf2bbf61 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:22.693165 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1002/2039] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:12:22.696931 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd42ec-0f4e-457e-a63c-8d32c712941a admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:22.712666 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd42ec-0f4e-457e-a63c-8d32c712941a admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:22.720844 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafd840-2f3d-40db-b1c9-68eb11b6f0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:22.721772 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafd840-2f3d-40db-b1c9-68eb11b6f0eb admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:22.722105 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafd840-2f3d-40db-b1c9-68eb11b6f0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:22.723955 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafd840-2f3d-40db-b1c9-68eb11b6f0eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:22.724352 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beafd840-2f3d-40db-b1c9-68eb11b6f0eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:22.726851 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beafd840-2f3d-40db-b1c9-68eb11b6f0eb admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:22.742720 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1038/2040] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:12:22.748510 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b560bc0-db35-472b-ab59-f7c6bf2bbf61 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:22.770956 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b560bc0-db35-472b-ab59-f7c6bf2bbf61 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:22.779531 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3be975-7538-49ca-a70d-b402470892ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:22.780881 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3be975-7538-49ca-a70d-b402470892ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:22.781465 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3be975-7538-49ca-a70d-b402470892ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:22.781945 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3be975-7538-49ca-a70d-b402470892ec admin admin] PATH_INFO: `/v3/projects/ebb47864b5694d2e85b1d90eb2c809bc/users/75559881115047eeb72554769404ed0a/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:22.813561 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3be975-7538-49ca-a70d-b402470892ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebb47864b5694d2e85b1d90eb2c809bc, user_id=75559881115047eeb72554769404ed0a, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:22.820121 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3be975-7538-49ca-a70d-b402470892ec admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:22.943940 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1003/2041] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:12:22 2022] PUT /identity/v3/projects/ebb47864b5694d2e85b1d90eb2c809bc/users/75559881115047eeb72554769404ed0a/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:12:22.952337 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34af52-4051-4ad1-beb9-71e6b71a1748 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:22.953653 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34af52-4051-4ad1-beb9-71e6b71a1748 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:22.954736 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34af52-4051-4ad1-beb9-71e6b71a1748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:23.067451 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-4f34af52-4051-4ad1-beb9-71e6b71a1748 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:23.067451 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-4f34af52-4051-4ad1-beb9-71e6b71a1748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:23.216587 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1039/2042] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:12:23.242539 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3be975-7538-49ca-a70d-b402470892ec admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:23.250997 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-1b3be975-7538-49ca-a70d-b402470892ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:23.381299 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:23.447631 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3be975-7538-49ca-a70d-b402470892ec admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:23.455974 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c03ecb-0f73-45ba-8bb2-52eb1c603757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:23.458252 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c03ecb-0f73-45ba-8bb2-52eb1c603757 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:23.459201 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c03ecb-0f73-45ba-8bb2-52eb1c603757 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:23.459784 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c03ecb-0f73-45ba-8bb2-52eb1c603757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:23.482400 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c03ecb-0f73-45ba-8bb2-52eb1c603757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:23.485631 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c03ecb-0f73-45ba-8bb2-52eb1c603757 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:23.509928 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1004/2043] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:12:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:12:23.798629 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34af52-4051-4ad1-beb9-71e6b71a1748 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:23.802759 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-4f34af52-4051-4ad1-beb9-71e6b71a1748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:23.840652 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34af52-4051-4ad1-beb9-71e6b71a1748 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:23.868083 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde03a6-0a62-4e18-a822-9acd7aa2ac23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:23.872775 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde03a6-0a62-4e18-a822-9acd7aa2ac23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:23.873991 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde03a6-0a62-4e18-a822-9acd7aa2ac23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:23.878240 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde03a6-0a62-4e18-a822-9acd7aa2ac23 admin admin] PATH_INFO: `/v3/projects/82fbbb51116c48a1adb3a981b1920991` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:23.881264 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde03a6-0a62-4e18-a822-9acd7aa2ac23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82fbbb51116c48a1adb3a981b1920991)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:23.886974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde03a6-0a62-4e18-a822-9acd7aa2ac23 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:24.112901 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-4fde03a6-0a62-4e18-a822-9acd7aa2ac23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82fbbb51116c48a1adb3a981b1920991', 'request_id': 'req-4fde03a6-0a62-4e18-a822-9acd7aa2ac23'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:24.235746 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-4fde03a6-0a62-4e18-a822-9acd7aa2ac23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82fbbb51116c48a1adb3a981b1920991', 'request_id': 'req-4fde03a6-0a62-4e18-a822-9acd7aa2ac23'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:24.261371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-4fde03a6-0a62-4e18-a822-9acd7aa2ac23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82fbbb51116c48a1adb3a981b1920991', 'request_id': 'req-4fde03a6-0a62-4e18-a822-9acd7aa2ac23'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:24.307549 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-4fde03a6-0a62-4e18-a822-9acd7aa2ac23 admin admin] The token cache is being invalidate because project 82fbbb51116c48a1adb3a981b1920991 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:12:24.308031 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-4fde03a6-0a62-4e18-a822-9acd7aa2ac23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:24.309199 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-4fde03a6-0a62-4e18-a822-9acd7aa2ac23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:24.311646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1040/2044] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:12:23 2022] DELETE /identity/v3/projects/82fbbb51116c48a1adb3a981b1920991 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:12:24.319349 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172d337-aafd-4b3a-94d2-e30c570923cb None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:24.319708 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172d337-aafd-4b3a-94d2-e30c570923cb None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:24.320270 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172d337-aafd-4b3a-94d2-e30c570923cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:24.359311 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-d172d337-aafd-4b3a-94d2-e30c570923cb None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:24.362553 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-d172d337-aafd-4b3a-94d2-e30c570923cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:24.559313 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1005/2045] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:12:24.575229 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed0d69-f430-4002-9d0a-fc38d6135a72 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:24.576303 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed0d69-f430-4002-9d0a-fc38d6135a72 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:24.576679 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed0d69-f430-4002-9d0a-fc38d6135a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:24.617919 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-24ed0d69-f430-4002-9d0a-fc38d6135a72 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:24.620980 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-24ed0d69-f430-4002-9d0a-fc38d6135a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:24.683064 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1041/2046] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:12:24.685045 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172d337-aafd-4b3a-94d2-e30c570923cb None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:24.721133 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172d337-aafd-4b3a-94d2-e30c570923cb None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:24.746616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac261e8-b9dc-43dd-9b0c-9c67c290e93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:24.747750 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac261e8-b9dc-43dd-9b0c-9c67c290e93e admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:24.748311 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac261e8-b9dc-43dd-9b0c-9c67c290e93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:24.749353 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac261e8-b9dc-43dd-9b0c-9c67c290e93e admin admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:24.751140 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac261e8-b9dc-43dd-9b0c-9c67c290e93e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:12:24.751850 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac261e8-b9dc-43dd-9b0c-9c67c290e93e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:24.763275 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac261e8-b9dc-43dd-9b0c-9c67c290e93e admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:24.819512 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1006/2047] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:12:24.820997 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed0d69-f430-4002-9d0a-fc38d6135a72 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:24.841979 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed0d69-f430-4002-9d0a-fc38d6135a72 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:24.854821 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f77b9-d7c4-4197-8ac4-28c25ef0118a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:24.855964 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f77b9-d7c4-4197-8ac4-28c25ef0118a admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:24.856488 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f77b9-d7c4-4197-8ac4-28c25ef0118a admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:24.872098 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f77b9-d7c4-4197-8ac4-28c25ef0118a admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:24.872098 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f77b9-d7c4-4197-8ac4-28c25ef0118a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:24.872098 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f77b9-d7c4-4197-8ac4-28c25ef0118a admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:24.872098 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:25.024338 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1042/2048] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:12:24 2022] POST /identity/v3/projects => generated 387 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:12:25.029617 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac261e8-b9dc-43dd-9b0c-9c67c290e93e admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:25.045363 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac261e8-b9dc-43dd-9b0c-9c67c290e93e admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:25.141213 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2041be-9ac9-414b-8320-22bebf473296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:25.142034 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2041be-9ac9-414b-8320-22bebf473296 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:25.142497 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2041be-9ac9-414b-8320-22bebf473296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:25.142866 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2041be-9ac9-414b-8320-22bebf473296 admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:25.144287 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2041be-9ac9-414b-8320-22bebf473296 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:25.146133 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2041be-9ac9-414b-8320-22bebf473296 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:25.301992 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1007/2049] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:12:25 2022] POST /identity/v3/users => generated 294 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:12:25.305987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f77b9-d7c4-4197-8ac4-28c25ef0118a admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:25.320003 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f77b9-d7c4-4197-8ac4-28c25ef0118a admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:25.328714 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980406b1-7503-4810-b98c-1ed1db42e6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:25.332371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980406b1-7503-4810-b98c-1ed1db42e6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:25.332371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980406b1-7503-4810-b98c-1ed1db42e6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:25.332371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980406b1-7503-4810-b98c-1ed1db42e6a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:25.332938 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980406b1-7503-4810-b98c-1ed1db42e6a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:25.335130 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980406b1-7503-4810-b98c-1ed1db42e6a9 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:25.352476 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1043/2050] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:12:25.355153 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2041be-9ac9-414b-8320-22bebf473296 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:25.371526 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2041be-9ac9-414b-8320-22bebf473296 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:25.379973 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3e074-86a1-41d5-b95a-54761762f7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:25.381032 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3e074-86a1-41d5-b95a-54761762f7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:25.387864 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3e074-86a1-41d5-b95a-54761762f7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:25.387864 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3e074-86a1-41d5-b95a-54761762f7b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:25.387864 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3e074-86a1-41d5-b95a-54761762f7b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:25.387864 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3e074-86a1-41d5-b95a-54761762f7b0 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:25.403485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1008/2051] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:12:25.410503 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980406b1-7503-4810-b98c-1ed1db42e6a9 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:25.433863 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980406b1-7503-4810-b98c-1ed1db42e6a9 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:25.443796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776bdb9-f98c-4238-a5f8-efa7f3e31c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:25.444628 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776bdb9-f98c-4238-a5f8-efa7f3e31c01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:25.445604 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776bdb9-f98c-4238-a5f8-efa7f3e31c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:25.445798 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776bdb9-f98c-4238-a5f8-efa7f3e31c01 admin admin] PATH_INFO: `/v3/projects/d148dee01f86457db80f4bb5128ba91b/users/4dd044689b834ab7a6b670bb8fc1285f/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:25.481512 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4776bdb9-f98c-4238-a5f8-efa7f3e31c01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d148dee01f86457db80f4bb5128ba91b, user_id=4dd044689b834ab7a6b670bb8fc1285f, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:25.488874 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4776bdb9-f98c-4238-a5f8-efa7f3e31c01 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:25.716951 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1044/2052] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:12:25 2022] PUT /identity/v3/projects/d148dee01f86457db80f4bb5128ba91b/users/4dd044689b834ab7a6b670bb8fc1285f/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:12:25.733049 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8502da9-4c57-43a3-a11e-ee203cbfa24c None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:25.733049 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8502da9-4c57-43a3-a11e-ee203cbfa24c None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:25.733049 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8502da9-4c57-43a3-a11e-ee203cbfa24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:25.775770 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-e8502da9-4c57-43a3-a11e-ee203cbfa24c None None] MFA Rules not processed for user `4dd044689b834ab7a6b670bb8fc1285f`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:25.778310 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-e8502da9-4c57-43a3-a11e-ee203cbfa24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:25.817450 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:25.896682 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1009/2053] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:12:25.902040 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776bdb9-f98c-4238-a5f8-efa7f3e31c01 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:26.010041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776bdb9-f98c-4238-a5f8-efa7f3e31c01 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:26.021247 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58d8ed-725a-4972-bf33-724ed49c1bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:26.022462 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58d8ed-725a-4972-bf33-724ed49c1bab admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:26.023066 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58d8ed-725a-4972-bf33-724ed49c1bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:26.023489 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58d8ed-725a-4972-bf33-724ed49c1bab admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:26.025733 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58d8ed-725a-4972-bf33-724ed49c1bab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:26.029308 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58d8ed-725a-4972-bf33-724ed49c1bab admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:26.184447 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1045/2054] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:12:25 2022] POST /identity/v3/projects => generated 385 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:12:26.185292 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8502da9-4c57-43a3-a11e-ee203cbfa24c None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:26.206815 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8502da9-4c57-43a3-a11e-ee203cbfa24c None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:26.310298 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d685a-5a35-46f7-8a86-9d0fd11c36b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:26.311139 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d685a-5a35-46f7-8a86-9d0fd11c36b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:26.311486 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d685a-5a35-46f7-8a86-9d0fd11c36b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:26.311855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d685a-5a35-46f7-8a86-9d0fd11c36b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:26.313012 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d685a-5a35-46f7-8a86-9d0fd11c36b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:26.314925 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d685a-5a35-46f7-8a86-9d0fd11c36b2 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:26.481600 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1010/2055] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:12:26 2022] POST /identity/v3/users => generated 299 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:12:26.488306 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58d8ed-725a-4972-bf33-724ed49c1bab admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:26.510627 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58d8ed-725a-4972-bf33-724ed49c1bab admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:26.523782 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7bd85-6a33-40ae-9a6a-3d0cd43c655a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:26.525736 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7bd85-6a33-40ae-9a6a-3d0cd43c655a admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:26.526180 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7bd85-6a33-40ae-9a6a-3d0cd43c655a admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:26.526639 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7bd85-6a33-40ae-9a6a-3d0cd43c655a admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:26.527655 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7bd85-6a33-40ae-9a6a-3d0cd43c655a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:26.529987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7bd85-6a33-40ae-9a6a-3d0cd43c655a admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:26.549086 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1046/2056] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:12:26.554993 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d685a-5a35-46f7-8a86-9d0fd11c36b2 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:26.568686 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d685a-5a35-46f7-8a86-9d0fd11c36b2 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:26.576545 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723fcac2-9eb7-4988-a812-dbab58eb581d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:26.577792 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723fcac2-9eb7-4988-a812-dbab58eb581d admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:26.578165 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723fcac2-9eb7-4988-a812-dbab58eb581d admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:26.578556 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723fcac2-9eb7-4988-a812-dbab58eb581d admin admin] PATH_INFO: `/v3/projects/c735ff08a0a8404d9162afc2b7c24c81/users/a92c7f1525a3400fb0d4bbc165c60b76/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:26.606006 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723fcac2-9eb7-4988-a812-dbab58eb581d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c735ff08a0a8404d9162afc2b7c24c81, user_id=a92c7f1525a3400fb0d4bbc165c60b76, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:26.611136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723fcac2-9eb7-4988-a812-dbab58eb581d admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:26.769644 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1011/2057] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:12:26 2022] PUT /identity/v3/projects/c735ff08a0a8404d9162afc2b7c24c81/users/a92c7f1525a3400fb0d4bbc165c60b76/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:12:26.778461 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7bd85-6a33-40ae-9a6a-3d0cd43c655a admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:26.793919 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7bd85-6a33-40ae-9a6a-3d0cd43c655a admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:26.897841 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2768fc-e16c-4de4-a180-d01fbb971ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:26.898846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2768fc-e16c-4de4-a180-d01fbb971ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:26.899342 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2768fc-e16c-4de4-a180-d01fbb971ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:26.899784 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2768fc-e16c-4de4-a180-d01fbb971ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:26.900567 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2768fc-e16c-4de4-a180-d01fbb971ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:26.902325 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2768fc-e16c-4de4-a180-d01fbb971ae8 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:26.915860 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1047/2058] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:12:26.927412 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723fcac2-9eb7-4988-a812-dbab58eb581d admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:26.949799 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723fcac2-9eb7-4988-a812-dbab58eb581d admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:26.958716 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfd245-0ac4-4395-8383-598ab0a290bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:26.959844 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfd245-0ac4-4395-8383-598ab0a290bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:26.960530 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfd245-0ac4-4395-8383-598ab0a290bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:26.960828 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfd245-0ac4-4395-8383-598ab0a290bf admin admin] PATH_INFO: `/v3/projects/c735ff08a0a8404d9162afc2b7c24c81/users/a92c7f1525a3400fb0d4bbc165c60b76/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:26.965799 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dfd245-0ac4-4395-8383-598ab0a290bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c735ff08a0a8404d9162afc2b7c24c81, user_id=a92c7f1525a3400fb0d4bbc165c60b76, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:26.970444 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dfd245-0ac4-4395-8383-598ab0a290bf admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:26.994661 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1012/2059] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:12:26 2022] PUT /identity/v3/projects/c735ff08a0a8404d9162afc2b7c24c81/users/a92c7f1525a3400fb0d4bbc165c60b76/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:12:27.016055 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a6ed9-482d-49ea-bad5-1137d5bad0f4 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:27.016661 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a6ed9-482d-49ea-bad5-1137d5bad0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:27.017313 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a6ed9-482d-49ea-bad5-1137d5bad0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:27.071195 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-925a6ed9-482d-49ea-bad5-1137d5bad0f4 None None] MFA Rules not processed for user `a92c7f1525a3400fb0d4bbc165c60b76`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:27.073198 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-925a6ed9-482d-49ea-bad5-1137d5bad0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:27.093488 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:27.211788 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1048/2060] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:27 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:12:27.232923 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfd245-0ac4-4395-8383-598ab0a290bf admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:27.235982 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-68dfd245-0ac4-4395-8383-598ab0a290bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:27.389176 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfd245-0ac4-4395-8383-598ab0a290bf admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:27.397799 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66630d5-fd90-4687-b28a-59b41f1bae0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:27.399231 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66630d5-fd90-4687-b28a-59b41f1bae0e service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:27.399837 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66630d5-fd90-4687-b28a-59b41f1bae0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:27.400687 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66630d5-fd90-4687-b28a-59b41f1bae0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:27.419601 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66630d5-fd90-4687-b28a-59b41f1bae0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:27.422611 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66630d5-fd90-4687-b28a-59b41f1bae0e service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:27.445182 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1013/2061] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:12:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:12:31.139175 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a6ed9-482d-49ea-bad5-1137d5bad0f4 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:31.383033 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a6ed9-482d-49ea-bad5-1137d5bad0f4 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:31.414673 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22497d1f-cf0c-4bc1-9297-602722ab6651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:31.416000 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22497d1f-cf0c-4bc1-9297-602722ab6651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:31.416484 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22497d1f-cf0c-4bc1-9297-602722ab6651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:31.416790 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22497d1f-cf0c-4bc1-9297-602722ab6651 admin admin] PATH_INFO: `/v3/users/4dd044689b834ab7a6b670bb8fc1285f` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:31.420069 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22497d1f-cf0c-4bc1-9297-602722ab6651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dd044689b834ab7a6b670bb8fc1285f)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:31.430074 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22497d1f-cf0c-4bc1-9297-602722ab6651 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:31.917955 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-22497d1f-cf0c-4bc1-9297-602722ab6651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dd044689b834ab7a6b670bb8fc1285f'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:32.038237 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-22497d1f-cf0c-4bc1-9297-602722ab6651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dd044689b834ab7a6b670bb8fc1285f'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:32.056755 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-22497d1f-cf0c-4bc1-9297-602722ab6651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dd044689b834ab7a6b670bb8fc1285f'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:32.057878 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-22497d1f-cf0c-4bc1-9297-602722ab6651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dd044689b834ab7a6b670bb8fc1285f'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:32.061035 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-22497d1f-cf0c-4bc1-9297-602722ab6651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dd044689b834ab7a6b670bb8fc1285f'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:32.092938 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1049/2062] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:12:31 2022] DELETE /identity/v3/users/4dd044689b834ab7a6b670bb8fc1285f => generated 0 bytes in 955 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:12:32.098917 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e06b0-5ce8-45bf-ba45-b71219ef30cf None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:32.099743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e06b0-5ce8-45bf-ba45-b71219ef30cf None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:32.099743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e06b0-5ce8-45bf-ba45-b71219ef30cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:32.133136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-a61e06b0-5ce8-45bf-ba45-b71219ef30cf None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:32.135569 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-a61e06b0-5ce8-45bf-ba45-b71219ef30cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:32.162477 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:32.267133 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1014/2063] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:12:32.279863 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22497d1f-cf0c-4bc1-9297-602722ab6651 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:32.282113 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-22497d1f-cf0c-4bc1-9297-602722ab6651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:32.359089 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:32.445857 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22497d1f-cf0c-4bc1-9297-602722ab6651 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:32.461516 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7496db-e789-4d9b-8435-864ab7d48c05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:32.462637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7496db-e789-4d9b-8435-864ab7d48c05 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:32.463135 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7496db-e789-4d9b-8435-864ab7d48c05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:32.463628 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7496db-e789-4d9b-8435-864ab7d48c05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:32.507334 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7496db-e789-4d9b-8435-864ab7d48c05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:32.510894 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7496db-e789-4d9b-8435-864ab7d48c05 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:32.548122 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1050/2064] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:12:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:12:33.693927 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e06b0-5ce8-45bf-ba45-b71219ef30cf None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:33.694929 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-a61e06b0-5ce8-45bf-ba45-b71219ef30cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:33.727920 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e06b0-5ce8-45bf-ba45-b71219ef30cf None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:33.734928 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a706c1-aafe-4122-aca4-a67c9dd37ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:33.736441 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a706c1-aafe-4122-aca4-a67c9dd37ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:33.736965 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a706c1-aafe-4122-aca4-a67c9dd37ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:33.737531 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a706c1-aafe-4122-aca4-a67c9dd37ea0 admin admin] PATH_INFO: `/v3/projects/d148dee01f86457db80f4bb5128ba91b` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:33.739409 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a706c1-aafe-4122-aca4-a67c9dd37ea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d148dee01f86457db80f4bb5128ba91b)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:33.742640 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a706c1-aafe-4122-aca4-a67c9dd37ea0 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:34.052612 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-70a706c1-aafe-4122-aca4-a67c9dd37ea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd148dee01f86457db80f4bb5128ba91b', 'request_id': 'req-70a706c1-aafe-4122-aca4-a67c9dd37ea0'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:34.077416 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-70a706c1-aafe-4122-aca4-a67c9dd37ea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd148dee01f86457db80f4bb5128ba91b', 'request_id': 'req-70a706c1-aafe-4122-aca4-a67c9dd37ea0'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:34.102591 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-70a706c1-aafe-4122-aca4-a67c9dd37ea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd148dee01f86457db80f4bb5128ba91b', 'request_id': 'req-70a706c1-aafe-4122-aca4-a67c9dd37ea0'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:34.267598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-70a706c1-aafe-4122-aca4-a67c9dd37ea0 admin admin] The token cache is being invalidate because project d148dee01f86457db80f4bb5128ba91b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:12:34.268792 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-70a706c1-aafe-4122-aca4-a67c9dd37ea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:34.270565 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-70a706c1-aafe-4122-aca4-a67c9dd37ea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:34.295691 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1015/2065] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:12:33 2022] DELETE /identity/v3/projects/d148dee01f86457db80f4bb5128ba91b => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:12:34.302836 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7496db-e789-4d9b-8435-864ab7d48c05 service neutron] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:34.351332 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7496db-e789-4d9b-8435-864ab7d48c05 service neutron] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:34.496574 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9a241-02f9-4124-ad66-d93e26ac3b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:34.497880 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9a241-02f9-4124-ad66-d93e26ac3b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:34.501076 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9a241-02f9-4124-ad66-d93e26ac3b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:34.501515 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9a241-02f9-4124-ad66-d93e26ac3b1b admin admin] PATH_INFO: `/v3/users/a92c7f1525a3400fb0d4bbc165c60b76` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:34.504659 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9a241-02f9-4124-ad66-d93e26ac3b1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a92c7f1525a3400fb0d4bbc165c60b76)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:34.507077 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9a241-02f9-4124-ad66-d93e26ac3b1b admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:34.947638 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-30e9a241-02f9-4124-ad66-d93e26ac3b1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a92c7f1525a3400fb0d4bbc165c60b76'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:35.084440 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-30e9a241-02f9-4124-ad66-d93e26ac3b1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a92c7f1525a3400fb0d4bbc165c60b76'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:35.127394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-30e9a241-02f9-4124-ad66-d93e26ac3b1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a92c7f1525a3400fb0d4bbc165c60b76'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:35.130842 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-30e9a241-02f9-4124-ad66-d93e26ac3b1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a92c7f1525a3400fb0d4bbc165c60b76'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:35.130842 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-30e9a241-02f9-4124-ad66-d93e26ac3b1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a92c7f1525a3400fb0d4bbc165c60b76'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:35.186057 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1051/2066] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:12:34 2022] DELETE /identity/v3/users/a92c7f1525a3400fb0d4bbc165c60b76 => generated 0 bytes in 862 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:12:36.146184 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a706c1-aafe-4122-aca4-a67c9dd37ea0 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:36.148920 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-70a706c1-aafe-4122-aca4-a67c9dd37ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:36.176396 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a706c1-aafe-4122-aca4-a67c9dd37ea0 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:36.219363 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078a4e8-e8e4-4b31-b7f6-4e02fd41ec8c None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:36.220187 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078a4e8-e8e4-4b31-b7f6-4e02fd41ec8c None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:36.220760 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078a4e8-e8e4-4b31-b7f6-4e02fd41ec8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:36.269426 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3251a-b22a-42da-82bb-fb91d0cfb121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:36.270647 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3251a-b22a-42da-82bb-fb91d0cfb121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:36.271098 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3251a-b22a-42da-82bb-fb91d0cfb121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:36.271635 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3251a-b22a-42da-82bb-fb91d0cfb121 admin admin] PATH_INFO: `/v3/projects/c735ff08a0a8404d9162afc2b7c24c81` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:36.277363 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3251a-b22a-42da-82bb-fb91d0cfb121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c735ff08a0a8404d9162afc2b7c24c81)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:36.280974 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3251a-b22a-42da-82bb-fb91d0cfb121 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:36.323168 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-9078a4e8-e8e4-4b31-b7f6-4e02fd41ec8c None None] MFA Rules not processed for user `75559881115047eeb72554769404ed0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:36.326099 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-9078a4e8-e8e4-4b31-b7f6-4e02fd41ec8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:36.415766 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:36.458822 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1052/2067] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:12:36.467151 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078a4e8-e8e4-4b31-b7f6-4e02fd41ec8c None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:36.469862 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-9078a4e8-e8e4-4b31-b7f6-4e02fd41ec8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:36.470084 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:36.476342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-d7d3251a-b22a-42da-82bb-fb91d0cfb121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c735ff08a0a8404d9162afc2b7c24c81', 'request_id': 'req-d7d3251a-b22a-42da-82bb-fb91d0cfb121'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:36.484743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-d7d3251a-b22a-42da-82bb-fb91d0cfb121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c735ff08a0a8404d9162afc2b7c24c81', 'request_id': 'req-d7d3251a-b22a-42da-82bb-fb91d0cfb121'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:36.493892 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-d7d3251a-b22a-42da-82bb-fb91d0cfb121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c735ff08a0a8404d9162afc2b7c24c81', 'request_id': 'req-d7d3251a-b22a-42da-82bb-fb91d0cfb121'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:36.496660 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078a4e8-e8e4-4b31-b7f6-4e02fd41ec8c None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:36.633870 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-d7d3251a-b22a-42da-82bb-fb91d0cfb121 admin admin] The token cache is being invalidate because project c735ff08a0a8404d9162afc2b7c24c81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:12:36.634808 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-d7d3251a-b22a-42da-82bb-fb91d0cfb121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:36.636266 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-d7d3251a-b22a-42da-82bb-fb91d0cfb121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:36.644500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1016/2068] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:12:36 2022] DELETE /identity/v3/projects/c735ff08a0a8404d9162afc2b7c24c81 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:12:36.648432 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b68944-da63-485e-91a2-6e19c99a7d9c None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:36.648818 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b68944-da63-485e-91a2-6e19c99a7d9c None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:36.649166 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b68944-da63-485e-91a2-6e19c99a7d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:36.651948 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39461856-05c2-4bf2-9224-eb631cafe98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:36.653408 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39461856-05c2-4bf2-9224-eb631cafe98a admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:36.654329 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39461856-05c2-4bf2-9224-eb631cafe98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:36.655124 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39461856-05c2-4bf2-9224-eb631cafe98a admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:36.657523 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39461856-05c2-4bf2-9224-eb631cafe98a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:36.662543 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39461856-05c2-4bf2-9224-eb631cafe98a admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:36.677845 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-89b68944-da63-485e-91a2-6e19c99a7d9c None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:36.680585 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-89b68944-da63-485e-91a2-6e19c99a7d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:36.699990 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1017/2069] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:12:36.711004 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441dc78-2de8-47a8-8e8c-bf6c2f5647ca None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:36.711347 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441dc78-2de8-47a8-8e8c-bf6c2f5647ca None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:36.711633 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441dc78-2de8-47a8-8e8c-bf6c2f5647ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:36.739091 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-1441dc78-2de8-47a8-8e8c-bf6c2f5647ca None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:36.740453 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-1441dc78-2de8-47a8-8e8c-bf6c2f5647ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:36.751174 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1018/2070] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:12:36.755922 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441dc78-2de8-47a8-8e8c-bf6c2f5647ca None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:36.766985 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441dc78-2de8-47a8-8e8c-bf6c2f5647ca None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:36.773381 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12721c69-dd51-457d-9e97-cb50170f5798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:36.774003 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12721c69-dd51-457d-9e97-cb50170f5798 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:36.774295 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12721c69-dd51-457d-9e97-cb50170f5798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:36.774573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12721c69-dd51-457d-9e97-cb50170f5798 admin admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:36.775403 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12721c69-dd51-457d-9e97-cb50170f5798 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:12:36.775828 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12721c69-dd51-457d-9e97-cb50170f5798 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:36.777547 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12721c69-dd51-457d-9e97-cb50170f5798 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:36.804402 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1019/2071] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:12:36.807384 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1053/2072] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:12:36 2022] POST /identity/v3/projects => generated 371 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:12:36.809018 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12721c69-dd51-457d-9e97-cb50170f5798 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:36.809235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39461856-05c2-4bf2-9224-eb631cafe98a admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:36.812818 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-12721c69-dd51-457d-9e97-cb50170f5798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:36.865570 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12721c69-dd51-457d-9e97-cb50170f5798 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:37.044230 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39461856-05c2-4bf2-9224-eb631cafe98a admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:37.062284 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98103d-09c6-4945-a9e2-f029f63ad868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:37.063123 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98103d-09c6-4945-a9e2-f029f63ad868 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:37.063551 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98103d-09c6-4945-a9e2-f029f63ad868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:37.063966 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98103d-09c6-4945-a9e2-f029f63ad868 admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:37.065235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98103d-09c6-4945-a9e2-f029f63ad868 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:37.074734 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98103d-09c6-4945-a9e2-f029f63ad868 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:37.078527 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e898240-da9f-4eba-b72b-735b204afeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:37.080805 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e898240-da9f-4eba-b72b-735b204afeeb admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:37.082089 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e898240-da9f-4eba-b72b-735b204afeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:37.082596 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e898240-da9f-4eba-b72b-735b204afeeb admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:37.083955 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e898240-da9f-4eba-b72b-735b204afeeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:37.091886 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e898240-da9f-4eba-b72b-735b204afeeb admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:37.261367 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1020/2073] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:12:36 2022] POST /identity/v3/users => generated 292 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:12:37.263787 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e898240-da9f-4eba-b72b-735b204afeeb admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:37.296067 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e898240-da9f-4eba-b72b-735b204afeeb admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:37.299720 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1054/2074] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:12:36 2022] POST /identity/v3/projects => generated 383 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:12:37.305337 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98103d-09c6-4945-a9e2-f029f63ad868 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:37.430608 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:37.467152 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98103d-09c6-4945-a9e2-f029f63ad868 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:37.469283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87daa7af-0ba3-4106-b903-080d543c9b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:37.470412 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daa7af-0ba3-4106-b903-080d543c9b1a admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:37.470889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daa7af-0ba3-4106-b903-080d543c9b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:37.471362 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daa7af-0ba3-4106-b903-080d543c9b1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:37.472943 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87daa7af-0ba3-4106-b903-080d543c9b1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:37.476327 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca53b0-24ed-45a9-a643-925b6dfae016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:37.477792 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87daa7af-0ba3-4106-b903-080d543c9b1a admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:37.477954 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca53b0-24ed-45a9-a643-925b6dfae016 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:37.478464 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca53b0-24ed-45a9-a643-925b6dfae016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:37.479136 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca53b0-24ed-45a9-a643-925b6dfae016 admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:37.480525 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca53b0-24ed-45a9-a643-925b6dfae016 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:37.485993 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca53b0-24ed-45a9-a643-925b6dfae016 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:37.501812 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1021/2075] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:12:37.508367 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87daa7af-0ba3-4106-b903-080d543c9b1a admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:37.525687 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87daa7af-0ba3-4106-b903-080d543c9b1a admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:37.532301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093c4e0-3f83-487f-983e-f72634133063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:37.533200 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093c4e0-3f83-487f-983e-f72634133063 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:37.533605 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093c4e0-3f83-487f-983e-f72634133063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:37.534022 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093c4e0-3f83-487f-983e-f72634133063 admin admin] PATH_INFO: `/v3/projects/271cb94f2b0941559c3a9011a2b58969/users/6a168d8fd2ad41c999c604dbca97ce80/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:37.558591 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1093c4e0-3f83-487f-983e-f72634133063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=271cb94f2b0941559c3a9011a2b58969, user_id=6a168d8fd2ad41c999c604dbca97ce80, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:37.562922 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1093c4e0-3f83-487f-983e-f72634133063 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:37.656144 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1055/2076] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:12:37 2022] POST /identity/v3/users => generated 292 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:12:37.662593 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca53b0-24ed-45a9-a643-925b6dfae016 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:37.679434 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca53b0-24ed-45a9-a643-925b6dfae016 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:37.681429 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1022/2077] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:12:37 2022] PUT /identity/v3/projects/271cb94f2b0941559c3a9011a2b58969/users/6a168d8fd2ad41c999c604dbca97ce80/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:12:37.685627 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093c4e0-3f83-487f-983e-f72634133063 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:37.710472 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:37.771807 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f01c8-9754-4c33-8c6a-8920d4710858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:37.772955 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f01c8-9754-4c33-8c6a-8920d4710858 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:37.773617 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f01c8-9754-4c33-8c6a-8920d4710858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:37.773896 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f01c8-9754-4c33-8c6a-8920d4710858 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:37.774982 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f01c8-9754-4c33-8c6a-8920d4710858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:37.777740 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f01c8-9754-4c33-8c6a-8920d4710858 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:37.789478 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093c4e0-3f83-487f-983e-f72634133063 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:37.795281 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44d264-1f5c-4007-86e5-911d3b797964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:37.796030 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44d264-1f5c-4007-86e5-911d3b797964 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:37.799762 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1056/2078] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:12:37.800629 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44d264-1f5c-4007-86e5-911d3b797964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:37.800629 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44d264-1f5c-4007-86e5-911d3b797964 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:37.800629 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44d264-1f5c-4007-86e5-911d3b797964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:37.800629 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44d264-1f5c-4007-86e5-911d3b797964 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:37.802381 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f01c8-9754-4c33-8c6a-8920d4710858 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:37.814234 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1023/2079] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:12:37.820830 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f01c8-9754-4c33-8c6a-8920d4710858 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:37.826665 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44d264-1f5c-4007-86e5-911d3b797964 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:37.829606 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096db02e-91f6-4d55-b348-cd0ad40c146b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:37.830262 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096db02e-91f6-4d55-b348-cd0ad40c146b admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:37.830548 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096db02e-91f6-4d55-b348-cd0ad40c146b admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:37.830827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096db02e-91f6-4d55-b348-cd0ad40c146b admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:37.833207 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096db02e-91f6-4d55-b348-cd0ad40c146b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:37.835217 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096db02e-91f6-4d55-b348-cd0ad40c146b admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:37.840198 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44d264-1f5c-4007-86e5-911d3b797964 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:37.848886 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1057/2080] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:12:37.851920 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6d369-42f8-4846-b180-149b5b55f88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:37.853007 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6d369-42f8-4846-b180-149b5b55f88e admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:37.857843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6d369-42f8-4846-b180-149b5b55f88e admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:37.857843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6d369-42f8-4846-b180-149b5b55f88e admin admin] PATH_INFO: `/v3/projects/271cb94f2b0941559c3a9011a2b58969/users/6a168d8fd2ad41c999c604dbca97ce80/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:37.857843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6d369-42f8-4846-b180-149b5b55f88e admin admin] RBAC: Authorizing `identity:create_grant(project_id=271cb94f2b0941559c3a9011a2b58969, user_id=6a168d8fd2ad41c999c604dbca97ce80, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:37.859914 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6d369-42f8-4846-b180-149b5b55f88e admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:37.861236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096db02e-91f6-4d55-b348-cd0ad40c146b admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:37.873617 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096db02e-91f6-4d55-b348-cd0ad40c146b admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:37.880325 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1024/2081] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:12:37 2022] PUT /identity/v3/projects/271cb94f2b0941559c3a9011a2b58969/users/6a168d8fd2ad41c999c604dbca97ce80/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:12:37.954589 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652a5aa-d1bc-4240-9f75-1cb0f47c3d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:37.955555 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652a5aa-d1bc-4240-9f75-1cb0f47c3d99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:37.955929 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652a5aa-d1bc-4240-9f75-1cb0f47c3d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:37.956371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652a5aa-d1bc-4240-9f75-1cb0f47c3d99 admin admin] PATH_INFO: `/v3/projects/01e249b1563f457aa0bbf22311ec3450/users/221e02c06e7d490f94d989c6d532cfde/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:37.995434 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652a5aa-d1bc-4240-9f75-1cb0f47c3d99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01e249b1563f457aa0bbf22311ec3450, user_id=221e02c06e7d490f94d989c6d532cfde, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:37.999748 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652a5aa-d1bc-4240-9f75-1cb0f47c3d99 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:38.157068 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1058/2082] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:12:37 2022] PUT /identity/v3/projects/01e249b1563f457aa0bbf22311ec3450/users/221e02c06e7d490f94d989c6d532cfde/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:12:38.157729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb841bea-138f-4550-a739-3ef424a9f38d None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:38.158021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb841bea-138f-4550-a739-3ef424a9f38d None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:38.158297 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb841bea-138f-4550-a739-3ef424a9f38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:38.194747 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-fb841bea-138f-4550-a739-3ef424a9f38d None None] MFA Rules not processed for user `221e02c06e7d490f94d989c6d532cfde`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:38.196069 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-fb841bea-138f-4550-a739-3ef424a9f38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:38.276598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1025/2083] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:12:38.281187 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652a5aa-d1bc-4240-9f75-1cb0f47c3d99 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:38.355890 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:38.379256 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652a5aa-d1bc-4240-9f75-1cb0f47c3d99 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:38.385238 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79439361-f869-43c4-9bcc-34dfc6eb7fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:38.386413 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79439361-f869-43c4-9bcc-34dfc6eb7fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:38.387358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79439361-f869-43c4-9bcc-34dfc6eb7fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:38.388258 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79439361-f869-43c4-9bcc-34dfc6eb7fe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:38.389808 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79439361-f869-43c4-9bcc-34dfc6eb7fe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:38.391961 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79439361-f869-43c4-9bcc-34dfc6eb7fe3 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:38.540201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1059/2084] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:12:38 2022] POST /identity/v3/projects => generated 385 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:12:38.546955 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb841bea-138f-4550-a739-3ef424a9f38d None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:38.583586 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb841bea-138f-4550-a739-3ef424a9f38d None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:38.715280 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934da767-764c-4c78-9cc7-6421d31cafe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:38.715745 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934da767-764c-4c78-9cc7-6421d31cafe0 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:38.716032 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934da767-764c-4c78-9cc7-6421d31cafe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:38.716378 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934da767-764c-4c78-9cc7-6421d31cafe0 admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:38.717114 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934da767-764c-4c78-9cc7-6421d31cafe0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:38.720544 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934da767-764c-4c78-9cc7-6421d31cafe0 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:38.822799 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1026/2085] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:12:38 2022] POST /identity/v3/users => generated 299 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:12:38.824933 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79439361-f869-43c4-9bcc-34dfc6eb7fe3 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:38.845833 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79439361-f869-43c4-9bcc-34dfc6eb7fe3 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:38.855161 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d895d-7151-4809-848a-dd090e8fd5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:38.856391 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d895d-7151-4809-848a-dd090e8fd5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:38.856759 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d895d-7151-4809-848a-dd090e8fd5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:38.857250 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d895d-7151-4809-848a-dd090e8fd5c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:38.858554 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d895d-7151-4809-848a-dd090e8fd5c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:38.861789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d895d-7151-4809-848a-dd090e8fd5c1 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:38.881687 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1060/2086] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:12:38.887002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934da767-764c-4c78-9cc7-6421d31cafe0 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:38.906355 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934da767-764c-4c78-9cc7-6421d31cafe0 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:38.912592 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff17a99-a17d-447d-83b6-d38fc52f58f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:38.913795 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff17a99-a17d-447d-83b6-d38fc52f58f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:38.914177 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff17a99-a17d-447d-83b6-d38fc52f58f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:38.914518 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff17a99-a17d-447d-83b6-d38fc52f58f9 admin admin] PATH_INFO: `/v3/projects/c188e72b936744a58c95aaa593e5d4cb/users/b4963ba170db4e26916c560e3f99a4e9/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:38.928315 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:38.943643 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff17a99-a17d-447d-83b6-d38fc52f58f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c188e72b936744a58c95aaa593e5d4cb, user_id=b4963ba170db4e26916c560e3f99a4e9, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:38.949475 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff17a99-a17d-447d-83b6-d38fc52f58f9 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:39.056920 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1027/2087] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:12:38 2022] PUT /identity/v3/projects/c188e72b936744a58c95aaa593e5d4cb/users/b4963ba170db4e26916c560e3f99a4e9/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:12:39.059143 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d895d-7151-4809-848a-dd090e8fd5c1 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:39.080400 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d895d-7151-4809-848a-dd090e8fd5c1 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:39.171877 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a718c-fde0-470c-8aea-78305931a003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:39.172828 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a718c-fde0-470c-8aea-78305931a003 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:39.173119 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a718c-fde0-470c-8aea-78305931a003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:39.173481 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a718c-fde0-470c-8aea-78305931a003 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:39.174391 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a718c-fde0-470c-8aea-78305931a003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:39.176473 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a718c-fde0-470c-8aea-78305931a003 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:39.189563 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1061/2088] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:12:39.196988 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff17a99-a17d-447d-83b6-d38fc52f58f9 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:39.217115 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff17a99-a17d-447d-83b6-d38fc52f58f9 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:39.227765 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a0a6d-eca8-4942-a791-701bc103172d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:39.229030 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a0a6d-eca8-4942-a791-701bc103172d admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:39.229569 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a0a6d-eca8-4942-a791-701bc103172d admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:39.230085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a0a6d-eca8-4942-a791-701bc103172d admin admin] PATH_INFO: `/v3/projects/c188e72b936744a58c95aaa593e5d4cb/users/b4963ba170db4e26916c560e3f99a4e9/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:39.234313 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a0a6d-eca8-4942-a791-701bc103172d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c188e72b936744a58c95aaa593e5d4cb, user_id=b4963ba170db4e26916c560e3f99a4e9, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:39.253796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a0a6d-eca8-4942-a791-701bc103172d admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:39.340626 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1028/2089] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:12:39 2022] PUT /identity/v3/projects/c188e72b936744a58c95aaa593e5d4cb/users/b4963ba170db4e26916c560e3f99a4e9/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:12:39.357559 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8353329-db18-4060-b570-ae03d677056b None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:39.359081 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8353329-db18-4060-b570-ae03d677056b None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:39.360013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8353329-db18-4060-b570-ae03d677056b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:39.426323 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-a8353329-db18-4060-b570-ae03d677056b None None] MFA Rules not processed for user `b4963ba170db4e26916c560e3f99a4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:39.428777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-a8353329-db18-4060-b570-ae03d677056b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:39.650367 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1062/2090] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:39 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:12:39.668641 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a0a6d-eca8-4942-a791-701bc103172d admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:39.671514 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-bd5a0a6d-eca8-4942-a791-701bc103172d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:39.817868 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a0a6d-eca8-4942-a791-701bc103172d admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:39.822859 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb87be-bef6-4dda-9e09-24ac8dfc7afd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:39.824637 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb87be-bef6-4dda-9e09-24ac8dfc7afd service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:39.825654 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb87be-bef6-4dda-9e09-24ac8dfc7afd service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:39.826247 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb87be-bef6-4dda-9e09-24ac8dfc7afd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:40.083551 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb87be-bef6-4dda-9e09-24ac8dfc7afd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:40.084649 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb87be-bef6-4dda-9e09-24ac8dfc7afd service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:40.118219 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1029/2091] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:12:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:12:47.308614 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8353329-db18-4060-b570-ae03d677056b None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:47.308614 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-a8353329-db18-4060-b570-ae03d677056b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:47.404751 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:47.453183 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8353329-db18-4060-b570-ae03d677056b None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:47.466535 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ecdb6b-1242-4310-996e-bc86cdabf19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:47.467336 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecdb6b-1242-4310-996e-bc86cdabf19b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:47.470590 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecdb6b-1242-4310-996e-bc86cdabf19b admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:47.470977 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecdb6b-1242-4310-996e-bc86cdabf19b admin admin] PATH_INFO: `/v3/users/baedd061340740fc89f75a3e4a7629bd` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:47.478249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ecdb6b-1242-4310-996e-bc86cdabf19b admin admin] RBAC: Authorizing `identity:delete_user(user_id=baedd061340740fc89f75a3e4a7629bd)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:47.491204 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ecdb6b-1242-4310-996e-bc86cdabf19b admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:47.767185 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-a5ecdb6b-1242-4310-996e-bc86cdabf19b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baedd061340740fc89f75a3e4a7629bd'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:47.925295 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-a5ecdb6b-1242-4310-996e-bc86cdabf19b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baedd061340740fc89f75a3e4a7629bd'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:47.932439 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-a5ecdb6b-1242-4310-996e-bc86cdabf19b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baedd061340740fc89f75a3e4a7629bd'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:47.937994 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-a5ecdb6b-1242-4310-996e-bc86cdabf19b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baedd061340740fc89f75a3e4a7629bd'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:47.942975 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-a5ecdb6b-1242-4310-996e-bc86cdabf19b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baedd061340740fc89f75a3e4a7629bd'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:48.034228 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1063/2092] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:12:47 2022] DELETE /identity/v3/users/baedd061340740fc89f75a3e4a7629bd => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:12:48.040638 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68dd0a4-9506-45fb-a9b6-8edd9206b640 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:48.041240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68dd0a4-9506-45fb-a9b6-8edd9206b640 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:48.041476 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68dd0a4-9506-45fb-a9b6-8edd9206b640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:48.083746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-d68dd0a4-9506-45fb-a9b6-8edd9206b640 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:48.086535 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-d68dd0a4-9506-45fb-a9b6-8edd9206b640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:48.344479 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1030/2093] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:12:48.357797 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ecdb6b-1242-4310-996e-bc86cdabf19b admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:48.360537 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-a5ecdb6b-1242-4310-996e-bc86cdabf19b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:48.601413 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ecdb6b-1242-4310-996e-bc86cdabf19b admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:48.613537 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b715527-2fa4-4886-a5c2-508de6891663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:48.615354 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b715527-2fa4-4886-a5c2-508de6891663 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:48.615354 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b715527-2fa4-4886-a5c2-508de6891663 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:48.615354 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b715527-2fa4-4886-a5c2-508de6891663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:48.646830 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b715527-2fa4-4886-a5c2-508de6891663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:48.649079 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b715527-2fa4-4886-a5c2-508de6891663 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:48.685041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1064/2094] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:12:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:12:50.012925 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68dd0a4-9506-45fb-a9b6-8edd9206b640 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:50.016255 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-d68dd0a4-9506-45fb-a9b6-8edd9206b640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:50.058508 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68dd0a4-9506-45fb-a9b6-8edd9206b640 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:50.072015 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d51949-21f6-48ce-8855-16753000e9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:50.073440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d51949-21f6-48ce-8855-16753000e9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:50.073944 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d51949-21f6-48ce-8855-16753000e9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:50.074439 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d51949-21f6-48ce-8855-16753000e9ce admin admin] PATH_INFO: `/v3/projects/179b66ad7e8b403d83049c67810fdcc4` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:50.076877 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d51949-21f6-48ce-8855-16753000e9ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=179b66ad7e8b403d83049c67810fdcc4)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:50.081753 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d51949-21f6-48ce-8855-16753000e9ce admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:50.148996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:50.247286 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97edc02-561b-45ed-ba38-e841cf49cacb None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:50.247906 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97edc02-561b-45ed-ba38-e841cf49cacb None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:50.248010 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97edc02-561b-45ed-ba38-e841cf49cacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:50.312406 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-65d51949-21f6-48ce-8855-16753000e9ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '179b66ad7e8b403d83049c67810fdcc4', 'request_id': 'req-65d51949-21f6-48ce-8855-16753000e9ce'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:50.353686 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-65d51949-21f6-48ce-8855-16753000e9ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '179b66ad7e8b403d83049c67810fdcc4', 'request_id': 'req-65d51949-21f6-48ce-8855-16753000e9ce'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:50.370518 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-65d51949-21f6-48ce-8855-16753000e9ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '179b66ad7e8b403d83049c67810fdcc4', 'request_id': 'req-65d51949-21f6-48ce-8855-16753000e9ce'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:50.372972 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-e97edc02-561b-45ed-ba38-e841cf49cacb None None] MFA Rules not processed for user `6a168d8fd2ad41c999c604dbca97ce80`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:50.378477 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-e97edc02-561b-45ed-ba38-e841cf49cacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:50.486184 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-65d51949-21f6-48ce-8855-16753000e9ce admin admin] The token cache is being invalidate because project 179b66ad7e8b403d83049c67810fdcc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:12:50.486482 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-65d51949-21f6-48ce-8855-16753000e9ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:50.508473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-65d51949-21f6-48ce-8855-16753000e9ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:12:50.508473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1031/2095] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:12:50 2022] DELETE /identity/v3/projects/179b66ad7e8b403d83049c67810fdcc4 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:12:50.508473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d51949-21f6-48ce-8855-16753000e9ce admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:50.508473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-65d51949-21f6-48ce-8855-16753000e9ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:50.587795 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:50.611365 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d51949-21f6-48ce-8855-16753000e9ce admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:50.619207 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f4d44-1c84-429d-8d26-580c90b6d5df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:50.620221 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f4d44-1c84-429d-8d26-580c90b6d5df service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:50.620670 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f4d44-1c84-429d-8d26-580c90b6d5df service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:50.622889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f4d44-1c84-429d-8d26-580c90b6d5df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:50.623862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-969f4d44-1c84-429d-8d26-580c90b6d5df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:50.709111 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1065/2096] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:50 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:12:50.713825 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c0c7f-f99c-4c40-b8d0-bb4a90c01b59 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:50.714236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c0c7f-f99c-4c40-b8d0-bb4a90c01b59 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:50.717823 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c0c7f-f99c-4c40-b8d0-bb4a90c01b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:50.723911 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f4d44-1c84-429d-8d26-580c90b6d5df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:50.726870 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f4d44-1c84-429d-8d26-580c90b6d5df service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:50.744201 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1032/2097] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:12:50 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:12:50.745564 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f4d44-1c84-429d-8d26-580c90b6d5df service cinder] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:50.747166 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-969f4d44-1c84-429d-8d26-580c90b6d5df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:50.829567 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:50.833460 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-b21c0c7f-f99c-4c40-b8d0-bb4a90c01b59 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:50.842458 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-b21c0c7f-f99c-4c40-b8d0-bb4a90c01b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:50.848532 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f4d44-1c84-429d-8d26-580c90b6d5df service cinder] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:50.855241 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e88bcc-4c4f-41ed-bc4d-0a14513afa16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:50.855949 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e88bcc-4c4f-41ed-bc4d-0a14513afa16 service nova] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:50.857038 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e88bcc-4c4f-41ed-bc4d-0a14513afa16 service nova] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:50.857038 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e88bcc-4c4f-41ed-bc4d-0a14513afa16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:50.859377 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-10e88bcc-4c4f-41ed-bc4d-0a14513afa16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:50.949431 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e88bcc-4c4f-41ed-bc4d-0a14513afa16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:50.957102 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e88bcc-4c4f-41ed-bc4d-0a14513afa16 service nova] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:50.970463 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1033/2098] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:12:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:12:50.982758 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1066/2099] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:12:50.994559 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00eef4-8ef6-4309-80b1-61a96221452b None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:50.995305 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00eef4-8ef6-4309-80b1-61a96221452b None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:50.995782 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00eef4-8ef6-4309-80b1-61a96221452b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:51.052494 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-ae00eef4-8ef6-4309-80b1-61a96221452b None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:51.055090 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-ae00eef4-8ef6-4309-80b1-61a96221452b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:51.070678 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1034/2100] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:12:51.075869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c0c7f-f99c-4c40-b8d0-bb4a90c01b59 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:51.090141 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c0c7f-f99c-4c40-b8d0-bb4a90c01b59 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:51.099161 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462aafe-12d1-4a62-9766-66965ffdfc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:51.099947 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462aafe-12d1-4a62-9766-66965ffdfc11 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:51.104066 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462aafe-12d1-4a62-9766-66965ffdfc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:51.104066 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462aafe-12d1-4a62-9766-66965ffdfc11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:51.104066 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462aafe-12d1-4a62-9766-66965ffdfc11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:12:51.104066 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462aafe-12d1-4a62-9766-66965ffdfc11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:51.105850 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462aafe-12d1-4a62-9766-66965ffdfc11 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:51.126345 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1067/2101] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:12:51.131678 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00eef4-8ef6-4309-80b1-61a96221452b None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:51.144380 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00eef4-8ef6-4309-80b1-61a96221452b None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:51.151200 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa05d4d-994b-4f90-8f67-d7bea9d09e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:51.152671 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa05d4d-994b-4f90-8f67-d7bea9d09e20 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:51.153268 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa05d4d-994b-4f90-8f67-d7bea9d09e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:51.153977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa05d4d-994b-4f90-8f67-d7bea9d09e20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:51.155116 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa05d4d-994b-4f90-8f67-d7bea9d09e20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:51.157503 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa05d4d-994b-4f90-8f67-d7bea9d09e20 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:51.334509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1035/2102] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:12:51 2022] POST /identity/v3/projects => generated 365 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:12:51.340993 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462aafe-12d1-4a62-9766-66965ffdfc11 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:51.367699 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462aafe-12d1-4a62-9766-66965ffdfc11 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:51.513900 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed425065-737c-469e-974e-bfdfd1c9cc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:51.516896 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed425065-737c-469e-974e-bfdfd1c9cc83 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:51.518103 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed425065-737c-469e-974e-bfdfd1c9cc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:51.519568 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed425065-737c-469e-974e-bfdfd1c9cc83 admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:51.527066 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed425065-737c-469e-974e-bfdfd1c9cc83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:51.533622 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed425065-737c-469e-974e-bfdfd1c9cc83 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:51.743464 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1068/2103] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:12:51 2022] POST /identity/v3/users => generated 283 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:12:51.748660 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa05d4d-994b-4f90-8f67-d7bea9d09e20 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:51.775635 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa05d4d-994b-4f90-8f67-d7bea9d09e20 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:51.798758 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4151fe6-b0ae-4206-89bb-77fca3689512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:51.799441 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4151fe6-b0ae-4206-89bb-77fca3689512 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:51.800240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4151fe6-b0ae-4206-89bb-77fca3689512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:51.800554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4151fe6-b0ae-4206-89bb-77fca3689512 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:51.801314 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4151fe6-b0ae-4206-89bb-77fca3689512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:51.803054 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4151fe6-b0ae-4206-89bb-77fca3689512 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:51.836116 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1036/2104] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:12:51.838695 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed425065-737c-469e-974e-bfdfd1c9cc83 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:51.870682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed425065-737c-469e-974e-bfdfd1c9cc83 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:51.884930 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059d5f0-e813-4115-a67f-738311631acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:51.885916 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059d5f0-e813-4115-a67f-738311631acd admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:51.886265 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059d5f0-e813-4115-a67f-738311631acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:51.886801 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059d5f0-e813-4115-a67f-738311631acd admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:51.887696 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059d5f0-e813-4115-a67f-738311631acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:51.891666 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059d5f0-e813-4115-a67f-738311631acd admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:51.934774 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1069/2105] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:12:51.946718 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4151fe6-b0ae-4206-89bb-77fca3689512 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:51.975642 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4151fe6-b0ae-4206-89bb-77fca3689512 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:51.987145 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3777cd-5a6e-47ab-9250-62e21f3e4773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:51.989125 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3777cd-5a6e-47ab-9250-62e21f3e4773 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:51.989598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3777cd-5a6e-47ab-9250-62e21f3e4773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:51.990073 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3777cd-5a6e-47ab-9250-62e21f3e4773 admin admin] PATH_INFO: `/v3/projects/68c6d9036f7f48b09d7381163b39ad3f/users/aa1c9d350c89483ba5744c703cd6afbe/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:52.025091 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3777cd-5a6e-47ab-9250-62e21f3e4773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68c6d9036f7f48b09d7381163b39ad3f, user_id=aa1c9d350c89483ba5744c703cd6afbe, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:52.032959 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3777cd-5a6e-47ab-9250-62e21f3e4773 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:52.165908 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1037/2106] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:12:51 2022] PUT /identity/v3/projects/68c6d9036f7f48b09d7381163b39ad3f/users/aa1c9d350c89483ba5744c703cd6afbe/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:12:52.171329 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233cddb-f6fe-4a54-980f-0545eb0ca48e None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:52.171667 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233cddb-f6fe-4a54-980f-0545eb0ca48e None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:52.171893 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233cddb-f6fe-4a54-980f-0545eb0ca48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:52.210130 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-1233cddb-f6fe-4a54-980f-0545eb0ca48e None None] MFA Rules not processed for user `aa1c9d350c89483ba5744c703cd6afbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:52.211591 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-1233cddb-f6fe-4a54-980f-0545eb0ca48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:52.270055 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f127d13-b6e9-42ad-a324-b382d0790b3c None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:52.270419 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f127d13-b6e9-42ad-a324-b382d0790b3c None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:52.270798 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f127d13-b6e9-42ad-a324-b382d0790b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:52.305587 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-6f127d13-b6e9-42ad-a324-b382d0790b3c None None] MFA Rules not processed for user `ad3a9141e9284bb5a096fb04d3e9d581`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:52.308531 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-6f127d13-b6e9-42ad-a324-b382d0790b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:52.359925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:52.402317 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1038/2107] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:12:52.417322 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1070/2108] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:12:52.437383 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f127d13-b6e9-42ad-a324-b382d0790b3c None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:52.439217 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-6f127d13-b6e9-42ad-a324-b382d0790b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:52.529838 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:52.564762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f127d13-b6e9-42ad-a324-b382d0790b3c None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:52.579645 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c460e61-8571-4f39-ae9c-9e41f69dddd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:52.579889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c460e61-8571-4f39-ae9c-9e41f69dddd7 service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:52.580269 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c460e61-8571-4f39-ae9c-9e41f69dddd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:52.580609 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c460e61-8571-4f39-ae9c-9e41f69dddd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:52.592701 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c460e61-8571-4f39-ae9c-9e41f69dddd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:52.594652 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c460e61-8571-4f39-ae9c-9e41f69dddd7 service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:52.608236 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1039/2109] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:12:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:12:55.414826 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a14202-a896-4387-b94b-2995cbe39ca8 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:55.416199 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a14202-a896-4387-b94b-2995cbe39ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:55.416882 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a14202-a896-4387-b94b-2995cbe39ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:55.475501 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-06a14202-a896-4387-b94b-2995cbe39ca8 None None] MFA Rules not processed for user `eb640d92cb9b49019f42351a60efe258`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:55.477051 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-06a14202-a896-4387-b94b-2995cbe39ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:55.579732 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1071/2110] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Aug 2 09:12:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:12:55.647106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c460e61-8571-4f39-ae9c-9e41f69dddd7 service cinder] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:55.653853 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-0c460e61-8571-4f39-ae9c-9e41f69dddd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:55.934043 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c460e61-8571-4f39-ae9c-9e41f69dddd7 service cinder] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:55.948491 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0bab9-a7ad-4f60-859d-28092f6fac17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f8e572550b4ab5955d7a94f1563441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:55.949879 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0bab9-a7ad-4f60-859d-28092f6fac17 service swift] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:55.951153 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0bab9-a7ad-4f60-859d-28092f6fac17 service swift] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:55.951795 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0bab9-a7ad-4f60-859d-28092f6fac17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:55.969009 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0bab9-a7ad-4f60-859d-28092f6fac17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:55.973637 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0bab9-a7ad-4f60-859d-28092f6fac17 service swift] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:55.998445 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1040/2111] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Aug 2 09:12:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:12:56.242755 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0dbd1-2c93-435f-a13f-ac9ef54e5174 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:56.243040 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0dbd1-2c93-435f-a13f-ac9ef54e5174 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:56.243496 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0dbd1-2c93-435f-a13f-ac9ef54e5174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:56.296687 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-b9f0dbd1-2c93-435f-a13f-ac9ef54e5174 None None] MFA Rules not processed for user `75559881115047eeb72554769404ed0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:56.299977 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-b9f0dbd1-2c93-435f-a13f-ac9ef54e5174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:56.446625 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1072/2112] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:12:57.800144 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fba5a7-c01a-4a0d-b1b6-6fd62d0a7de0 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:57.810701 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fba5a7-c01a-4a0d-b1b6-6fd62d0a7de0 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:57.810701 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fba5a7-c01a-4a0d-b1b6-6fd62d0a7de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:57.858100 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-60fba5a7-c01a-4a0d-b1b6-6fd62d0a7de0 None None] MFA Rules not processed for user `1eda94767d1547fa82f6407a4c7de1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:12:57.861352 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-60fba5a7-c01a-4a0d-b1b6-6fd62d0a7de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:58.060269 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1041/2113] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:12:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:12:59.053562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0dbd1-2c93-435f-a13f-ac9ef54e5174 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:12:59.055639 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-b9f0dbd1-2c93-435f-a13f-ac9ef54e5174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:12:59.250122 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0dbd1-2c93-435f-a13f-ac9ef54e5174 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:12:59.282224 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e79d36-478d-4df3-a1b0-9b283fe430fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:12:59.285834 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e79d36-478d-4df3-a1b0-9b283fe430fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:12:59.286641 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e79d36-478d-4df3-a1b0-9b283fe430fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:12:59.288712 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e79d36-478d-4df3-a1b0-9b283fe430fe admin admin] PATH_INFO: `/v3/users/221e02c06e7d490f94d989c6d532cfde` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:12:59.293446 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e79d36-478d-4df3-a1b0-9b283fe430fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=221e02c06e7d490f94d989c6d532cfde)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:12:59.309456 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e79d36-478d-4df3-a1b0-9b283fe430fe admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:12:59.780354 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:59.841487 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-f6e79d36-478d-4df3-a1b0-9b283fe430fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '221e02c06e7d490f94d989c6d532cfde'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:00.058641 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-f6e79d36-478d-4df3-a1b0-9b283fe430fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '221e02c06e7d490f94d989c6d532cfde'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:00.091088 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-f6e79d36-478d-4df3-a1b0-9b283fe430fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '221e02c06e7d490f94d989c6d532cfde'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:00.092609 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-f6e79d36-478d-4df3-a1b0-9b283fe430fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '221e02c06e7d490f94d989c6d532cfde'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:00.093228 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-f6e79d36-478d-4df3-a1b0-9b283fe430fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '221e02c06e7d490f94d989c6d532cfde'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:00.148080 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1073/2114] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:12:59 2022] DELETE /identity/v3/users/221e02c06e7d490f94d989c6d532cfde => generated 0 bytes in 1090 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:13:00.148456 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39baf85-4d50-42ed-b413-bcfb3bd66007 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:00.148950 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39baf85-4d50-42ed-b413-bcfb3bd66007 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:00.149521 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39baf85-4d50-42ed-b413-bcfb3bd66007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:00.217833 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-a39baf85-4d50-42ed-b413-bcfb3bd66007 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:13:00.233328 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-a39baf85-4d50-42ed-b413-bcfb3bd66007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:00.392470 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1042/2115] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:13:00.403322 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e79d36-478d-4df3-a1b0-9b283fe430fe admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:00.405879 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-f6e79d36-478d-4df3-a1b0-9b283fe430fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:00.606009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e79d36-478d-4df3-a1b0-9b283fe430fe admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:00.625425 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a012b-3ce7-4bdd-8b4e-120853be9df8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:00.627822 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a012b-3ce7-4bdd-8b4e-120853be9df8 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:00.629512 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a012b-3ce7-4bdd-8b4e-120853be9df8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:00.663018 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a012b-3ce7-4bdd-8b4e-120853be9df8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:00.679112 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a012b-3ce7-4bdd-8b4e-120853be9df8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:00.681426 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a012b-3ce7-4bdd-8b4e-120853be9df8 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:00.705277 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1074/2116] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:13:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:13:03.068873 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39baf85-4d50-42ed-b413-bcfb3bd66007 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:03.070594 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-a39baf85-4d50-42ed-b413-bcfb3bd66007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:03.104491 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39baf85-4d50-42ed-b413-bcfb3bd66007 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:03.114078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977057f-6fc1-4e48-b697-06622b98897c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:03.116935 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977057f-6fc1-4e48-b697-06622b98897c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:03.117246 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977057f-6fc1-4e48-b697-06622b98897c admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:03.118733 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977057f-6fc1-4e48-b697-06622b98897c admin admin] PATH_INFO: `/v3/projects/01e249b1563f457aa0bbf22311ec3450` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:03.123366 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977057f-6fc1-4e48-b697-06622b98897c admin admin] RBAC: Authorizing `identity:delete_project(project_id=01e249b1563f457aa0bbf22311ec3450)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:03.126777 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977057f-6fc1-4e48-b697-06622b98897c admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:03.162089 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:03.357572 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-8977057f-6fc1-4e48-b697-06622b98897c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01e249b1563f457aa0bbf22311ec3450', 'request_id': 'req-8977057f-6fc1-4e48-b697-06622b98897c'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:03.381690 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-8977057f-6fc1-4e48-b697-06622b98897c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01e249b1563f457aa0bbf22311ec3450', 'request_id': 'req-8977057f-6fc1-4e48-b697-06622b98897c'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:03.402399 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-8977057f-6fc1-4e48-b697-06622b98897c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01e249b1563f457aa0bbf22311ec3450', 'request_id': 'req-8977057f-6fc1-4e48-b697-06622b98897c'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:03.534582 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-8977057f-6fc1-4e48-b697-06622b98897c admin admin] The token cache is being invalidate because project 01e249b1563f457aa0bbf22311ec3450 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:13:03.545053 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-8977057f-6fc1-4e48-b697-06622b98897c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:03.545053 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-8977057f-6fc1-4e48-b697-06622b98897c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:03.545053 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1043/2117] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:13:03 2022] DELETE /identity/v3/projects/01e249b1563f457aa0bbf22311ec3450 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:13:03.545668 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a012b-3ce7-4bdd-8b4e-120853be9df8 service neutron] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:03.591441 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a012b-3ce7-4bdd-8b4e-120853be9df8 service neutron] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:03.814232 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123e83f-a0da-4595-8e9c-fd3cb0795f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:03.815058 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123e83f-a0da-4595-8e9c-fd3cb0795f6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:03.815462 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123e83f-a0da-4595-8e9c-fd3cb0795f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:03.816383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123e83f-a0da-4595-8e9c-fd3cb0795f6c admin admin] PATH_INFO: `/v3/users/b4963ba170db4e26916c560e3f99a4e9` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:03.817650 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123e83f-a0da-4595-8e9c-fd3cb0795f6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4963ba170db4e26916c560e3f99a4e9)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:03.824221 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123e83f-a0da-4595-8e9c-fd3cb0795f6c admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:04.211269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d123e83f-a0da-4595-8e9c-fd3cb0795f6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4963ba170db4e26916c560e3f99a4e9'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:04.371414 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d123e83f-a0da-4595-8e9c-fd3cb0795f6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4963ba170db4e26916c560e3f99a4e9'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:04.374778 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:04.399493 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d123e83f-a0da-4595-8e9c-fd3cb0795f6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4963ba170db4e26916c560e3f99a4e9'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:04.399493 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d123e83f-a0da-4595-8e9c-fd3cb0795f6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4963ba170db4e26916c560e3f99a4e9'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:04.399493 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d123e83f-a0da-4595-8e9c-fd3cb0795f6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4963ba170db4e26916c560e3f99a4e9'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:04.454332 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1075/2118] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:13:03 2022] DELETE /identity/v3/users/b4963ba170db4e26916c560e3f99a4e9 => generated 0 bytes in 912 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:13:05.495292 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977057f-6fc1-4e48-b697-06622b98897c admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:05.497801 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-8977057f-6fc1-4e48-b697-06622b98897c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:05.522071 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977057f-6fc1-4e48-b697-06622b98897c admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:05.720417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec2686-744a-47a7-b7e2-cba76c055e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:05.720417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec2686-744a-47a7-b7e2-cba76c055e5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:05.720417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec2686-744a-47a7-b7e2-cba76c055e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:05.720417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec2686-744a-47a7-b7e2-cba76c055e5a admin admin] PATH_INFO: `/v3/projects/c188e72b936744a58c95aaa593e5d4cb` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:05.720818 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec2686-744a-47a7-b7e2-cba76c055e5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c188e72b936744a58c95aaa593e5d4cb)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:05.725971 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec2686-744a-47a7-b7e2-cba76c055e5a admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:06.402162 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-a3ec2686-744a-47a7-b7e2-cba76c055e5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c188e72b936744a58c95aaa593e5d4cb', 'request_id': 'req-a3ec2686-744a-47a7-b7e2-cba76c055e5a'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:06.423092 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-a3ec2686-744a-47a7-b7e2-cba76c055e5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c188e72b936744a58c95aaa593e5d4cb', 'request_id': 'req-a3ec2686-744a-47a7-b7e2-cba76c055e5a'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:06.449136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-a3ec2686-744a-47a7-b7e2-cba76c055e5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c188e72b936744a58c95aaa593e5d4cb', 'request_id': 'req-a3ec2686-744a-47a7-b7e2-cba76c055e5a'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:06.620867 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-a3ec2686-744a-47a7-b7e2-cba76c055e5a admin admin] The token cache is being invalidate because project c188e72b936744a58c95aaa593e5d4cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:13:06.622041 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-a3ec2686-744a-47a7-b7e2-cba76c055e5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:06.623209 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-a3ec2686-744a-47a7-b7e2-cba76c055e5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:06.629307 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1044/2119] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:13:05 2022] DELETE /identity/v3/projects/c188e72b936744a58c95aaa593e5d4cb => generated 0 bytes in 1136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:13:06.642132 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bff9ca-f616-4d6e-b962-0c70a6a9ae8d None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:06.642821 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bff9ca-f616-4d6e-b962-0c70a6a9ae8d None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:06.642821 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bff9ca-f616-4d6e-b962-0c70a6a9ae8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:06.708448 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-c9bff9ca-f616-4d6e-b962-0c70a6a9ae8d None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:13:06.709705 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-c9bff9ca-f616-4d6e-b962-0c70a6a9ae8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:06.795889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1076/2120] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:13:06.821387 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc207c47-c5b4-4554-884c-136439bda8d2 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:06.821821 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc207c47-c5b4-4554-884c-136439bda8d2 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:06.822220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc207c47-c5b4-4554-884c-136439bda8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:06.845188 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-fc207c47-c5b4-4554-884c-136439bda8d2 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:13:06.847083 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-fc207c47-c5b4-4554-884c-136439bda8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:06.860516 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1045/2121] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:13:06.866740 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bff9ca-f616-4d6e-b962-0c70a6a9ae8d None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:06.883434 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bff9ca-f616-4d6e-b962-0c70a6a9ae8d None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:06.888670 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00857ee2-5f5e-4143-baf0-3d4fdbc6c4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:06.889412 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00857ee2-5f5e-4143-baf0-3d4fdbc6c4bc admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:06.889695 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00857ee2-5f5e-4143-baf0-3d4fdbc6c4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:06.890015 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00857ee2-5f5e-4143-baf0-3d4fdbc6c4bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:06.890932 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00857ee2-5f5e-4143-baf0-3d4fdbc6c4bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:13:06.891412 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00857ee2-5f5e-4143-baf0-3d4fdbc6c4bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:06.894105 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00857ee2-5f5e-4143-baf0-3d4fdbc6c4bc admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:06.910698 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1077/2122] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:13:06.915303 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc207c47-c5b4-4554-884c-136439bda8d2 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:06.927864 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc207c47-c5b4-4554-884c-136439bda8d2 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:06.935556 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3bddd-0ccd-46ae-8efa-05f5718d8e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:06.936812 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3bddd-0ccd-46ae-8efa-05f5718d8e25 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:06.937677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3bddd-0ccd-46ae-8efa-05f5718d8e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:06.937677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3bddd-0ccd-46ae-8efa-05f5718d8e25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:06.938815 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3bddd-0ccd-46ae-8efa-05f5718d8e25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:06.940744 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3bddd-0ccd-46ae-8efa-05f5718d8e25 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:07.145553 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1046/2123] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:13:06 2022] POST /identity/v3/projects => generated 371 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:13:07.148089 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00857ee2-5f5e-4143-baf0-3d4fdbc6c4bc admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:07.176146 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00857ee2-5f5e-4143-baf0-3d4fdbc6c4bc admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:07.267392 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f074404-c3c1-444b-a1b3-b25f6f4b2ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:07.268429 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f074404-c3c1-444b-a1b3-b25f6f4b2ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:07.268995 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f074404-c3c1-444b-a1b3-b25f6f4b2ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:07.269459 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f074404-c3c1-444b-a1b3-b25f6f4b2ce8 admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:07.270634 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f074404-c3c1-444b-a1b3-b25f6f4b2ce8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:07.291649 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f074404-c3c1-444b-a1b3-b25f6f4b2ce8 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:07.422604 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1078/2124] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:13:07 2022] POST /identity/v3/users => generated 286 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:13:07.428298 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3bddd-0ccd-46ae-8efa-05f5718d8e25 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:07.436935 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:07.448129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3bddd-0ccd-46ae-8efa-05f5718d8e25 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:07.465346 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea37f62-b7ee-46f7-bbbb-b58edf01de95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:07.466354 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea37f62-b7ee-46f7-bbbb-b58edf01de95 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:07.466811 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea37f62-b7ee-46f7-bbbb-b58edf01de95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:07.467251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea37f62-b7ee-46f7-bbbb-b58edf01de95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:07.468347 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea37f62-b7ee-46f7-bbbb-b58edf01de95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:07.470970 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea37f62-b7ee-46f7-bbbb-b58edf01de95 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:07.539069 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1047/2125] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:13:07.543840 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f074404-c3c1-444b-a1b3-b25f6f4b2ce8 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:07.571813 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f074404-c3c1-444b-a1b3-b25f6f4b2ce8 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:07.599040 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac520f3-8ca6-49b6-9513-39b654c25f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:07.599706 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac520f3-8ca6-49b6-9513-39b654c25f59 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:07.599995 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac520f3-8ca6-49b6-9513-39b654c25f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:07.600308 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac520f3-8ca6-49b6-9513-39b654c25f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:07.601138 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac520f3-8ca6-49b6-9513-39b654c25f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:07.602851 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac520f3-8ca6-49b6-9513-39b654c25f59 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:07.632390 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1079/2126] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:13:07.636922 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea37f62-b7ee-46f7-bbbb-b58edf01de95 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:07.650967 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea37f62-b7ee-46f7-bbbb-b58edf01de95 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:07.669025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b66ce-2ae3-4d87-a69f-4746b48f9dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:07.669834 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b66ce-2ae3-4d87-a69f-4746b48f9dec admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:07.670194 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b66ce-2ae3-4d87-a69f-4746b48f9dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:07.670566 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b66ce-2ae3-4d87-a69f-4746b48f9dec admin admin] PATH_INFO: `/v3/projects/798cf91275484856b3b12d264565b08f/users/85b0ef8eb93341b987f565472b69169c/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:07.710419 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b66ce-2ae3-4d87-a69f-4746b48f9dec admin admin] RBAC: Authorizing `identity:create_grant(project_id=798cf91275484856b3b12d264565b08f, user_id=85b0ef8eb93341b987f565472b69169c, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:07.714185 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b66ce-2ae3-4d87-a69f-4746b48f9dec admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:07.812918 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1048/2127] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:13:07 2022] PUT /identity/v3/projects/798cf91275484856b3b12d264565b08f/users/85b0ef8eb93341b987f565472b69169c/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:13:07.826458 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81df7b7-53b1-4e31-bb9c-30ed395323f4 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:07.827248 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81df7b7-53b1-4e31-bb9c-30ed395323f4 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:07.827248 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81df7b7-53b1-4e31-bb9c-30ed395323f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:07.882198 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-d81df7b7-53b1-4e31-bb9c-30ed395323f4 None None] MFA Rules not processed for user `85b0ef8eb93341b987f565472b69169c`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:13:07.883901 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-d81df7b7-53b1-4e31-bb9c-30ed395323f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:07.978614 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:08.089086 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1080/2128] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:13:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:13:08.099157 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b66ce-2ae3-4d87-a69f-4746b48f9dec admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:08.100913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-b37b66ce-2ae3-4d87-a69f-4746b48f9dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:08.249558 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b66ce-2ae3-4d87-a69f-4746b48f9dec admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:08.257099 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314c921-c3a2-4cc8-adda-bee86013ca1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:08.258220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314c921-c3a2-4cc8-adda-bee86013ca1a service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:08.258220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314c921-c3a2-4cc8-adda-bee86013ca1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:08.258434 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314c921-c3a2-4cc8-adda-bee86013ca1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:08.279544 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314c921-c3a2-4cc8-adda-bee86013ca1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:08.281360 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314c921-c3a2-4cc8-adda-bee86013ca1a service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:08.300632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1049/2129] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:13:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:13:08.333149 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81df7b7-53b1-4e31-bb9c-30ed395323f4 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:08.563610 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81df7b7-53b1-4e31-bb9c-30ed395323f4 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:08.593980 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd746c-a639-4ce1-a2e5-90c5ccb094c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:08.594718 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd746c-a639-4ce1-a2e5-90c5ccb094c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:08.595010 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd746c-a639-4ce1-a2e5-90c5ccb094c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:08.605468 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd746c-a639-4ce1-a2e5-90c5ccb094c4 admin admin] PATH_INFO: `/v3/users/85b0ef8eb93341b987f565472b69169c` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:08.613903 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd746c-a639-4ce1-a2e5-90c5ccb094c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85b0ef8eb93341b987f565472b69169c)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:08.615984 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd746c-a639-4ce1-a2e5-90c5ccb094c4 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:08.958554 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-7abd746c-a639-4ce1-a2e5-90c5ccb094c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85b0ef8eb93341b987f565472b69169c'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:09.030166 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-7abd746c-a639-4ce1-a2e5-90c5ccb094c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85b0ef8eb93341b987f565472b69169c'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:09.085673 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-7abd746c-a639-4ce1-a2e5-90c5ccb094c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85b0ef8eb93341b987f565472b69169c'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:09.091822 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-7abd746c-a639-4ce1-a2e5-90c5ccb094c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85b0ef8eb93341b987f565472b69169c'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:09.097876 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-7abd746c-a639-4ce1-a2e5-90c5ccb094c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85b0ef8eb93341b987f565472b69169c'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:09.160261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1081/2130] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:13:08 2022] DELETE /identity/v3/users/85b0ef8eb93341b987f565472b69169c => generated 0 bytes in 825 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:13:09.164376 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1e8e7-58d7-4e31-ac0d-41c9b35a35d4 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:09.165358 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1e8e7-58d7-4e31-ac0d-41c9b35a35d4 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:09.166002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1e8e7-58d7-4e31-ac0d-41c9b35a35d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:09.201616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-b6c1e8e7-58d7-4e31-ac0d-41c9b35a35d4 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:13:09.205136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-b6c1e8e7-58d7-4e31-ac0d-41c9b35a35d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:09.332927 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1050/2131] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:13:09.347568 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd746c-a639-4ce1-a2e5-90c5ccb094c4 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:09.347568 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-7abd746c-a639-4ce1-a2e5-90c5ccb094c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:09.468795 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:09.487776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd746c-a639-4ce1-a2e5-90c5ccb094c4 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:09.492309 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e0c9b-7855-42e5-8dfe-5e0fcbab1c1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:09.493049 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e0c9b-7855-42e5-8dfe-5e0fcbab1c1b service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:09.493344 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e0c9b-7855-42e5-8dfe-5e0fcbab1c1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:09.493699 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e0c9b-7855-42e5-8dfe-5e0fcbab1c1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:09.509232 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e0c9b-7855-42e5-8dfe-5e0fcbab1c1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:09.511017 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e0c9b-7855-42e5-8dfe-5e0fcbab1c1b service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:09.533580 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1082/2132] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:13:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:13:10.339191 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1e8e7-58d7-4e31-ac0d-41c9b35a35d4 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:10.340327 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-b6c1e8e7-58d7-4e31-ac0d-41c9b35a35d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:10.368339 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1e8e7-58d7-4e31-ac0d-41c9b35a35d4 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:10.376539 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d7f7d-2e37-46ee-91aa-4cd225412b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:10.378811 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d7f7d-2e37-46ee-91aa-4cd225412b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:10.379573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d7f7d-2e37-46ee-91aa-4cd225412b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:10.380143 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d7f7d-2e37-46ee-91aa-4cd225412b8c admin admin] PATH_INFO: `/v3/projects/798cf91275484856b3b12d264565b08f` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:10.382486 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d7f7d-2e37-46ee-91aa-4cd225412b8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=798cf91275484856b3b12d264565b08f)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:10.386180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d7f7d-2e37-46ee-91aa-4cd225412b8c admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:10.633493 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-af5d7f7d-2e37-46ee-91aa-4cd225412b8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '798cf91275484856b3b12d264565b08f', 'request_id': 'req-af5d7f7d-2e37-46ee-91aa-4cd225412b8c'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:10.704856 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-af5d7f7d-2e37-46ee-91aa-4cd225412b8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '798cf91275484856b3b12d264565b08f', 'request_id': 'req-af5d7f7d-2e37-46ee-91aa-4cd225412b8c'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:10.730561 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-af5d7f7d-2e37-46ee-91aa-4cd225412b8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '798cf91275484856b3b12d264565b08f', 'request_id': 'req-af5d7f7d-2e37-46ee-91aa-4cd225412b8c'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:10.741238 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:10.848494 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-af5d7f7d-2e37-46ee-91aa-4cd225412b8c admin admin] The token cache is being invalidate because project 798cf91275484856b3b12d264565b08f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:13:10.849002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-af5d7f7d-2e37-46ee-91aa-4cd225412b8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:10.850167 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-af5d7f7d-2e37-46ee-91aa-4cd225412b8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:10.868999 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1051/2133] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:13:10 2022] DELETE /identity/v3/projects/798cf91275484856b3b12d264565b08f => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:13:10.869371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c9bfe-e872-41ed-a6c7-84d6ddf632a6 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:10.870116 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c9bfe-e872-41ed-a6c7-84d6ddf632a6 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:10.870390 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c9bfe-e872-41ed-a6c7-84d6ddf632a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:10.981317 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-393c9bfe-e872-41ed-a6c7-84d6ddf632a6 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:13:10.982771 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-393c9bfe-e872-41ed-a6c7-84d6ddf632a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:11.138126 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1083/2134] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:13:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:13:11.156921 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d9e6d-dbcf-49f9-994f-024290957f04 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:11.157952 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d9e6d-dbcf-49f9-994f-024290957f04 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:11.158506 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d9e6d-dbcf-49f9-994f-024290957f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:11.185140 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-5e7d9e6d-dbcf-49f9-994f-024290957f04 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:13:11.186671 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-5e7d9e6d-dbcf-49f9-994f-024290957f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:11.202098 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1052/2135] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:13:11.206857 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c9bfe-e872-41ed-a6c7-84d6ddf632a6 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:11.220457 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c9bfe-e872-41ed-a6c7-84d6ddf632a6 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:11.229128 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec705c-6546-490f-afec-f1ecf3383500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:11.230507 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec705c-6546-490f-afec-f1ecf3383500 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:11.230507 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec705c-6546-490f-afec-f1ecf3383500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:11.230507 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec705c-6546-490f-afec-f1ecf3383500 admin admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:11.231094 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec705c-6546-490f-afec-f1ecf3383500 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:13:11.231395 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec705c-6546-490f-afec-f1ecf3383500 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:11.236414 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec705c-6546-490f-afec-f1ecf3383500 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:11.258473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d9e6d-dbcf-49f9-994f-024290957f04 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:11.265902 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1084/2136] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:13:11.275008 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d9e6d-dbcf-49f9-994f-024290957f04 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:11.295573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed9215-6b29-4c89-9cce-587000ac6201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:11.296436 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed9215-6b29-4c89-9cce-587000ac6201 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:11.296945 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed9215-6b29-4c89-9cce-587000ac6201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:11.297288 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed9215-6b29-4c89-9cce-587000ac6201 admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:11.298034 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed9215-6b29-4c89-9cce-587000ac6201 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:11.303270 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed9215-6b29-4c89-9cce-587000ac6201 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:11.419646 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1053/2137] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:13:11 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:13:11.427458 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec705c-6546-490f-afec-f1ecf3383500 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:11.442125 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec705c-6546-490f-afec-f1ecf3383500 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:11.555234 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e330e-6a32-440e-a24f-8e64b4b7359d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:11.556591 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e330e-6a32-440e-a24f-8e64b4b7359d admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:11.557278 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e330e-6a32-440e-a24f-8e64b4b7359d admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:11.557791 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e330e-6a32-440e-a24f-8e64b4b7359d admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:11.558744 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e330e-6a32-440e-a24f-8e64b4b7359d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:11.560949 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e330e-6a32-440e-a24f-8e64b4b7359d admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:11.697293 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1085/2138] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:13:11 2022] POST /identity/v3/users => generated 292 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:13:11.698728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed9215-6b29-4c89-9cce-587000ac6201 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:11.719302 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed9215-6b29-4c89-9cce-587000ac6201 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:11.728051 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f7d9f-7452-49ac-b190-11cbee8f5adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:11.729175 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f7d9f-7452-49ac-b190-11cbee8f5adf admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:11.729685 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f7d9f-7452-49ac-b190-11cbee8f5adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:11.730442 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f7d9f-7452-49ac-b190-11cbee8f5adf admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:11.731850 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f7d9f-7452-49ac-b190-11cbee8f5adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:11.735088 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f7d9f-7452-49ac-b190-11cbee8f5adf admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:11.761555 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1054/2139] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:13:11.763638 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e330e-6a32-440e-a24f-8e64b4b7359d admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:11.780518 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e330e-6a32-440e-a24f-8e64b4b7359d admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:11.789025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b260e8b-81bb-40d2-9958-9c11df5900a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:11.789846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b260e8b-81bb-40d2-9958-9c11df5900a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:11.790266 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b260e8b-81bb-40d2-9958-9c11df5900a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:11.790656 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b260e8b-81bb-40d2-9958-9c11df5900a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:11.791645 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b260e8b-81bb-40d2-9958-9c11df5900a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:11.793607 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b260e8b-81bb-40d2-9958-9c11df5900a8 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:11.809393 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1086/2140] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:13:11.813797 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f7d9f-7452-49ac-b190-11cbee8f5adf admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:11.826159 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f7d9f-7452-49ac-b190-11cbee8f5adf admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:11.832045 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392046ee-329e-4378-ac63-1a64be5d0436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:11.832789 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392046ee-329e-4378-ac63-1a64be5d0436 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:11.833073 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392046ee-329e-4378-ac63-1a64be5d0436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:11.833347 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392046ee-329e-4378-ac63-1a64be5d0436 admin admin] PATH_INFO: `/v3/projects/7ab0735f6ee4452a9e3971402b377e02/users/dfcc860d540d47b4b7c914cc723dc9c3/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:11.853010 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392046ee-329e-4378-ac63-1a64be5d0436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ab0735f6ee4452a9e3971402b377e02, user_id=dfcc860d540d47b4b7c914cc723dc9c3, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:11.856822 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392046ee-329e-4378-ac63-1a64be5d0436 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:12.028445 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1055/2141] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:13:11 2022] PUT /identity/v3/projects/7ab0735f6ee4452a9e3971402b377e02/users/dfcc860d540d47b4b7c914cc723dc9c3/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:13:12.034125 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602f624-9395-4f27-96db-8df8cef265d7 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:12.034125 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602f624-9395-4f27-96db-8df8cef265d7 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:12.034125 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602f624-9395-4f27-96db-8df8cef265d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:12.123292 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-4602f624-9395-4f27-96db-8df8cef265d7 None None] MFA Rules not processed for user `dfcc860d540d47b4b7c914cc723dc9c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:13:12.124691 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-4602f624-9395-4f27-96db-8df8cef265d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:12.200235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:12.223878 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1087/2142] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:13:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:13:12.228350 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392046ee-329e-4378-ac63-1a64be5d0436 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:12.333640 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392046ee-329e-4378-ac63-1a64be5d0436 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:12.339947 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17fea98-fb5c-4902-9bbb-7ad1f496f6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:12.340955 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fea98-fb5c-4902-9bbb-7ad1f496f6f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:12.341317 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fea98-fb5c-4902-9bbb-7ad1f496f6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:12.341652 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fea98-fb5c-4902-9bbb-7ad1f496f6f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:12.342509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17fea98-fb5c-4902-9bbb-7ad1f496f6f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:12.344650 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17fea98-fb5c-4902-9bbb-7ad1f496f6f8 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:12.929582 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1056/2143] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:13:12 2022] POST /identity/v3/projects => generated 383 bytes in 702 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:13:12.936111 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602f624-9395-4f27-96db-8df8cef265d7 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:12.960778 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602f624-9395-4f27-96db-8df8cef265d7 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:13.075659 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991df52-643b-4ea3-b29e-bc488db03343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:13.078067 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991df52-643b-4ea3-b29e-bc488db03343 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:13.080875 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991df52-643b-4ea3-b29e-bc488db03343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:13.080875 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991df52-643b-4ea3-b29e-bc488db03343 admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:13.080875 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991df52-643b-4ea3-b29e-bc488db03343 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:13.083568 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991df52-643b-4ea3-b29e-bc488db03343 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:13.292317 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1088/2144] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:13:12 2022] POST /identity/v3/users => generated 292 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:13:13.297498 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17fea98-fb5c-4902-9bbb-7ad1f496f6f8 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:13.323083 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17fea98-fb5c-4902-9bbb-7ad1f496f6f8 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:13.337028 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f5405-34e2-4cdd-b9b2-cd9aa0ba4f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:13.337028 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f5405-34e2-4cdd-b9b2-cd9aa0ba4f98 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:13.338027 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f5405-34e2-4cdd-b9b2-cd9aa0ba4f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:13.338687 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f5405-34e2-4cdd-b9b2-cd9aa0ba4f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:13.341074 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f5405-34e2-4cdd-b9b2-cd9aa0ba4f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:13.346461 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f5405-34e2-4cdd-b9b2-cd9aa0ba4f98 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:13.372727 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1057/2145] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:13:13.382838 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991df52-643b-4ea3-b29e-bc488db03343 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:13.402515 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991df52-643b-4ea3-b29e-bc488db03343 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:13.413289 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a339f2f-4e79-43ef-a8bb-3f8feb5c5e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:13.414037 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a339f2f-4e79-43ef-a8bb-3f8feb5c5e7c admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:13.414408 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a339f2f-4e79-43ef-a8bb-3f8feb5c5e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:13.414687 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a339f2f-4e79-43ef-a8bb-3f8feb5c5e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:13.419121 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a339f2f-4e79-43ef-a8bb-3f8feb5c5e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:13.421384 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a339f2f-4e79-43ef-a8bb-3f8feb5c5e7c admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:13.442752 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1089/2146] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:13:13.448040 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f5405-34e2-4cdd-b9b2-cd9aa0ba4f98 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:13.461681 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f5405-34e2-4cdd-b9b2-cd9aa0ba4f98 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:13.467521 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4989f59-cb53-4992-b63d-6e6273243114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:13.468814 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4989f59-cb53-4992-b63d-6e6273243114 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:13.469341 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4989f59-cb53-4992-b63d-6e6273243114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:13.469908 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4989f59-cb53-4992-b63d-6e6273243114 admin admin] PATH_INFO: `/v3/projects/f3ee70adbc994c8c94a41f7ad03bd192/users/7aaa244c4fac4718bbcae145706f9423/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:13.493161 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4989f59-cb53-4992-b63d-6e6273243114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3ee70adbc994c8c94a41f7ad03bd192, user_id=7aaa244c4fac4718bbcae145706f9423, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:13.497124 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4989f59-cb53-4992-b63d-6e6273243114 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:13.618546 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1058/2147] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:13:13 2022] PUT /identity/v3/projects/f3ee70adbc994c8c94a41f7ad03bd192/users/7aaa244c4fac4718bbcae145706f9423/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:13:13.644932 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dacdb3-48c9-4353-8d71-0f39d5c55967 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:13.645333 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dacdb3-48c9-4353-8d71-0f39d5c55967 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:13.645850 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dacdb3-48c9-4353-8d71-0f39d5c55967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:13.713272 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-c7dacdb3-48c9-4353-8d71-0f39d5c55967 None None] MFA Rules not processed for user `7aaa244c4fac4718bbcae145706f9423`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:13:13.717027 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-c7dacdb3-48c9-4353-8d71-0f39d5c55967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:13.891576 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1090/2148] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:13:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:13:13.898816 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4989f59-cb53-4992-b63d-6e6273243114 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:14.041470 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:14.082452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4989f59-cb53-4992-b63d-6e6273243114 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:14.089315 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805dc80c-11d5-4a88-bd61-6a8130fbd3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:14.093966 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805dc80c-11d5-4a88-bd61-6a8130fbd3bb admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:14.093966 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805dc80c-11d5-4a88-bd61-6a8130fbd3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:14.093966 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805dc80c-11d5-4a88-bd61-6a8130fbd3bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:14.093966 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805dc80c-11d5-4a88-bd61-6a8130fbd3bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:14.093966 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805dc80c-11d5-4a88-bd61-6a8130fbd3bb admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:14.304645 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1059/2149] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:13:13 2022] POST /identity/v3/projects => generated 383 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:13:14.305537 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dacdb3-48c9-4353-8d71-0f39d5c55967 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:14.332719 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dacdb3-48c9-4353-8d71-0f39d5c55967 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:14.429262 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:14.438609 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8803e-1ea8-4dda-b78b-39eb8ccf0531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:14.439415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8803e-1ea8-4dda-b78b-39eb8ccf0531 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:14.440432 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8803e-1ea8-4dda-b78b-39eb8ccf0531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:14.441015 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8803e-1ea8-4dda-b78b-39eb8ccf0531 admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:14.442326 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8803e-1ea8-4dda-b78b-39eb8ccf0531 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:14.444760 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8803e-1ea8-4dda-b78b-39eb8ccf0531 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:14.646318 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1091/2150] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:13:14 2022] POST /identity/v3/users => generated 298 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:13:14.650982 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805dc80c-11d5-4a88-bd61-6a8130fbd3bb admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:14.661984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805dc80c-11d5-4a88-bd61-6a8130fbd3bb admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:14.666784 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8b957-3b81-44c0-8b07-4a0a220aba5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:14.667353 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8b957-3b81-44c0-8b07-4a0a220aba5b admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:14.667630 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8b957-3b81-44c0-8b07-4a0a220aba5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:14.667910 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8b957-3b81-44c0-8b07-4a0a220aba5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:14.668663 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8b957-3b81-44c0-8b07-4a0a220aba5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:14.670309 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8b957-3b81-44c0-8b07-4a0a220aba5b admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:14.682675 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1060/2151] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:13:14.690322 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8803e-1ea8-4dda-b78b-39eb8ccf0531 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:14.707476 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8803e-1ea8-4dda-b78b-39eb8ccf0531 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:14.713630 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16221b-377b-4b6b-a07e-e467c8471961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:14.714406 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16221b-377b-4b6b-a07e-e467c8471961 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:14.714729 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16221b-377b-4b6b-a07e-e467c8471961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:14.715056 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16221b-377b-4b6b-a07e-e467c8471961 admin admin] PATH_INFO: `/v3/projects/8c1bd4f873c940e59c39b7846785c183/users/bd76ab3dc33c43d3a04bb1d2b653c19d/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:14.740331 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16221b-377b-4b6b-a07e-e467c8471961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c1bd4f873c940e59c39b7846785c183, user_id=bd76ab3dc33c43d3a04bb1d2b653c19d, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:14.740820 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16221b-377b-4b6b-a07e-e467c8471961 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:14.882062 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1092/2152] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:13:14 2022] PUT /identity/v3/projects/8c1bd4f873c940e59c39b7846785c183/users/bd76ab3dc33c43d3a04bb1d2b653c19d/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:13:14.886547 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8b957-3b81-44c0-8b07-4a0a220aba5b admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:14.899081 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8b957-3b81-44c0-8b07-4a0a220aba5b admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:14.981132 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a66b12-a49b-41c7-b861-68d0e294d0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:14.982254 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a66b12-a49b-41c7-b861-68d0e294d0fc admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:14.982958 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a66b12-a49b-41c7-b861-68d0e294d0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:14.983433 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a66b12-a49b-41c7-b861-68d0e294d0fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:14.984732 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a66b12-a49b-41c7-b861-68d0e294d0fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:14.987109 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a66b12-a49b-41c7-b861-68d0e294d0fc admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:15.005072 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1061/2153] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:13:15.012797 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16221b-377b-4b6b-a07e-e467c8471961 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:15.031515 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16221b-377b-4b6b-a07e-e467c8471961 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:15.040548 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f5847-771b-424f-afb2-5aeed8fb48b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:15.041640 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f5847-771b-424f-afb2-5aeed8fb48b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:15.042091 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f5847-771b-424f-afb2-5aeed8fb48b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:15.042562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f5847-771b-424f-afb2-5aeed8fb48b2 admin admin] PATH_INFO: `/v3/projects/8c1bd4f873c940e59c39b7846785c183/users/bd76ab3dc33c43d3a04bb1d2b653c19d/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:15.046203 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f5847-771b-424f-afb2-5aeed8fb48b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c1bd4f873c940e59c39b7846785c183, user_id=bd76ab3dc33c43d3a04bb1d2b653c19d, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:15.053056 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f5847-771b-424f-afb2-5aeed8fb48b2 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:15.073840 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1093/2154] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:13:15 2022] PUT /identity/v3/projects/8c1bd4f873c940e59c39b7846785c183/users/bd76ab3dc33c43d3a04bb1d2b653c19d/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:13:15.151745 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f487c-2a4f-4090-8a83-7e2f349eb926 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:15.152485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f487c-2a4f-4090-8a83-7e2f349eb926 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:15.152692 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f487c-2a4f-4090-8a83-7e2f349eb926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:15.199156 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-806f487c-2a4f-4090-8a83-7e2f349eb926 None None] MFA Rules not processed for user `bd76ab3dc33c43d3a04bb1d2b653c19d`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:13:15.201220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-806f487c-2a4f-4090-8a83-7e2f349eb926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:15.304132 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1062/2155] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:13:15 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:13:15.329979 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f5847-771b-424f-afb2-5aeed8fb48b2 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:15.350816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-731f5847-771b-424f-afb2-5aeed8fb48b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:15.452787 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f5847-771b-424f-afb2-5aeed8fb48b2 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:15.464978 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67c9e8-58e8-4328-8b54-fbd14d48846e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:15.466366 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67c9e8-58e8-4328-8b54-fbd14d48846e service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:15.466996 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67c9e8-58e8-4328-8b54-fbd14d48846e service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:15.467486 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67c9e8-58e8-4328-8b54-fbd14d48846e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:15.567006 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67c9e8-58e8-4328-8b54-fbd14d48846e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:15.568595 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67c9e8-58e8-4328-8b54-fbd14d48846e service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:15.579730 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1094/2156] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:13:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:13:18.171513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f487c-2a4f-4090-8a83-7e2f349eb926 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:18.194071 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f487c-2a4f-4090-8a83-7e2f349eb926 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:18.203823 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7f8c0-6cf7-407e-b2aa-86bac3e9f46c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:18.205990 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7f8c0-6cf7-407e-b2aa-86bac3e9f46c service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:18.207454 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7f8c0-6cf7-407e-b2aa-86bac3e9f46c service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:18.208064 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7f8c0-6cf7-407e-b2aa-86bac3e9f46c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:18.278171 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:18.328457 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7f8c0-6cf7-407e-b2aa-86bac3e9f46c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:18.329884 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7f8c0-6cf7-407e-b2aa-86bac3e9f46c service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:18.342842 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1063/2157] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:13:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:13:21.300658 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67c9e8-58e8-4328-8b54-fbd14d48846e service cinder] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:21.303153 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-8d67c9e8-58e8-4328-8b54-fbd14d48846e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:21.377204 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7f8c0-6cf7-407e-b2aa-86bac3e9f46c service cinder] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:21.406351 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7f8c0-6cf7-407e-b2aa-86bac3e9f46c service cinder] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:21.414420 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ecd7f-2fc5-4efb-808f-c0e8986b9d44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:21.416581 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ecd7f-2fc5-4efb-808f-c0e8986b9d44 service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:21.417189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ecd7f-2fc5-4efb-808f-c0e8986b9d44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:21.420963 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ecd7f-2fc5-4efb-808f-c0e8986b9d44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:21.427461 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:21.433118 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67c9e8-58e8-4328-8b54-fbd14d48846e service cinder] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:21.440762 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51518a-f12e-4e3a-ac4a-b77ce0d22847 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cac76aa21415d8ab0a2524a7049d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:21.441916 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51518a-f12e-4e3a-ac4a-b77ce0d22847 service placement] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:21.442275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51518a-f12e-4e3a-ac4a-b77ce0d22847 service placement] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:21.442644 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51518a-f12e-4e3a-ac4a-b77ce0d22847 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:21.445289 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-db51518a-f12e-4e3a-ac4a-b77ce0d22847 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:21.462827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51518a-f12e-4e3a-ac4a-b77ce0d22847 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:21.464812 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51518a-f12e-4e3a-ac4a-b77ce0d22847 service placement] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:21.473890 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ecd7f-2fc5-4efb-808f-c0e8986b9d44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:21.484134 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1095/2158] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:13:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:13:21.485218 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ecd7f-2fc5-4efb-808f-c0e8986b9d44 service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:21.510120 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1064/2159] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:13:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:13:25.254910 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338185a4-986c-417d-b462-606159e70359 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:25.257401 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338185a4-986c-417d-b462-606159e70359 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:25.258856 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338185a4-986c-417d-b462-606159e70359 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:25.260948 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1096/2160] 10.222.0.20 () {54 vars in 921 bytes} [Tue Aug 2 09:13:25 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:13:25.267902 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bc0eb-4cec-4bb5-afc3-d9458943e5e1 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:25.268549 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bc0eb-4cec-4bb5-afc3-d9458943e5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:25.268549 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bc0eb-4cec-4bb5-afc3-d9458943e5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:25.291353 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-797bc0eb-4cec-4bb5-afc3-d9458943e5e1 None None] MFA Rules not processed for user `7bfcddefa71546d28078a38325c723a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:13:25.292769 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-797bc0eb-4cec-4bb5-afc3-d9458943e5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:25.407660 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1065/2161] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Aug 2 09:13:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:13:25.421792 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338185a4-986c-417d-b462-606159e70359 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:25.423633 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-338185a4-986c-417d-b462-606159e70359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:25.506587 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338185a4-986c-417d-b462-606159e70359 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:25.514383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13dfec-bb74-4ecd-ba43-3a82b788ed91 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca8afe2c10f4db58716aacfd373504b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:25.515516 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13dfec-bb74-4ecd-ba43-3a82b788ed91 service glance] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:25.516067 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13dfec-bb74-4ecd-ba43-3a82b788ed91 service glance] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:25.516649 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13dfec-bb74-4ecd-ba43-3a82b788ed91 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:25.537117 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee13dfec-bb74-4ecd-ba43-3a82b788ed91 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:25.540036 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee13dfec-bb74-4ecd-ba43-3a82b788ed91 service glance] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:25.563307 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1097/2162] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:13:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:13:25.849474 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdaa78e-11a0-408e-b0cc-766659ca427f None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:25.849764 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdaa78e-11a0-408e-b0cc-766659ca427f None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:25.849989 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdaa78e-11a0-408e-b0cc-766659ca427f None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:25.852107 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1066/2163] 10.222.0.20 () {54 vars in 921 bytes} [Tue Aug 2 09:13:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:13:25.857744 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c7fcc-e306-414f-8a46-bf6e529b3bf9 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:25.858053 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c7fcc-e306-414f-8a46-bf6e529b3bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:25.858328 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c7fcc-e306-414f-8a46-bf6e529b3bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:25.884876 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-756c7fcc-e306-414f-8a46-bf6e529b3bf9 None None] MFA Rules not processed for user `6128f07ffd5f4357968b0e2e300f2e09`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:13:25.886423 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-756c7fcc-e306-414f-8a46-bf6e529b3bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:25.967358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1098/2164] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Aug 2 09:13:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:13:25.980937 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdaa78e-11a0-408e-b0cc-766659ca427f None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:25.982697 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-bbdaa78e-11a0-408e-b0cc-766659ca427f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:25.997469 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdaa78e-11a0-408e-b0cc-766659ca427f None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:26.002435 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fbe38-bf46-4102-bff0-e6d2ac9aa6e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:26.003378 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fbe38-bf46-4102-bff0-e6d2ac9aa6e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:26.003987 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fbe38-bf46-4102-bff0-e6d2ac9aa6e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:26.004474 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fbe38-bf46-4102-bff0-e6d2ac9aa6e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:26.013804 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3fbe38-bf46-4102-bff0-e6d2ac9aa6e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:26.015401 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3fbe38-bf46-4102-bff0-e6d2ac9aa6e8 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:26.038839 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1067/2165] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:13:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:13:26.122560 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf5a98-c7d5-4b54-845a-51d870fff24b None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:26.123679 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf5a98-c7d5-4b54-845a-51d870fff24b None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:26.124419 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf5a98-c7d5-4b54-845a-51d870fff24b None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:26.126670 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1099/2166] 10.222.0.20 () {54 vars in 921 bytes} [Tue Aug 2 09:13:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:13:26.135361 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a3f2b-7cdd-4a08-b6cb-7962f7af314a None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:26.135735 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a3f2b-7cdd-4a08-b6cb-7962f7af314a None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:26.136099 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a3f2b-7cdd-4a08-b6cb-7962f7af314a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:26.160482 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-023a3f2b-7cdd-4a08-b6cb-7962f7af314a None None] MFA Rules not processed for user `7bfcddefa71546d28078a38325c723a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:13:26.161824 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-023a3f2b-7cdd-4a08-b6cb-7962f7af314a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:26.186509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1068/2167] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Aug 2 09:13:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:13:26.210791 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf5a98-c7d5-4b54-845a-51d870fff24b None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:26.212878 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-a7bf5a98-c7d5-4b54-845a-51d870fff24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:26.233441 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf5a98-c7d5-4b54-845a-51d870fff24b None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:26.238159 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ecca2-137c-49f1-a1e7-79590c2d4eb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:26.238887 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ecca2-137c-49f1-a1e7-79590c2d4eb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:26.239239 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ecca2-137c-49f1-a1e7-79590c2d4eb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:26.239585 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ecca2-137c-49f1-a1e7-79590c2d4eb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:26.251266 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ecca2-137c-49f1-a1e7-79590c2d4eb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:26.253800 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ecca2-137c-49f1-a1e7-79590c2d4eb9 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:26.268425 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1100/2168] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:13:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:13:26.686477 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a3f2b-7cdd-4a08-b6cb-7962f7af314a None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:26.817121 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a3f2b-7cdd-4a08-b6cb-7962f7af314a None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:26.823871 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8625e3-f09a-4d26-84cd-e59826891931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:26.824944 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8625e3-f09a-4d26-84cd-e59826891931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:26.825418 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8625e3-f09a-4d26-84cd-e59826891931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:26.825990 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8625e3-f09a-4d26-84cd-e59826891931 admin admin] PATH_INFO: `/v3/users/dfcc860d540d47b4b7c914cc723dc9c3` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:26.827793 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8625e3-f09a-4d26-84cd-e59826891931 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfcc860d540d47b4b7c914cc723dc9c3)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:26.831628 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8625e3-f09a-4d26-84cd-e59826891931 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:27.166962 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:27.181159 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-2d8625e3-f09a-4d26-84cd-e59826891931 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfcc860d540d47b4b7c914cc723dc9c3'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:27.191945 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-2d8625e3-f09a-4d26-84cd-e59826891931 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfcc860d540d47b4b7c914cc723dc9c3'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:27.192860 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-2d8625e3-f09a-4d26-84cd-e59826891931 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfcc860d540d47b4b7c914cc723dc9c3'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:27.319955 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-2d8625e3-f09a-4d26-84cd-e59826891931 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfcc860d540d47b4b7c914cc723dc9c3'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:27.367157 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-2d8625e3-f09a-4d26-84cd-e59826891931 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfcc860d540d47b4b7c914cc723dc9c3'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:27.380756 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1069/2169] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:13:26 2022] DELETE /identity/v3/users/dfcc860d540d47b4b7c914cc723dc9c3 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:13:27.382306 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3b540-6f2f-40bb-bee1-6e89bbfc1283 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:27.392985 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3b540-6f2f-40bb-bee1-6e89bbfc1283 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:27.392985 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3b540-6f2f-40bb-bee1-6e89bbfc1283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:27.417067 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-44f3b540-6f2f-40bb-bee1-6e89bbfc1283 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:13:27.419378 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-44f3b540-6f2f-40bb-bee1-6e89bbfc1283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:27.570639 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1101/2170] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:13:27.587299 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8625e3-f09a-4d26-84cd-e59826891931 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:27.589740 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-2d8625e3-f09a-4d26-84cd-e59826891931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:27.703465 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8625e3-f09a-4d26-84cd-e59826891931 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:27.708639 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273f192-b8ce-4855-817c-1cf4ae49ce0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:27.717318 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273f192-b8ce-4855-817c-1cf4ae49ce0a service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:27.717318 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273f192-b8ce-4855-817c-1cf4ae49ce0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:27.717318 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273f192-b8ce-4855-817c-1cf4ae49ce0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:27.725272 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273f192-b8ce-4855-817c-1cf4ae49ce0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:27.727007 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273f192-b8ce-4855-817c-1cf4ae49ce0a service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:27.755061 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1070/2171] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:13:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:13:28.559985 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3b540-6f2f-40bb-bee1-6e89bbfc1283 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:28.562307 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-44f3b540-6f2f-40bb-bee1-6e89bbfc1283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:28.581513 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3b540-6f2f-40bb-bee1-6e89bbfc1283 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:28.590708 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189f1df-f05f-4953-9163-d34ac83aaef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:28.591901 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189f1df-f05f-4953-9163-d34ac83aaef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:28.592473 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189f1df-f05f-4953-9163-d34ac83aaef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:28.592970 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189f1df-f05f-4953-9163-d34ac83aaef5 admin admin] PATH_INFO: `/v3/projects/7ab0735f6ee4452a9e3971402b377e02` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:28.594695 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1189f1df-f05f-4953-9163-d34ac83aaef5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ab0735f6ee4452a9e3971402b377e02)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:28.600490 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1189f1df-f05f-4953-9163-d34ac83aaef5 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:28.786941 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:28.822109 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-1189f1df-f05f-4953-9163-d34ac83aaef5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ab0735f6ee4452a9e3971402b377e02', 'request_id': 'req-1189f1df-f05f-4953-9163-d34ac83aaef5'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:28.960564 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-1189f1df-f05f-4953-9163-d34ac83aaef5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ab0735f6ee4452a9e3971402b377e02', 'request_id': 'req-1189f1df-f05f-4953-9163-d34ac83aaef5'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:28.971581 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-1189f1df-f05f-4953-9163-d34ac83aaef5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ab0735f6ee4452a9e3971402b377e02', 'request_id': 'req-1189f1df-f05f-4953-9163-d34ac83aaef5'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:28.987865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-1189f1df-f05f-4953-9163-d34ac83aaef5 admin admin] The token cache is being invalidate because project 7ab0735f6ee4452a9e3971402b377e02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:13:28.988596 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-1189f1df-f05f-4953-9163-d34ac83aaef5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:28.989505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-1189f1df-f05f-4953-9163-d34ac83aaef5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:28.991150 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1102/2172] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:13:28 2022] DELETE /identity/v3/projects/7ab0735f6ee4452a9e3971402b377e02 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:13:28.996050 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273f192-b8ce-4855-817c-1cf4ae49ce0a service neutron] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:29.007277 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273f192-b8ce-4855-817c-1cf4ae49ce0a service neutron] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:29.155253 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873625d8-dd01-49b1-a871-0676ea73d0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:29.159761 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873625d8-dd01-49b1-a871-0676ea73d0bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:29.159761 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873625d8-dd01-49b1-a871-0676ea73d0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:29.159761 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873625d8-dd01-49b1-a871-0676ea73d0bb admin admin] PATH_INFO: `/v3/users/7aaa244c4fac4718bbcae145706f9423` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:29.165506 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873625d8-dd01-49b1-a871-0676ea73d0bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aaa244c4fac4718bbcae145706f9423)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:29.169849 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873625d8-dd01-49b1-a871-0676ea73d0bb admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:29.481267 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-873625d8-dd01-49b1-a871-0676ea73d0bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aaa244c4fac4718bbcae145706f9423'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:29.493341 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-873625d8-dd01-49b1-a871-0676ea73d0bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aaa244c4fac4718bbcae145706f9423'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:29.494591 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-873625d8-dd01-49b1-a871-0676ea73d0bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aaa244c4fac4718bbcae145706f9423'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:29.496487 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:29.587152 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-873625d8-dd01-49b1-a871-0676ea73d0bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aaa244c4fac4718bbcae145706f9423'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:29.623421 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-873625d8-dd01-49b1-a871-0676ea73d0bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aaa244c4fac4718bbcae145706f9423'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:29.662558 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1071/2173] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:13:28 2022] DELETE /identity/v3/users/7aaa244c4fac4718bbcae145706f9423 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:13:30.281805 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189f1df-f05f-4953-9163-d34ac83aaef5 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:30.284999 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-1189f1df-f05f-4953-9163-d34ac83aaef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:30.311440 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189f1df-f05f-4953-9163-d34ac83aaef5 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:30.415015 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddccd9e0-b325-401a-a832-be8da46235c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:30.416213 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddccd9e0-b325-401a-a832-be8da46235c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:30.416611 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddccd9e0-b325-401a-a832-be8da46235c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:30.417072 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddccd9e0-b325-401a-a832-be8da46235c3 admin admin] PATH_INFO: `/v3/projects/f3ee70adbc994c8c94a41f7ad03bd192` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:30.418687 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddccd9e0-b325-401a-a832-be8da46235c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3ee70adbc994c8c94a41f7ad03bd192)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:30.420938 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddccd9e0-b325-401a-a832-be8da46235c3 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:30.614857 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-ddccd9e0-b325-401a-a832-be8da46235c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3ee70adbc994c8c94a41f7ad03bd192', 'request_id': 'req-ddccd9e0-b325-401a-a832-be8da46235c3'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:30.753844 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-ddccd9e0-b325-401a-a832-be8da46235c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3ee70adbc994c8c94a41f7ad03bd192', 'request_id': 'req-ddccd9e0-b325-401a-a832-be8da46235c3'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:30.760358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-ddccd9e0-b325-401a-a832-be8da46235c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3ee70adbc994c8c94a41f7ad03bd192', 'request_id': 'req-ddccd9e0-b325-401a-a832-be8da46235c3'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:30.771807 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-ddccd9e0-b325-401a-a832-be8da46235c3 admin admin] The token cache is being invalidate because project f3ee70adbc994c8c94a41f7ad03bd192 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:13:30.772081 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-ddccd9e0-b325-401a-a832-be8da46235c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:30.772793 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-ddccd9e0-b325-401a-a832-be8da46235c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:30.774363 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1103/2174] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:13:30 2022] DELETE /identity/v3/projects/f3ee70adbc994c8c94a41f7ad03bd192 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:13:30.778447 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873625d8-dd01-49b1-a871-0676ea73d0bb admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:30.779962 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-873625d8-dd01-49b1-a871-0676ea73d0bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:30.799906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873625d8-dd01-49b1-a871-0676ea73d0bb admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:30.864015 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8976d2-e700-402a-940d-6688e70c8290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:30.864709 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8976d2-e700-402a-940d-6688e70c8290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:30.864985 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8976d2-e700-402a-940d-6688e70c8290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:30.865289 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8976d2-e700-402a-940d-6688e70c8290 admin admin] PATH_INFO: `/v3/users/bd76ab3dc33c43d3a04bb1d2b653c19d` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:30.866443 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8976d2-e700-402a-940d-6688e70c8290 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd76ab3dc33c43d3a04bb1d2b653c19d)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:30.868496 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8976d2-e700-402a-940d-6688e70c8290 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:31.136142 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-7d8976d2-e700-402a-940d-6688e70c8290 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd76ab3dc33c43d3a04bb1d2b653c19d'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:31.156182 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-7d8976d2-e700-402a-940d-6688e70c8290 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd76ab3dc33c43d3a04bb1d2b653c19d'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:31.157528 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-7d8976d2-e700-402a-940d-6688e70c8290 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd76ab3dc33c43d3a04bb1d2b653c19d'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:31.332540 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-7d8976d2-e700-402a-940d-6688e70c8290 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd76ab3dc33c43d3a04bb1d2b653c19d'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:31.351990 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-7d8976d2-e700-402a-940d-6688e70c8290 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd76ab3dc33c43d3a04bb1d2b653c19d'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:31.359420 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1072/2175] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:13:30 2022] DELETE /identity/v3/users/bd76ab3dc33c43d3a04bb1d2b653c19d => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:13:31.866327 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddccd9e0-b325-401a-a832-be8da46235c3 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:31.876420 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-ddccd9e0-b325-401a-a832-be8da46235c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:31.891643 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddccd9e0-b325-401a-a832-be8da46235c3 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:31.968270 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:31.992844 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75893d8-abf0-4bd2-b72b-ca92ce8287c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:31.993526 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75893d8-abf0-4bd2-b72b-ca92ce8287c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:31.993838 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75893d8-abf0-4bd2-b72b-ca92ce8287c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:31.995975 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75893d8-abf0-4bd2-b72b-ca92ce8287c7 admin admin] PATH_INFO: `/v3/projects/8c1bd4f873c940e59c39b7846785c183` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:31.995975 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75893d8-abf0-4bd2-b72b-ca92ce8287c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c1bd4f873c940e59c39b7846785c183)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:31.997626 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75893d8-abf0-4bd2-b72b-ca92ce8287c7 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:32.186321 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d75893d8-abf0-4bd2-b72b-ca92ce8287c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c1bd4f873c940e59c39b7846785c183', 'request_id': 'req-d75893d8-abf0-4bd2-b72b-ca92ce8287c7'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:32.333859 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d75893d8-abf0-4bd2-b72b-ca92ce8287c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c1bd4f873c940e59c39b7846785c183', 'request_id': 'req-d75893d8-abf0-4bd2-b72b-ca92ce8287c7'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:32.346239 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d75893d8-abf0-4bd2-b72b-ca92ce8287c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c1bd4f873c940e59c39b7846785c183', 'request_id': 'req-d75893d8-abf0-4bd2-b72b-ca92ce8287c7'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:32.367378 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d75893d8-abf0-4bd2-b72b-ca92ce8287c7 admin admin] The token cache is being invalidate because project 8c1bd4f873c940e59c39b7846785c183 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:13:32.367996 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d75893d8-abf0-4bd2-b72b-ca92ce8287c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:32.369628 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d75893d8-abf0-4bd2-b72b-ca92ce8287c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:32.372947 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1104/2176] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:13:31 2022] DELETE /identity/v3/projects/8c1bd4f873c940e59c39b7846785c183 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:13:32.615558 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf075a-7c61-4aec-af87-6ded0322c8c5 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:32.616025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf075a-7c61-4aec-af87-6ded0322c8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:32.624150 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf075a-7c61-4aec-af87-6ded0322c8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:32.666563 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-9baf075a-7c61-4aec-af87-6ded0322c8c5 None None] MFA Rules not processed for user `eb640d92cb9b49019f42351a60efe258`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:13:32.668308 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-9baf075a-7c61-4aec-af87-6ded0322c8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:32.752517 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:32.762754 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1073/2177] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Aug 2 09:13:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:13:32.779831 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75893d8-abf0-4bd2-b72b-ca92ce8287c7 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:32.781603 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-d75893d8-abf0-4bd2-b72b-ca92ce8287c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:32.894638 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75893d8-abf0-4bd2-b72b-ca92ce8287c7 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:32.903427 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642eb3a5-fb41-46ea-8abb-8e4ae89c8b9b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f8e572550b4ab5955d7a94f1563441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:32.904530 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642eb3a5-fb41-46ea-8abb-8e4ae89c8b9b service swift] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:32.904969 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642eb3a5-fb41-46ea-8abb-8e4ae89c8b9b service swift] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:32.905463 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642eb3a5-fb41-46ea-8abb-8e4ae89c8b9b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:32.920613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642eb3a5-fb41-46ea-8abb-8e4ae89c8b9b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:32.922639 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642eb3a5-fb41-46ea-8abb-8e4ae89c8b9b service swift] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:32.934049 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1105/2178] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Aug 2 09:13:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:13:42.851133 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:42.929186 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=63,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:48.732769 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf075a-7c61-4aec-af87-6ded0322c8c5 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:48.734440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-9baf075a-7c61-4aec-af87-6ded0322c8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:48.807492 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf075a-7c61-4aec-af87-6ded0322c8c5 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:48.816455 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea977f8-8ee2-43ab-93ab-0484860ff652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:48.816455 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea977f8-8ee2-43ab-93ab-0484860ff652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:48.816455 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea977f8-8ee2-43ab-93ab-0484860ff652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:48.816455 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea977f8-8ee2-43ab-93ab-0484860ff652 admin admin] PATH_INFO: `/v3/users/aa1c9d350c89483ba5744c703cd6afbe` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:48.816829 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea977f8-8ee2-43ab-93ab-0484860ff652 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa1c9d350c89483ba5744c703cd6afbe)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:48.818464 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea977f8-8ee2-43ab-93ab-0484860ff652 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:49.059129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-3ea977f8-8ee2-43ab-93ab-0484860ff652 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa1c9d350c89483ba5744c703cd6afbe'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:49.074445 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-3ea977f8-8ee2-43ab-93ab-0484860ff652 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa1c9d350c89483ba5744c703cd6afbe'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:49.076137 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-3ea977f8-8ee2-43ab-93ab-0484860ff652 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa1c9d350c89483ba5744c703cd6afbe'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:49.153012 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-3ea977f8-8ee2-43ab-93ab-0484860ff652 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa1c9d350c89483ba5744c703cd6afbe'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:49.170461 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-3ea977f8-8ee2-43ab-93ab-0484860ff652 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa1c9d350c89483ba5744c703cd6afbe'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:49.181771 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1074/2179] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:13:48 2022] DELETE /identity/v3/users/aa1c9d350c89483ba5744c703cd6afbe => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:13:49.187754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664722c-1c81-4aa4-8a89-d36ae5e180d2 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:49.188398 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664722c-1c81-4aa4-8a89-d36ae5e180d2 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:49.188502 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664722c-1c81-4aa4-8a89-d36ae5e180d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:49.212093 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-5664722c-1c81-4aa4-8a89-d36ae5e180d2 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:13:49.213305 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-5664722c-1c81-4aa4-8a89-d36ae5e180d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:49.281984 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1106/2180] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:13:49.295995 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea977f8-8ee2-43ab-93ab-0484860ff652 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:49.296629 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-3ea977f8-8ee2-43ab-93ab-0484860ff652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:49.371226 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea977f8-8ee2-43ab-93ab-0484860ff652 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:49.375215 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16041b77-aa51-4cdf-a4b1-1093bd372e4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:49.375863 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16041b77-aa51-4cdf-a4b1-1093bd372e4d service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:49.376689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16041b77-aa51-4cdf-a4b1-1093bd372e4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:49.376973 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16041b77-aa51-4cdf-a4b1-1093bd372e4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:49.390001 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16041b77-aa51-4cdf-a4b1-1093bd372e4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:49.393785 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16041b77-aa51-4cdf-a4b1-1093bd372e4d service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:49.404856 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1075/2181] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:13:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:13:49.939408 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664722c-1c81-4aa4-8a89-d36ae5e180d2 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:49.941422 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-5664722c-1c81-4aa4-8a89-d36ae5e180d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:49.956324 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664722c-1c81-4aa4-8a89-d36ae5e180d2 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:49.962388 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc883c-63d9-4b3b-becb-e35b7fd1951f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:49.963058 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc883c-63d9-4b3b-becb-e35b7fd1951f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:49.963341 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc883c-63d9-4b3b-becb-e35b7fd1951f admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:49.963658 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc883c-63d9-4b3b-becb-e35b7fd1951f admin admin] PATH_INFO: `/v3/projects/68c6d9036f7f48b09d7381163b39ad3f` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:49.964903 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc883c-63d9-4b3b-becb-e35b7fd1951f admin admin] RBAC: Authorizing `identity:delete_project(project_id=68c6d9036f7f48b09d7381163b39ad3f)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:49.966841 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc883c-63d9-4b3b-becb-e35b7fd1951f admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:50.121042 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d6bc883c-63d9-4b3b-becb-e35b7fd1951f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68c6d9036f7f48b09d7381163b39ad3f', 'request_id': 'req-d6bc883c-63d9-4b3b-becb-e35b7fd1951f'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:50.221884 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d6bc883c-63d9-4b3b-becb-e35b7fd1951f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68c6d9036f7f48b09d7381163b39ad3f', 'request_id': 'req-d6bc883c-63d9-4b3b-becb-e35b7fd1951f'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:50.229382 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d6bc883c-63d9-4b3b-becb-e35b7fd1951f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68c6d9036f7f48b09d7381163b39ad3f', 'request_id': 'req-d6bc883c-63d9-4b3b-becb-e35b7fd1951f'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:50.246898 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d6bc883c-63d9-4b3b-becb-e35b7fd1951f admin admin] The token cache is being invalidate because project 68c6d9036f7f48b09d7381163b39ad3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:13:50.247195 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d6bc883c-63d9-4b3b-becb-e35b7fd1951f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:50.248035 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d6bc883c-63d9-4b3b-becb-e35b7fd1951f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:13:50.249656 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1107/2182] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:13:49 2022] DELETE /identity/v3/projects/68c6d9036f7f48b09d7381163b39ad3f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:13:50.257167 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa0e7d-1692-41fb-981c-8b3a40849253 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:50.261599 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa0e7d-1692-41fb-981c-8b3a40849253 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:50.261599 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa0e7d-1692-41fb-981c-8b3a40849253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:50.280857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-9eaa0e7d-1692-41fb-981c-8b3a40849253 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:13:50.282095 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-9eaa0e7d-1692-41fb-981c-8b3a40849253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:50.302384 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:50.353852 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1076/2183] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:13:50.363699 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e71cbb-a53f-4a5a-bab5-3f9529f7aa1e None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:50.364016 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e71cbb-a53f-4a5a-bab5-3f9529f7aa1e None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:50.364306 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e71cbb-a53f-4a5a-bab5-3f9529f7aa1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:50.391008 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-59e71cbb-a53f-4a5a-bab5-3f9529f7aa1e None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:13:50.391008 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-59e71cbb-a53f-4a5a-bab5-3f9529f7aa1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:50.402287 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1108/2184] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:13:50.406954 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa0e7d-1692-41fb-981c-8b3a40849253 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:50.419059 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa0e7d-1692-41fb-981c-8b3a40849253 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:50.425442 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c19c28-c261-4bb5-852f-a4d9c0732e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:50.426065 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c19c28-c261-4bb5-852f-a4d9c0732e59 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:50.426338 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c19c28-c261-4bb5-852f-a4d9c0732e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:50.426613 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c19c28-c261-4bb5-852f-a4d9c0732e59 admin admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:50.427323 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c19c28-c261-4bb5-852f-a4d9c0732e59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:13:50.427621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c19c28-c261-4bb5-852f-a4d9c0732e59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:50.429300 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c19c28-c261-4bb5-852f-a4d9c0732e59 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:50.443643 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1077/2185] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:13:50.447841 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e71cbb-a53f-4a5a-bab5-3f9529f7aa1e None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:50.459609 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e71cbb-a53f-4a5a-bab5-3f9529f7aa1e None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:50.464739 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19768158-f622-4e8f-a459-d1648686a65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:50.465380 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19768158-f622-4e8f-a459-d1648686a65d admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:50.465657 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19768158-f622-4e8f-a459-d1648686a65d admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:50.465928 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19768158-f622-4e8f-a459-d1648686a65d admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:50.466621 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19768158-f622-4e8f-a459-d1648686a65d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:50.468579 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19768158-f622-4e8f-a459-d1648686a65d admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:50.573813 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1109/2186] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:13:50 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:13:50.578372 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c19c28-c261-4bb5-852f-a4d9c0732e59 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:50.589594 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c19c28-c261-4bb5-852f-a4d9c0732e59 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:50.659701 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5702f-7662-4baf-8fb9-1540fd889533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:50.660547 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5702f-7662-4baf-8fb9-1540fd889533 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:50.660875 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5702f-7662-4baf-8fb9-1540fd889533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:50.661220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5702f-7662-4baf-8fb9-1540fd889533 admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:50.662032 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5702f-7662-4baf-8fb9-1540fd889533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:50.664995 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5702f-7662-4baf-8fb9-1540fd889533 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:50.794945 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1078/2187] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:13:50 2022] POST /identity/v3/users => generated 287 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:13:50.800414 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19768158-f622-4e8f-a459-d1648686a65d admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:50.819856 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19768158-f622-4e8f-a459-d1648686a65d admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:50.831790 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae025c10-d730-430f-a2f1-bafc50d43176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:50.832676 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae025c10-d730-430f-a2f1-bafc50d43176 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:50.833173 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae025c10-d730-430f-a2f1-bafc50d43176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:50.833657 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae025c10-d730-430f-a2f1-bafc50d43176 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:50.834956 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae025c10-d730-430f-a2f1-bafc50d43176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:50.838066 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae025c10-d730-430f-a2f1-bafc50d43176 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:50.858902 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1110/2188] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:13:50.863968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5702f-7662-4baf-8fb9-1540fd889533 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:50.874381 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5702f-7662-4baf-8fb9-1540fd889533 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:50.879881 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a25b10-fcfb-4eb3-a32e-e8f4d525b2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:50.880668 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a25b10-fcfb-4eb3-a32e-e8f4d525b2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:50.880972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a25b10-fcfb-4eb3-a32e-e8f4d525b2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:50.881240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a25b10-fcfb-4eb3-a32e-e8f4d525b2e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:50.881938 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a25b10-fcfb-4eb3-a32e-e8f4d525b2e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:50.883583 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a25b10-fcfb-4eb3-a32e-e8f4d525b2e7 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:50.896931 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1079/2189] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:13:50.901438 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae025c10-d730-430f-a2f1-bafc50d43176 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:50.912955 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae025c10-d730-430f-a2f1-bafc50d43176 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:50.917766 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901c205-3150-4dbd-93d7-1114659642a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:50.918447 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901c205-3150-4dbd-93d7-1114659642a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:50.918721 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901c205-3150-4dbd-93d7-1114659642a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:50.918993 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901c205-3150-4dbd-93d7-1114659642a6 admin admin] PATH_INFO: `/v3/projects/8a56014e2738416a992738ec87e6e740/users/bc46b066d2854ab3913076baf6e8d112/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:50.937016 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901c205-3150-4dbd-93d7-1114659642a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a56014e2738416a992738ec87e6e740, user_id=bc46b066d2854ab3913076baf6e8d112, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:50.940621 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901c205-3150-4dbd-93d7-1114659642a6 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:51.028932 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1111/2190] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:13:50 2022] PUT /identity/v3/projects/8a56014e2738416a992738ec87e6e740/users/bc46b066d2854ab3913076baf6e8d112/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:13:51.054958 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4907f2-5b75-4ca6-88e4-f077ff2fa5e5 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:51.055377 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4907f2-5b75-4ca6-88e4-f077ff2fa5e5 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:51.055704 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4907f2-5b75-4ca6-88e4-f077ff2fa5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:51.117793 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-5d4907f2-5b75-4ca6-88e4-f077ff2fa5e5 None None] MFA Rules not processed for user `bc46b066d2854ab3913076baf6e8d112`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:13:51.119020 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-5d4907f2-5b75-4ca6-88e4-f077ff2fa5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:51.193362 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1080/2191] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:13:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:13:51.201295 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901c205-3150-4dbd-93d7-1114659642a6 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:51.203295 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-9901c205-3150-4dbd-93d7-1114659642a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:51.229056 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:51.275212 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901c205-3150-4dbd-93d7-1114659642a6 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:51.279198 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe291e-e1d6-4eee-a59e-312faf508ba3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:51.279889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe291e-e1d6-4eee-a59e-312faf508ba3 service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:51.280235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe291e-e1d6-4eee-a59e-312faf508ba3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:51.280521 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe291e-e1d6-4eee-a59e-312faf508ba3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:51.291983 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe291e-e1d6-4eee-a59e-312faf508ba3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:51.293788 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe291e-e1d6-4eee-a59e-312faf508ba3 service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:51.306693 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1112/2192] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:13:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:13:53.035031 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4907f2-5b75-4ca6-88e4-f077ff2fa5e5 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:53.036727 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-5d4907f2-5b75-4ca6-88e4-f077ff2fa5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:53.066037 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:53.123326 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4907f2-5b75-4ca6-88e4-f077ff2fa5e5 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:53.138656 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce79acb-3b73-47a2-986a-772cab1689ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:53.138656 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce79acb-3b73-47a2-986a-772cab1689ef service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:53.138656 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce79acb-3b73-47a2-986a-772cab1689ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:53.138656 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce79acb-3b73-47a2-986a-772cab1689ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:53.139034 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-4ce79acb-3b73-47a2-986a-772cab1689ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:53.207636 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce79acb-3b73-47a2-986a-772cab1689ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:53.209236 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce79acb-3b73-47a2-986a-772cab1689ef service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:53.220442 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1081/2193] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:13:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:13:58.057027 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958688a-9831-4422-abe2-a9bc7e3d7315 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:58.058001 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958688a-9831-4422-abe2-a9bc7e3d7315 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:58.058251 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958688a-9831-4422-abe2-a9bc7e3d7315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:58.083084 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-2958688a-9831-4422-abe2-a9bc7e3d7315 None None] MFA Rules not processed for user `eb640d92cb9b49019f42351a60efe258`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:13:58.084309 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-2958688a-9831-4422-abe2-a9bc7e3d7315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:58.152714 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1113/2194] 10.222.0.20 () {58 vars in 967 bytes} [Tue Aug 2 09:13:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:13:58.186581 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce79acb-3b73-47a2-986a-772cab1689ef service neutron] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:13:58.188077 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-4ce79acb-3b73-47a2-986a-772cab1689ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:13:58.287731 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce79acb-3b73-47a2-986a-772cab1689ef service neutron] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:13:58.293478 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77ff4e-f5ae-4ded-b175-704d7d304f65 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f8e572550b4ab5955d7a94f1563441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:13:58.294251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77ff4e-f5ae-4ded-b175-704d7d304f65 service swift] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:13:58.294711 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77ff4e-f5ae-4ded-b175-704d7d304f65 service swift] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:13:58.294989 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77ff4e-f5ae-4ded-b175-704d7d304f65 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:13:58.304816 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77ff4e-f5ae-4ded-b175-704d7d304f65 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:13:58.306510 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77ff4e-f5ae-4ded-b175-704d7d304f65 service swift] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:13:58.324477 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1082/2195] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Aug 2 09:13:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:14:03.606587 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958688a-9831-4422-abe2-a9bc7e3d7315 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:03.686923 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958688a-9831-4422-abe2-a9bc7e3d7315 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:03.693590 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed593b4-0586-4ec8-9f8d-d8205988dfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:03.694262 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed593b4-0586-4ec8-9f8d-d8205988dfcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:03.694540 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed593b4-0586-4ec8-9f8d-d8205988dfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:03.694916 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed593b4-0586-4ec8-9f8d-d8205988dfcb admin admin] PATH_INFO: `/v3/users/bc46b066d2854ab3913076baf6e8d112` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:03.696018 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed593b4-0586-4ec8-9f8d-d8205988dfcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc46b066d2854ab3913076baf6e8d112)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:03.698027 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed593b4-0586-4ec8-9f8d-d8205988dfcb admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:03.958094 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-4ed593b4-0586-4ec8-9f8d-d8205988dfcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc46b066d2854ab3913076baf6e8d112'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:04.056646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-4ed593b4-0586-4ec8-9f8d-d8205988dfcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc46b066d2854ab3913076baf6e8d112'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:04.066036 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-4ed593b4-0586-4ec8-9f8d-d8205988dfcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc46b066d2854ab3913076baf6e8d112'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:04.072683 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-4ed593b4-0586-4ec8-9f8d-d8205988dfcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc46b066d2854ab3913076baf6e8d112'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:04.072683 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-4ed593b4-0586-4ec8-9f8d-d8205988dfcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc46b066d2854ab3913076baf6e8d112'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:04.075497 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:04.089230 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1114/2196] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:14:03 2022] DELETE /identity/v3/users/bc46b066d2854ab3913076baf6e8d112 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:14:04.093963 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e356e-b013-449c-8f4c-52c4cb63e621 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:04.094464 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e356e-b013-449c-8f4c-52c4cb63e621 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:04.095130 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e356e-b013-449c-8f4c-52c4cb63e621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:04.115859 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-785e356e-b013-449c-8f4c-52c4cb63e621 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:14:04.117127 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-785e356e-b013-449c-8f4c-52c4cb63e621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:04.180096 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:04.191521 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1083/2197] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:14:04.202033 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed593b4-0586-4ec8-9f8d-d8205988dfcb admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:04.203825 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-4ed593b4-0586-4ec8-9f8d-d8205988dfcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:04.269119 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed593b4-0586-4ec8-9f8d-d8205988dfcb admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:04.274924 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4cd03-f332-46db-89bf-29c15126bdda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:04.275674 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4cd03-f332-46db-89bf-29c15126bdda service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:04.275883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4cd03-f332-46db-89bf-29c15126bdda service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:04.276130 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4cd03-f332-46db-89bf-29c15126bdda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:04.289219 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4cd03-f332-46db-89bf-29c15126bdda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:04.290975 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4cd03-f332-46db-89bf-29c15126bdda service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:04.302004 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1115/2198] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:14:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:14:04.876710 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e356e-b013-449c-8f4c-52c4cb63e621 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:04.878229 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-785e356e-b013-449c-8f4c-52c4cb63e621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:04.903486 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e356e-b013-449c-8f4c-52c4cb63e621 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:04.911004 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b7e2e-120e-4094-a924-6dd15a653261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:04.911686 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b7e2e-120e-4094-a924-6dd15a653261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:04.912034 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b7e2e-120e-4094-a924-6dd15a653261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:04.913143 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b7e2e-120e-4094-a924-6dd15a653261 admin admin] PATH_INFO: `/v3/projects/8a56014e2738416a992738ec87e6e740` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:04.913557 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804b7e2e-120e-4094-a924-6dd15a653261 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a56014e2738416a992738ec87e6e740)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:04.915510 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804b7e2e-120e-4094-a924-6dd15a653261 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:05.083168 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-804b7e2e-120e-4094-a924-6dd15a653261 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a56014e2738416a992738ec87e6e740', 'request_id': 'req-804b7e2e-120e-4094-a924-6dd15a653261'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:05.088898 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-804b7e2e-120e-4094-a924-6dd15a653261 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a56014e2738416a992738ec87e6e740', 'request_id': 'req-804b7e2e-120e-4094-a924-6dd15a653261'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:05.095930 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-804b7e2e-120e-4094-a924-6dd15a653261 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a56014e2738416a992738ec87e6e740', 'request_id': 'req-804b7e2e-120e-4094-a924-6dd15a653261'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:05.182649 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-804b7e2e-120e-4094-a924-6dd15a653261 admin admin] The token cache is being invalidate because project 8a56014e2738416a992738ec87e6e740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:14:05.182882 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-804b7e2e-120e-4094-a924-6dd15a653261 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:05.183550 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-804b7e2e-120e-4094-a924-6dd15a653261 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:05.185150 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1084/2199] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:14:04 2022] DELETE /identity/v3/projects/8a56014e2738416a992738ec87e6e740 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:14:05.190837 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e093e-7dbd-4cb5-a058-67e4196cb03d None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:05.191456 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e093e-7dbd-4cb5-a058-67e4196cb03d None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:05.191456 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e093e-7dbd-4cb5-a058-67e4196cb03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:05.215594 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-ad9e093e-7dbd-4cb5-a058-67e4196cb03d None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:14:05.216864 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-ad9e093e-7dbd-4cb5-a058-67e4196cb03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:05.296372 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1116/2200] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:14:05.305148 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc01c4f-995b-4813-b46e-b84208c1a5e3 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:05.305432 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc01c4f-995b-4813-b46e-b84208c1a5e3 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:05.305713 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc01c4f-995b-4813-b46e-b84208c1a5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:05.331015 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-1dc01c4f-995b-4813-b46e-b84208c1a5e3 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:14:05.332328 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-1dc01c4f-995b-4813-b46e-b84208c1a5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:05.348501 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1085/2201] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:14:05.353139 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e093e-7dbd-4cb5-a058-67e4196cb03d None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:05.364586 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e093e-7dbd-4cb5-a058-67e4196cb03d None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:05.369784 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998b0fc-48a3-4537-a6b9-e4b419cc323d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:05.370504 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998b0fc-48a3-4537-a6b9-e4b419cc323d admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:05.370826 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998b0fc-48a3-4537-a6b9-e4b419cc323d admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:05.371129 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998b0fc-48a3-4537-a6b9-e4b419cc323d admin admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:05.371914 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998b0fc-48a3-4537-a6b9-e4b419cc323d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:14:05.372418 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998b0fc-48a3-4537-a6b9-e4b419cc323d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:05.374261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998b0fc-48a3-4537-a6b9-e4b419cc323d admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:05.389574 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1117/2202] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:14:05.395392 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc01c4f-995b-4813-b46e-b84208c1a5e3 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:05.406392 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc01c4f-995b-4813-b46e-b84208c1a5e3 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:05.412955 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cac94-e03a-46bc-8714-30cab86e8d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:05.413813 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cac94-e03a-46bc-8714-30cab86e8d7f admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:05.414191 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cac94-e03a-46bc-8714-30cab86e8d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:05.414563 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cac94-e03a-46bc-8714-30cab86e8d7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:05.415378 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2cac94-e03a-46bc-8714-30cab86e8d7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:05.417649 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2cac94-e03a-46bc-8714-30cab86e8d7f admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:05.506337 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1086/2203] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:14:05 2022] POST /identity/v3/projects => generated 391 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:14:05.511559 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998b0fc-48a3-4537-a6b9-e4b419cc323d admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:05.529599 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998b0fc-48a3-4537-a6b9-e4b419cc323d admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:05.602676 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a49c2-34f8-4d3d-bfb4-0382ca02e82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:05.603350 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a49c2-34f8-4d3d-bfb4-0382ca02e82e admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:05.603632 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a49c2-34f8-4d3d-bfb4-0382ca02e82e admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:05.603906 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a49c2-34f8-4d3d-bfb4-0382ca02e82e admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:05.604614 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a49c2-34f8-4d3d-bfb4-0382ca02e82e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:05.606637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a49c2-34f8-4d3d-bfb4-0382ca02e82e admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:05.737028 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1118/2204] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:14:05 2022] POST /identity/v3/users => generated 296 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:14:05.744514 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cac94-e03a-46bc-8714-30cab86e8d7f admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:05.761345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cac94-e03a-46bc-8714-30cab86e8d7f admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:05.766658 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf13e0-8aed-403c-823a-1a5fff846ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:05.767215 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf13e0-8aed-403c-823a-1a5fff846ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:05.767568 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf13e0-8aed-403c-823a-1a5fff846ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:05.767851 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf13e0-8aed-403c-823a-1a5fff846ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:05.768600 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf13e0-8aed-403c-823a-1a5fff846ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:05.770324 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf13e0-8aed-403c-823a-1a5fff846ed5 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:05.782843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1087/2205] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:14:05.787937 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a49c2-34f8-4d3d-bfb4-0382ca02e82e admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:05.807313 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a49c2-34f8-4d3d-bfb4-0382ca02e82e admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:05.815759 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf914bf4-81b1-4889-99e2-58864a0b1020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:05.816876 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf914bf4-81b1-4889-99e2-58864a0b1020 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:05.818931 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf914bf4-81b1-4889-99e2-58864a0b1020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:05.818931 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf914bf4-81b1-4889-99e2-58864a0b1020 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:05.819486 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf914bf4-81b1-4889-99e2-58864a0b1020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:05.822310 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf914bf4-81b1-4889-99e2-58864a0b1020 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:05.824746 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:05.850648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1119/2206] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:14:05.852704 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf13e0-8aed-403c-823a-1a5fff846ed5 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:05.865314 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf13e0-8aed-403c-823a-1a5fff846ed5 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:05.870614 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57f0bd-e300-4c9a-95f6-bc729bd4efe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:05.871347 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57f0bd-e300-4c9a-95f6-bc729bd4efe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:05.871629 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57f0bd-e300-4c9a-95f6-bc729bd4efe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:05.871905 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57f0bd-e300-4c9a-95f6-bc729bd4efe6 admin admin] PATH_INFO: `/v3/projects/7c6403907afe4a44a59eb1cbe25f1647/users/b7b05dd49dd44f53b1b5a24239fbe7a0/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:05.888851 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57f0bd-e300-4c9a-95f6-bc729bd4efe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c6403907afe4a44a59eb1cbe25f1647, user_id=b7b05dd49dd44f53b1b5a24239fbe7a0, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:05.891658 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57f0bd-e300-4c9a-95f6-bc729bd4efe6 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:06.011321 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1088/2207] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:14:05 2022] PUT /identity/v3/projects/7c6403907afe4a44a59eb1cbe25f1647/users/b7b05dd49dd44f53b1b5a24239fbe7a0/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:14:06.024211 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a7842-e588-47fd-9bec-cf48641bc6f1 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:06.024531 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a7842-e588-47fd-9bec-cf48641bc6f1 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:06.024762 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a7842-e588-47fd-9bec-cf48641bc6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:06.058129 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-e75a7842-e588-47fd-9bec-cf48641bc6f1 None None] MFA Rules not processed for user `b7b05dd49dd44f53b1b5a24239fbe7a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:14:06.059390 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-e75a7842-e588-47fd-9bec-cf48641bc6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:06.145950 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1120/2208] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:14:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:14:06.154813 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57f0bd-e300-4c9a-95f6-bc729bd4efe6 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:06.156704 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-0e57f0bd-e300-4c9a-95f6-bc729bd4efe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:06.242301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57f0bd-e300-4c9a-95f6-bc729bd4efe6 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:06.245408 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcaa810-7c0c-4709-9229-2a5e52e934e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:06.246057 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcaa810-7c0c-4709-9229-2a5e52e934e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:06.246346 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcaa810-7c0c-4709-9229-2a5e52e934e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:06.246637 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcaa810-7c0c-4709-9229-2a5e52e934e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:06.258140 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcaa810-7c0c-4709-9229-2a5e52e934e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:06.260342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcaa810-7c0c-4709-9229-2a5e52e934e4 service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:06.274039 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1089/2209] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:14:06 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:14:16.143927 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=34 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:16.267959 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=81,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:28.680659 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a7842-e588-47fd-9bec-cf48641bc6f1 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:28.753278 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a7842-e588-47fd-9bec-cf48641bc6f1 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:28.757889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f5bad-afe9-4521-b25b-230d1bb71f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:28.758538 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f5bad-afe9-4521-b25b-230d1bb71f3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:28.758815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f5bad-afe9-4521-b25b-230d1bb71f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:28.759090 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f5bad-afe9-4521-b25b-230d1bb71f3f admin admin] PATH_INFO: `/v3/users/b7b05dd49dd44f53b1b5a24239fbe7a0` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:28.760288 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f5bad-afe9-4521-b25b-230d1bb71f3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7b05dd49dd44f53b1b5a24239fbe7a0)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:28.762202 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f5bad-afe9-4521-b25b-230d1bb71f3f admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:29.021043 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-f56f5bad-afe9-4521-b25b-230d1bb71f3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7b05dd49dd44f53b1b5a24239fbe7a0'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:29.165151 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-f56f5bad-afe9-4521-b25b-230d1bb71f3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7b05dd49dd44f53b1b5a24239fbe7a0'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:29.175072 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-f56f5bad-afe9-4521-b25b-230d1bb71f3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7b05dd49dd44f53b1b5a24239fbe7a0'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:29.175842 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-f56f5bad-afe9-4521-b25b-230d1bb71f3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7b05dd49dd44f53b1b5a24239fbe7a0'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:29.176483 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-f56f5bad-afe9-4521-b25b-230d1bb71f3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7b05dd49dd44f53b1b5a24239fbe7a0'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:29.195979 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1121/2210] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:14:28 2022] DELETE /identity/v3/users/b7b05dd49dd44f53b1b5a24239fbe7a0 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:14:29.200675 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee36de3-f203-41e5-8a01-bea6ed8a6027 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:29.201526 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee36de3-f203-41e5-8a01-bea6ed8a6027 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:29.201700 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee36de3-f203-41e5-8a01-bea6ed8a6027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:29.221960 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-fee36de3-f203-41e5-8a01-bea6ed8a6027 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:14:29.223193 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-fee36de3-f203-41e5-8a01-bea6ed8a6027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:29.294778 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1090/2211] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:14:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:14:29.305382 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f5bad-afe9-4521-b25b-230d1bb71f3f admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:29.306873 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-f56f5bad-afe9-4521-b25b-230d1bb71f3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:29.374158 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f5bad-afe9-4521-b25b-230d1bb71f3f admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:29.378951 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c64cf-f276-495c-a420-3244c678ffeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:29.379426 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c64cf-f276-495c-a420-3244c678ffeb service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:29.379767 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c64cf-f276-495c-a420-3244c678ffeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:29.380044 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c64cf-f276-495c-a420-3244c678ffeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:29.392261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c64cf-f276-495c-a420-3244c678ffeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:29.394104 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c64cf-f276-495c-a420-3244c678ffeb service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:29.404826 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1122/2212] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:14:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:14:30.001363 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee36de3-f203-41e5-8a01-bea6ed8a6027 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:30.002852 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-fee36de3-f203-41e5-8a01-bea6ed8a6027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:30.015584 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee36de3-f203-41e5-8a01-bea6ed8a6027 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:30.023888 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a139054-5789-4874-878a-d0c42de4130d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:30.025143 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a139054-5789-4874-878a-d0c42de4130d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:30.025643 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a139054-5789-4874-878a-d0c42de4130d admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:30.026143 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a139054-5789-4874-878a-d0c42de4130d admin admin] PATH_INFO: `/v3/projects/7c6403907afe4a44a59eb1cbe25f1647` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:30.028513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a139054-5789-4874-878a-d0c42de4130d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c6403907afe4a44a59eb1cbe25f1647)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:30.033009 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a139054-5789-4874-878a-d0c42de4130d admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:30.245964 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-3a139054-5789-4874-878a-d0c42de4130d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c6403907afe4a44a59eb1cbe25f1647', 'request_id': 'req-3a139054-5789-4874-878a-d0c42de4130d'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:30.253000 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-3a139054-5789-4874-878a-d0c42de4130d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c6403907afe4a44a59eb1cbe25f1647', 'request_id': 'req-3a139054-5789-4874-878a-d0c42de4130d'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:30.260246 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-3a139054-5789-4874-878a-d0c42de4130d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c6403907afe4a44a59eb1cbe25f1647', 'request_id': 'req-3a139054-5789-4874-878a-d0c42de4130d'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:30.334075 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-3a139054-5789-4874-878a-d0c42de4130d admin admin] The token cache is being invalidate because project 7c6403907afe4a44a59eb1cbe25f1647 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:14:30.334368 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-3a139054-5789-4874-878a-d0c42de4130d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:30.335194 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-3a139054-5789-4874-878a-d0c42de4130d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:14:30.337530 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1091/2213] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:14:30 2022] DELETE /identity/v3/projects/7c6403907afe4a44a59eb1cbe25f1647 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:14:30.345796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356e805-d2a6-46b2-8198-2ecdcff790cc None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:30.351839 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356e805-d2a6-46b2-8198-2ecdcff790cc None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:30.351839 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356e805-d2a6-46b2-8198-2ecdcff790cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:30.382206 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-5356e805-d2a6-46b2-8198-2ecdcff790cc None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:14:30.384440 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-5356e805-d2a6-46b2-8198-2ecdcff790cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:30.409262 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:30.465980 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1123/2214] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:14:30.475240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe009d-9fa7-4eb9-9e98-a71b1c886109 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:30.475527 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe009d-9fa7-4eb9-9e98-a71b1c886109 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:30.475810 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe009d-9fa7-4eb9-9e98-a71b1c886109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:30.500916 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-6cfe009d-9fa7-4eb9-9e98-a71b1c886109 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:14:30.502226 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-6cfe009d-9fa7-4eb9-9e98-a71b1c886109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:30.511129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1092/2215] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:14:30.516893 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356e805-d2a6-46b2-8198-2ecdcff790cc None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:30.528536 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356e805-d2a6-46b2-8198-2ecdcff790cc None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:30.534468 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3e91c-cdac-4a52-8fab-4810c628eff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:30.535135 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3e91c-cdac-4a52-8fab-4810c628eff6 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:30.535415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3e91c-cdac-4a52-8fab-4810c628eff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:30.535690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3e91c-cdac-4a52-8fab-4810c628eff6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:30.536465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3e91c-cdac-4a52-8fab-4810c628eff6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:14:30.536778 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3e91c-cdac-4a52-8fab-4810c628eff6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:30.538420 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3e91c-cdac-4a52-8fab-4810c628eff6 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:30.551362 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1124/2216] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:14:30.557007 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe009d-9fa7-4eb9-9e98-a71b1c886109 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:30.568297 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe009d-9fa7-4eb9-9e98-a71b1c886109 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:30.573750 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dca83e-738c-470f-9ec5-04b13f22ade7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:30.574399 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dca83e-738c-470f-9ec5-04b13f22ade7 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:30.574677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dca83e-738c-470f-9ec5-04b13f22ade7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:30.574958 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dca83e-738c-470f-9ec5-04b13f22ade7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:30.575656 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dca83e-738c-470f-9ec5-04b13f22ade7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:30.577899 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dca83e-738c-470f-9ec5-04b13f22ade7 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:30.685271 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1093/2217] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:14:30 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:14:30.690218 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3e91c-cdac-4a52-8fab-4810c628eff6 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:30.706396 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3e91c-cdac-4a52-8fab-4810c628eff6 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:30.786055 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b35dad-5e95-48de-b9e4-571a1fd4cca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:30.786627 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b35dad-5e95-48de-b9e4-571a1fd4cca3 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:30.786919 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b35dad-5e95-48de-b9e4-571a1fd4cca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:30.787192 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b35dad-5e95-48de-b9e4-571a1fd4cca3 admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:30.787897 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b35dad-5e95-48de-b9e4-571a1fd4cca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:30.789940 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b35dad-5e95-48de-b9e4-571a1fd4cca3 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:30.905857 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1125/2218] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:14:30 2022] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:14:30.910783 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dca83e-738c-470f-9ec5-04b13f22ade7 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:30.927536 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dca83e-738c-470f-9ec5-04b13f22ade7 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:30.933784 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842976d2-0572-4683-871c-bae544d65c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:30.934685 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842976d2-0572-4683-871c-bae544d65c85 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:30.935149 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842976d2-0572-4683-871c-bae544d65c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:30.935610 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842976d2-0572-4683-871c-bae544d65c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:30.936897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842976d2-0572-4683-871c-bae544d65c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:30.938782 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842976d2-0572-4683-871c-bae544d65c85 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:30.956898 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1094/2219] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:14:30.958122 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b35dad-5e95-48de-b9e4-571a1fd4cca3 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:30.972777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b35dad-5e95-48de-b9e4-571a1fd4cca3 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:30.979611 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84720a1-7193-4f31-97ee-0a8654acfb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:30.980363 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84720a1-7193-4f31-97ee-0a8654acfb9a admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:30.980681 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84720a1-7193-4f31-97ee-0a8654acfb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:30.980988 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84720a1-7193-4f31-97ee-0a8654acfb9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:30.981715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84720a1-7193-4f31-97ee-0a8654acfb9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:30.983382 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84720a1-7193-4f31-97ee-0a8654acfb9a admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:30.995357 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1126/2220] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:14:30.999848 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842976d2-0572-4683-871c-bae544d65c85 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:31.011239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842976d2-0572-4683-871c-bae544d65c85 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:31.016663 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ab164-2833-45f2-a3e2-d4083f1604de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:31.018579 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ab164-2833-45f2-a3e2-d4083f1604de admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:31.018579 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ab164-2833-45f2-a3e2-d4083f1604de admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:31.018579 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ab164-2833-45f2-a3e2-d4083f1604de admin admin] PATH_INFO: `/v3/projects/8e8d4b340fc54e639758d911a5ab16a7/users/c0a2b49114e0458f9625de698cc89861/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:31.035666 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ab164-2833-45f2-a3e2-d4083f1604de admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e8d4b340fc54e639758d911a5ab16a7, user_id=c0a2b49114e0458f9625de698cc89861, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:31.038446 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ab164-2833-45f2-a3e2-d4083f1604de admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:31.115586 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1095/2221] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:14:30 2022] PUT /identity/v3/projects/8e8d4b340fc54e639758d911a5ab16a7/users/c0a2b49114e0458f9625de698cc89861/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:14:31.121988 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934974ee-c1c9-4201-9e95-4b9dd2553bbe None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:31.122495 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934974ee-c1c9-4201-9e95-4b9dd2553bbe None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:31.122968 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934974ee-c1c9-4201-9e95-4b9dd2553bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:31.156194 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-934974ee-c1c9-4201-9e95-4b9dd2553bbe None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:14:31.158549 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-934974ee-c1c9-4201-9e95-4b9dd2553bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:31.244315 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1127/2222] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:14:31.255206 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ab164-2833-45f2-a3e2-d4083f1604de admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:31.257049 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-7e4ab164-2833-45f2-a3e2-d4083f1604de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:31.288811 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:31.334487 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ab164-2833-45f2-a3e2-d4083f1604de admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:31.338392 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7db7b-31b7-4c8c-b5c7-b91ab4d90ed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:31.345154 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7db7b-31b7-4c8c-b5c7-b91ab4d90ed1 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:31.345154 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7db7b-31b7-4c8c-b5c7-b91ab4d90ed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:31.345154 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7db7b-31b7-4c8c-b5c7-b91ab4d90ed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:31.353144 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7db7b-31b7-4c8c-b5c7-b91ab4d90ed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:31.354957 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7db7b-31b7-4c8c-b5c7-b91ab4d90ed1 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:31.373144 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1096/2223] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:14:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:14:37.940721 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0994ffc-414e-435c-83c2-152d42a952e8 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:37.941526 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0994ffc-414e-435c-83c2-152d42a952e8 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:37.941686 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0994ffc-414e-435c-83c2-152d42a952e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:37.977621 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-d0994ffc-414e-435c-83c2-152d42a952e8 None None] MFA Rules not processed for user `c0a2b49114e0458f9625de698cc89861`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:14:37.979312 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-d0994ffc-414e-435c-83c2-152d42a952e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:38.009456 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:38.096681 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1128/2224] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:14:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:14:38.096959 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7db7b-31b7-4c8c-b5c7-b91ab4d90ed1 service neutron] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:38.107039 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7db7b-31b7-4c8c-b5c7-b91ab4d90ed1 service neutron] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:38.112912 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffe2f2-c0c1-4dad-93f7-049346d5eaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:38.113608 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffe2f2-c0c1-4dad-93f7-049346d5eaed admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:38.113895 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffe2f2-c0c1-4dad-93f7-049346d5eaed admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:38.114158 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffe2f2-c0c1-4dad-93f7-049346d5eaed admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:38.115089 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffe2f2-c0c1-4dad-93f7-049346d5eaed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:38.117325 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffe2f2-c0c1-4dad-93f7-049346d5eaed admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:38.219669 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1097/2225] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:14:38 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:14:38.223968 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0994ffc-414e-435c-83c2-152d42a952e8 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:38.238118 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0994ffc-414e-435c-83c2-152d42a952e8 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:38.332571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cdf44-40ea-4bdc-a2d4-5f350fd1ab53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:38.332571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cdf44-40ea-4bdc-a2d4-5f350fd1ab53 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:38.332571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cdf44-40ea-4bdc-a2d4-5f350fd1ab53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:38.332571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cdf44-40ea-4bdc-a2d4-5f350fd1ab53 admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:38.333332 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78cdf44-40ea-4bdc-a2d4-5f350fd1ab53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:38.335381 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78cdf44-40ea-4bdc-a2d4-5f350fd1ab53 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:38.450327 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1129/2226] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:14:38 2022] POST /identity/v3/users => generated 295 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:14:38.455419 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffe2f2-c0c1-4dad-93f7-049346d5eaed admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:38.469252 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffe2f2-c0c1-4dad-93f7-049346d5eaed admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:38.483603 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf23f5e-710e-4f00-b6fe-2528222b39c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:38.486198 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf23f5e-710e-4f00-b6fe-2528222b39c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:38.486675 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf23f5e-710e-4f00-b6fe-2528222b39c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:38.487098 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf23f5e-710e-4f00-b6fe-2528222b39c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:38.487978 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf23f5e-710e-4f00-b6fe-2528222b39c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:38.490606 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf23f5e-710e-4f00-b6fe-2528222b39c2 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:38.513846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1098/2227] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:14:38.519868 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cdf44-40ea-4bdc-a2d4-5f350fd1ab53 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:38.544636 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cdf44-40ea-4bdc-a2d4-5f350fd1ab53 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:38.551008 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f52f1-747a-4ec9-82da-8f41c337afd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:38.551651 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f52f1-747a-4ec9-82da-8f41c337afd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:38.553298 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f52f1-747a-4ec9-82da-8f41c337afd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:38.553476 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f52f1-747a-4ec9-82da-8f41c337afd2 admin admin] PATH_INFO: `/v3/projects/c3310513afe54469b2a8d07a1ff6c6db/users/47ae81d900054622a22acf6db4ff094b/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:38.575505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f52f1-747a-4ec9-82da-8f41c337afd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3310513afe54469b2a8d07a1ff6c6db, user_id=47ae81d900054622a22acf6db4ff094b, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:38.581616 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f52f1-747a-4ec9-82da-8f41c337afd2 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:38.680656 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1130/2228] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:14:38 2022] PUT /identity/v3/projects/c3310513afe54469b2a8d07a1ff6c6db/users/47ae81d900054622a22acf6db4ff094b/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:14:38.686427 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf23f5e-710e-4f00-b6fe-2528222b39c2 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:38.699351 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf23f5e-710e-4f00-b6fe-2528222b39c2 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:38.783251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f7a29-a765-4752-9040-7e956956678a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:38.784210 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f7a29-a765-4752-9040-7e956956678a admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:38.784720 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f7a29-a765-4752-9040-7e956956678a admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:38.785143 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f7a29-a765-4752-9040-7e956956678a admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:38.786043 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f7a29-a765-4752-9040-7e956956678a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:38.788193 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f7a29-a765-4752-9040-7e956956678a admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:38.801265 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1099/2229] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:14:38.805539 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f52f1-747a-4ec9-82da-8f41c337afd2 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:38.821649 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f52f1-747a-4ec9-82da-8f41c337afd2 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:38.827918 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f173cd-124e-46b6-a110-8c10fd876678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:38.829457 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f173cd-124e-46b6-a110-8c10fd876678 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:38.829871 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f173cd-124e-46b6-a110-8c10fd876678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:38.830212 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f173cd-124e-46b6-a110-8c10fd876678 admin admin] PATH_INFO: `/v3/projects/c3310513afe54469b2a8d07a1ff6c6db/users/47ae81d900054622a22acf6db4ff094b/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:38.832516 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f173cd-124e-46b6-a110-8c10fd876678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3310513afe54469b2a8d07a1ff6c6db, user_id=47ae81d900054622a22acf6db4ff094b, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:38.835399 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f173cd-124e-46b6-a110-8c10fd876678 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:38.850086 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1131/2230] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:14:38 2022] PUT /identity/v3/projects/c3310513afe54469b2a8d07a1ff6c6db/users/47ae81d900054622a22acf6db4ff094b/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:14:46.934321 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd1be0-512e-4772-bb4b-8b7836067c5f None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:46.934958 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd1be0-512e-4772-bb4b-8b7836067c5f None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:46.935245 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd1be0-512e-4772-bb4b-8b7836067c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:46.993001 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-33dd1be0-512e-4772-bb4b-8b7836067c5f None None] MFA Rules not processed for user `47ae81d900054622a22acf6db4ff094b`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:14:46.995703 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-33dd1be0-512e-4772-bb4b-8b7836067c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:47.120711 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1100/2231] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:14:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:14:47.136934 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f173cd-124e-46b6-a110-8c10fd876678 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:47.141212 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-b4f173cd-124e-46b6-a110-8c10fd876678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:47.349995 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f173cd-124e-46b6-a110-8c10fd876678 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:47.363746 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252e7ef-2cb0-4c90-ba10-09266bf26586 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:47.364581 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252e7ef-2cb0-4c90-ba10-09266bf26586 service nova] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:47.364926 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252e7ef-2cb0-4c90-ba10-09266bf26586 service nova] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:47.365276 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252e7ef-2cb0-4c90-ba10-09266bf26586 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:47.372963 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:47.462902 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252e7ef-2cb0-4c90-ba10-09266bf26586 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:47.466362 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252e7ef-2cb0-4c90-ba10-09266bf26586 service nova] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:47.485601 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1132/2232] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:14:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:14:48.202273 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f7b24-2bc5-47c8-bd2c-1961dad29504 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:48.203723 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f7b24-2bc5-47c8-bd2c-1961dad29504 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:48.203723 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f7b24-2bc5-47c8-bd2c-1961dad29504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:48.227755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-662f7b24-2bc5-47c8-bd2c-1961dad29504 None None] MFA Rules not processed for user `ad3a9141e9284bb5a096fb04d3e9d581`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:14:48.229037 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-662f7b24-2bc5-47c8-bd2c-1961dad29504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:48.235727 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:48.341396 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1101/2233] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:14:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:14:56.125299 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea626c4-cabb-4aec-8026-a1600b3ca9d4 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:56.125691 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea626c4-cabb-4aec-8026-a1600b3ca9d4 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:56.126031 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea626c4-cabb-4aec-8026-a1600b3ca9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:56.154226 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-2ea626c4-cabb-4aec-8026-a1600b3ca9d4 None None] MFA Rules not processed for user `1eda94767d1547fa82f6407a4c7de1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:14:56.156473 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-2ea626c4-cabb-4aec-8026-a1600b3ca9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:56.292054 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1133/2234] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:14:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:14:58.539928 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=20 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:03.493764 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081f2bb-861e-4a75-b941-c5b6c96119b2 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:03.494818 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081f2bb-861e-4a75-b941-c5b6c96119b2 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:03.502421 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081f2bb-861e-4a75-b941-c5b6c96119b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:03.520600 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-d081f2bb-861e-4a75-b941-c5b6c96119b2 None None] MFA Rules not processed for user `4a1a40ef55434cd48a2dc4385880fe0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:15:03.522268 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-d081f2bb-861e-4a75-b941-c5b6c96119b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:03.628118 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1102/2235] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:15:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:15:06.271506 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=49 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:08.665054 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af269ff-50cf-417b-b0b6-702dc1767232 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:08.665690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af269ff-50cf-417b-b0b6-702dc1767232 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:08.665690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af269ff-50cf-417b-b0b6-702dc1767232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:08.699223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-0af269ff-50cf-417b-b0b6-702dc1767232 None None] MFA Rules not processed for user `c0a2b49114e0458f9625de698cc89861`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:15:08.701788 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-0af269ff-50cf-417b-b0b6-702dc1767232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:08.712059 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1134/2236] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:15:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:15:13.618349 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=25 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:18.065120 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081f2bb-861e-4a75-b941-c5b6c96119b2 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:15:18.067616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-d081f2bb-861e-4a75-b941-c5b6c96119b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:18.166762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081f2bb-861e-4a75-b941-c5b6c96119b2 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:15:18.174771 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a54063-c713-4ff0-9066-c5ce07eb5344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:15:18.175434 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a54063-c713-4ff0-9066-c5ce07eb5344 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:18.175713 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a54063-c713-4ff0-9066-c5ce07eb5344 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:18.175991 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a54063-c713-4ff0-9066-c5ce07eb5344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:18.178021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-42a54063-c713-4ff0-9066-c5ce07eb5344 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:18.194283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a54063-c713-4ff0-9066-c5ce07eb5344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:15:18.195966 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a54063-c713-4ff0-9066-c5ce07eb5344 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:15:18.209332 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1103/2237] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:15:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:15:18.690793 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:21.661939 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af269ff-50cf-417b-b0b6-702dc1767232 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:15:21.677197 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af269ff-50cf-417b-b0b6-702dc1767232 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:15:21.681445 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12893873-dc94-44b1-83c6-4277e3d2bbc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:15:21.682089 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12893873-dc94-44b1-83c6-4277e3d2bbc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:21.682369 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12893873-dc94-44b1-83c6-4277e3d2bbc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:21.682643 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12893873-dc94-44b1-83c6-4277e3d2bbc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:21.684557 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-12893873-dc94-44b1-83c6-4277e3d2bbc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:21.700389 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12893873-dc94-44b1-83c6-4277e3d2bbc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:15:21.703087 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12893873-dc94-44b1-83c6-4277e3d2bbc2 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:15:21.715453 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1135/2238] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:15:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:15:28.203651 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=26 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:31.710155 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=6 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:33.661715 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a54063-c713-4ff0-9066-c5ce07eb5344 service neutron] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:15:33.673232 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a54063-c713-4ff0-9066-c5ce07eb5344 service neutron] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:15:33.679497 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a996679-2d94-41f2-8438-f6ab908f5ba7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:15:33.680636 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a996679-2d94-41f2-8438-f6ab908f5ba7 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:33.681124 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a996679-2d94-41f2-8438-f6ab908f5ba7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:33.681592 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a996679-2d94-41f2-8438-f6ab908f5ba7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:33.698262 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a996679-2d94-41f2-8438-f6ab908f5ba7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:15:33.699984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a996679-2d94-41f2-8438-f6ab908f5ba7 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:15:33.712326 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1104/2239] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:15:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:15:43.707434 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=6 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:45.513834 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12893873-dc94-44b1-83c6-4277e3d2bbc2 service neutron] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:15:45.515746 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-12893873-dc94-44b1-83c6-4277e3d2bbc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:45.538718 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12893873-dc94-44b1-83c6-4277e3d2bbc2 service neutron] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:15:45.544828 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980edbf-23aa-4a46-8f4b-c1f865a99c1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:15:45.545460 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980edbf-23aa-4a46-8f4b-c1f865a99c1a service nova] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:45.546408 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980edbf-23aa-4a46-8f4b-c1f865a99c1a service nova] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:45.546682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980edbf-23aa-4a46-8f4b-c1f865a99c1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:45.548788 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-7980edbf-23aa-4a46-8f4b-c1f865a99c1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:45.561348 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980edbf-23aa-4a46-8f4b-c1f865a99c1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:15:45.565595 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980edbf-23aa-4a46-8f4b-c1f865a99c1a service nova] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:15:45.577976 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1136/2240] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:15:45 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:15:54.855466 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a996679-2d94-41f2-8438-f6ab908f5ba7 service neutron] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:15:54.871569 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a996679-2d94-41f2-8438-f6ab908f5ba7 service neutron] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:15:54.877633 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5afde-701c-4e1a-834e-edc67657b460 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:15:54.878269 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5afde-701c-4e1a-834e-edc67657b460 service nova] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:54.878554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5afde-701c-4e1a-834e-edc67657b460 service nova] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:54.878915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5afde-701c-4e1a-834e-edc67657b460 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:54.880718 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-a7b5afde-701c-4e1a-834e-edc67657b460 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:54.894457 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5afde-701c-4e1a-834e-edc67657b460 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:15:54.898776 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5afde-701c-4e1a-834e-edc67657b460 service nova] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:15:54.908950 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1105/2241] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:15:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:15:55.572175 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=6 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:04.902966 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=6 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:05.316228 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980edbf-23aa-4a46-8f4b-c1f865a99c1a service nova] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:05.335582 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980edbf-23aa-4a46-8f4b-c1f865a99c1a service nova] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:05.355352 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07c6c8-7668-4ca7-9eee-b28c2c9fe956 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:05.356435 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07c6c8-7668-4ca7-9eee-b28c2c9fe956 service nova] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:05.356902 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07c6c8-7668-4ca7-9eee-b28c2c9fe956 service nova] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:05.357466 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07c6c8-7668-4ca7-9eee-b28c2c9fe956 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:05.360338 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-ba07c6c8-7668-4ca7-9eee-b28c2c9fe956 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:05.377511 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07c6c8-7668-4ca7-9eee-b28c2c9fe956 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:05.381334 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07c6c8-7668-4ca7-9eee-b28c2c9fe956 service nova] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:05.459291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1137/2242] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:16:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:16:08.252682 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5afde-701c-4e1a-834e-edc67657b460 service nova] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:08.278044 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5afde-701c-4e1a-834e-edc67657b460 service nova] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:08.282701 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3965e8-6906-4057-b2f9-0f81938ef779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:08.283591 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3965e8-6906-4057-b2f9-0f81938ef779 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:08.284913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3965e8-6906-4057-b2f9-0f81938ef779 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:08.285689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3965e8-6906-4057-b2f9-0f81938ef779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:08.287952 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-1c3965e8-6906-4057-b2f9-0f81938ef779 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:08.381590 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3965e8-6906-4057-b2f9-0f81938ef779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:08.383184 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3965e8-6906-4057-b2f9-0f81938ef779 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:08.396405 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1106/2243] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:16:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:16:10.672365 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07c6c8-7668-4ca7-9eee-b28c2c9fe956 service nova] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:10.693065 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07c6c8-7668-4ca7-9eee-b28c2c9fe956 service nova] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:10.703755 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412927a-5631-4ee0-8c67-17f3e3e9b1b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:10.704712 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412927a-5631-4ee0-8c67-17f3e3e9b1b2 service nova] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:10.704990 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412927a-5631-4ee0-8c67-17f3e3e9b1b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:10.705289 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412927a-5631-4ee0-8c67-17f3e3e9b1b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:10.709311 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-9412927a-5631-4ee0-8c67-17f3e3e9b1b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:10.724810 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412927a-5631-4ee0-8c67-17f3e3e9b1b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:10.728382 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412927a-5631-4ee0-8c67-17f3e3e9b1b2 service nova] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:10.746358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1138/2244] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:16:10 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:16:12.122047 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3965e8-6906-4057-b2f9-0f81938ef779 service neutron] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:12.134329 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3965e8-6906-4057-b2f9-0f81938ef779 service neutron] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:12.142485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1fcde-790a-4c9d-a2c9-502b58c85f1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:12.143139 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1fcde-790a-4c9d-a2c9-502b58c85f1e service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:12.144426 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1fcde-790a-4c9d-a2c9-502b58c85f1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:12.144765 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1fcde-790a-4c9d-a2c9-502b58c85f1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:12.148301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-c8f1fcde-790a-4c9d-a2c9-502b58c85f1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:12.171671 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1fcde-790a-4c9d-a2c9-502b58c85f1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:12.177021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1fcde-790a-4c9d-a2c9-502b58c85f1e service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:12.200542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1107/2245] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:16:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:16:13.330353 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412927a-5631-4ee0-8c67-17f3e3e9b1b2 service nova] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:13.334085 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-9412927a-5631-4ee0-8c67-17f3e3e9b1b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:13.359095 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412927a-5631-4ee0-8c67-17f3e3e9b1b2 service nova] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:13.365053 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62ac0e-a1ec-4944-b880-7a93262b53c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:13.367236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62ac0e-a1ec-4944-b880-7a93262b53c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:13.367236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62ac0e-a1ec-4944-b880-7a93262b53c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:13.367236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62ac0e-a1ec-4944-b880-7a93262b53c2 admin admin] PATH_INFO: `/v3/users/1eda94767d1547fa82f6407a4c7de1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:13.368815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e62ac0e-a1ec-4944-b880-7a93262b53c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eda94767d1547fa82f6407a4c7de1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:13.372705 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e62ac0e-a1ec-4944-b880-7a93262b53c2 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:13.599653 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-3e62ac0e-a1ec-4944-b880-7a93262b53c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eda94767d1547fa82f6407a4c7de1d8'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:16:13.700648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-3e62ac0e-a1ec-4944-b880-7a93262b53c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eda94767d1547fa82f6407a4c7de1d8'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:16:13.706890 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-3e62ac0e-a1ec-4944-b880-7a93262b53c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eda94767d1547fa82f6407a4c7de1d8'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:16:13.708753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-3e62ac0e-a1ec-4944-b880-7a93262b53c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eda94767d1547fa82f6407a4c7de1d8'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:16:13.712905 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-3e62ac0e-a1ec-4944-b880-7a93262b53c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eda94767d1547fa82f6407a4c7de1d8'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:16:13.750633 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1139/2246] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:16:13 2022] DELETE /identity/v3/users/1eda94767d1547fa82f6407a4c7de1d8 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:16:14.118330 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1fcde-790a-4c9d-a2c9-502b58c85f1e service neutron] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:14.139469 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1fcde-790a-4c9d-a2c9-502b58c85f1e service neutron] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:14.225727 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e385983-22ec-47d7-bc73-1f556dfeadb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:14.226454 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e385983-22ec-47d7-bc73-1f556dfeadb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:14.226746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e385983-22ec-47d7-bc73-1f556dfeadb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:14.227025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e385983-22ec-47d7-bc73-1f556dfeadb6 admin admin] PATH_INFO: `/v3/projects/5b01727cea94442bb62b56e7a4ae57a0` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:14.228236 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e385983-22ec-47d7-bc73-1f556dfeadb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b01727cea94442bb62b56e7a4ae57a0)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:14.232009 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e385983-22ec-47d7-bc73-1f556dfeadb6 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:14.373488 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-8e385983-22ec-47d7-bc73-1f556dfeadb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b01727cea94442bb62b56e7a4ae57a0', 'request_id': 'req-8e385983-22ec-47d7-bc73-1f556dfeadb6'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:16:14.386861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-8e385983-22ec-47d7-bc73-1f556dfeadb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b01727cea94442bb62b56e7a4ae57a0', 'request_id': 'req-8e385983-22ec-47d7-bc73-1f556dfeadb6'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:16:14.400495 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-8e385983-22ec-47d7-bc73-1f556dfeadb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b01727cea94442bb62b56e7a4ae57a0', 'request_id': 'req-8e385983-22ec-47d7-bc73-1f556dfeadb6'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:16:14.479557 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-8e385983-22ec-47d7-bc73-1f556dfeadb6 admin admin] The token cache is being invalidate because project 5b01727cea94442bb62b56e7a4ae57a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:16:14.479846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-8e385983-22ec-47d7-bc73-1f556dfeadb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:16:14.480938 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-8e385983-22ec-47d7-bc73-1f556dfeadb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:16:14.482554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1108/2247] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:16:14 2022] DELETE /identity/v3/projects/5b01727cea94442bb62b56e7a4ae57a0 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:16:14.487838 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abed3c3-3323-467c-9e26-9dc68558847d None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:14.488364 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abed3c3-3323-467c-9e26-9dc68558847d None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:14.488482 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abed3c3-3323-467c-9e26-9dc68558847d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:14.509033 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-1abed3c3-3323-467c-9e26-9dc68558847d None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:16:14.510305 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-1abed3c3-3323-467c-9e26-9dc68558847d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:14.577079 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1140/2248] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:16:14.585577 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169718d-5510-40fe-a065-575ed69b0645 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:14.585857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169718d-5510-40fe-a065-575ed69b0645 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:14.586138 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169718d-5510-40fe-a065-575ed69b0645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:14.607413 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-3169718d-5510-40fe-a065-575ed69b0645 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:16:14.612507 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-3169718d-5510-40fe-a065-575ed69b0645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:14.620058 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1109/2249] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:16:14.624753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abed3c3-3323-467c-9e26-9dc68558847d None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:14.635975 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abed3c3-3323-467c-9e26-9dc68558847d None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:14.640690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993cf2d-3caa-4616-8702-acea54862f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:14.641394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993cf2d-3caa-4616-8702-acea54862f77 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:14.641597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993cf2d-3caa-4616-8702-acea54862f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:14.641872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993cf2d-3caa-4616-8702-acea54862f77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:14.642569 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993cf2d-3caa-4616-8702-acea54862f77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:16:14.642912 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993cf2d-3caa-4616-8702-acea54862f77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:14.644912 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993cf2d-3caa-4616-8702-acea54862f77 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:14.666955 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1141/2250] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:16:14.671952 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169718d-5510-40fe-a065-575ed69b0645 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:14.679923 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:14.683621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169718d-5510-40fe-a065-575ed69b0645 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:14.697218 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86745e56-988a-4104-aa7c-00a51f257867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:14.698517 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86745e56-988a-4104-aa7c-00a51f257867 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:14.698706 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86745e56-988a-4104-aa7c-00a51f257867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:14.699142 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86745e56-988a-4104-aa7c-00a51f257867 admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:14.700756 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86745e56-988a-4104-aa7c-00a51f257867 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:14.705113 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86745e56-988a-4104-aa7c-00a51f257867 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:14.944653 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1110/2251] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:16:14 2022] POST /identity/v3/projects => generated 357 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:16:14.947975 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993cf2d-3caa-4616-8702-acea54862f77 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:14.959330 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993cf2d-3caa-4616-8702-acea54862f77 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:14.999915 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:15.033086 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521ac3b-147d-4bf9-bc05-890de047b76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:15.033886 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521ac3b-147d-4bf9-bc05-890de047b76f admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:15.034340 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521ac3b-147d-4bf9-bc05-890de047b76f admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:15.034626 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521ac3b-147d-4bf9-bc05-890de047b76f admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:15.035515 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521ac3b-147d-4bf9-bc05-890de047b76f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:15.037506 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521ac3b-147d-4bf9-bc05-890de047b76f admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:15.123191 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1142/2252] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:16:14 2022] POST /identity/v3/users => generated 279 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:16:15.128737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86745e56-988a-4104-aa7c-00a51f257867 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:15.141716 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86745e56-988a-4104-aa7c-00a51f257867 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:15.147255 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585e5c4-580e-4ba0-9492-11d4270d248d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:15.147999 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585e5c4-580e-4ba0-9492-11d4270d248d admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:15.148425 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585e5c4-580e-4ba0-9492-11d4270d248d admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:15.149228 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585e5c4-580e-4ba0-9492-11d4270d248d admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:15.150037 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585e5c4-580e-4ba0-9492-11d4270d248d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:15.151862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585e5c4-580e-4ba0-9492-11d4270d248d admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:15.165648 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1111/2253] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:16:15.172454 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521ac3b-147d-4bf9-bc05-890de047b76f admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:15.187309 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521ac3b-147d-4bf9-bc05-890de047b76f admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:15.195693 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd3f5b-224e-4c46-8a44-e8e055aee620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:15.196601 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd3f5b-224e-4c46-8a44-e8e055aee620 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:15.202967 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd3f5b-224e-4c46-8a44-e8e055aee620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:15.202967 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd3f5b-224e-4c46-8a44-e8e055aee620 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:15.202967 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd3f5b-224e-4c46-8a44-e8e055aee620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:15.202967 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd3f5b-224e-4c46-8a44-e8e055aee620 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:15.219651 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1143/2254] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:16:15.224702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585e5c4-580e-4ba0-9492-11d4270d248d admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:15.236443 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585e5c4-580e-4ba0-9492-11d4270d248d admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:15.243293 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9adca-7069-4fb5-9946-235b99f5d1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:15.244270 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9adca-7069-4fb5-9946-235b99f5d1fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:15.244581 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9adca-7069-4fb5-9946-235b99f5d1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:15.244877 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9adca-7069-4fb5-9946-235b99f5d1fe admin admin] PATH_INFO: `/v3/projects/092f5fef38fe49b6891521ed8cf2ebf5/users/61ea54f037f6493baff18f0389ac37ac/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:15.263646 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae9adca-7069-4fb5-9946-235b99f5d1fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=092f5fef38fe49b6891521ed8cf2ebf5, user_id=61ea54f037f6493baff18f0389ac37ac, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:15.271755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae9adca-7069-4fb5-9946-235b99f5d1fe admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:15.414872 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1112/2255] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:16:15 2022] PUT /identity/v3/projects/092f5fef38fe49b6891521ed8cf2ebf5/users/61ea54f037f6493baff18f0389ac37ac/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:16:15.426636 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ccb0a-f3f7-415a-9ace-36522653f88e None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:15.427005 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ccb0a-f3f7-415a-9ace-36522653f88e None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:15.427196 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ccb0a-f3f7-415a-9ace-36522653f88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:15.458486 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-c00ccb0a-f3f7-415a-9ace-36522653f88e None None] MFA Rules not processed for user `61ea54f037f6493baff18f0389ac37ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:16:15.459139 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-c00ccb0a-f3f7-415a-9ace-36522653f88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:15.535721 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1144/2256] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:16:15 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:16:15.542380 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9adca-7069-4fb5-9946-235b99f5d1fe admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:15.626152 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9adca-7069-4fb5-9946-235b99f5d1fe admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:15.632219 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c481e-53e2-4a2f-ba00-aa40c83d1ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:15.632861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c481e-53e2-4a2f-ba00-aa40c83d1ac0 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:15.634170 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c481e-53e2-4a2f-ba00-aa40c83d1ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:15.634170 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c481e-53e2-4a2f-ba00-aa40c83d1ac0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:15.634170 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c481e-53e2-4a2f-ba00-aa40c83d1ac0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:15.636016 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c481e-53e2-4a2f-ba00-aa40c83d1ac0 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:15.762044 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1113/2257] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:16:15 2022] POST /identity/v3/projects => generated 357 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:16:15.765955 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ccb0a-f3f7-415a-9ace-36522653f88e None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:15.779763 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ccb0a-f3f7-415a-9ace-36522653f88e None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:15.855645 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43ca66-1426-43b5-b9e4-6b89e28bbe35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:15.856644 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43ca66-1426-43b5-b9e4-6b89e28bbe35 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:15.857113 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43ca66-1426-43b5-b9e4-6b89e28bbe35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:15.857355 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43ca66-1426-43b5-b9e4-6b89e28bbe35 admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:15.858121 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43ca66-1426-43b5-b9e4-6b89e28bbe35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:15.860078 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43ca66-1426-43b5-b9e4-6b89e28bbe35 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:15.979419 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1145/2258] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:16:15 2022] POST /identity/v3/users => generated 285 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:16:15.986366 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c481e-53e2-4a2f-ba00-aa40c83d1ac0 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:16.006563 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c481e-53e2-4a2f-ba00-aa40c83d1ac0 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:16.015717 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987814d-bed0-4ba9-b00c-84fd524efc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:16.016878 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987814d-bed0-4ba9-b00c-84fd524efc22 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:16.017361 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987814d-bed0-4ba9-b00c-84fd524efc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:16.017852 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987814d-bed0-4ba9-b00c-84fd524efc22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:16.019286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987814d-bed0-4ba9-b00c-84fd524efc22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:16.022574 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987814d-bed0-4ba9-b00c-84fd524efc22 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:16.037996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1114/2259] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:16:16.046808 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43ca66-1426-43b5-b9e4-6b89e28bbe35 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:16.072613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43ca66-1426-43b5-b9e4-6b89e28bbe35 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:16.078748 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fb021-2bed-48bb-84af-b7954ba9a0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:16.079531 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fb021-2bed-48bb-84af-b7954ba9a0da admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:16.079813 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fb021-2bed-48bb-84af-b7954ba9a0da admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:16.080090 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fb021-2bed-48bb-84af-b7954ba9a0da admin admin] PATH_INFO: `/v3/projects/ce4a43293b9b451396245bd394a1911f/users/901818501d804ef1a7a3379d2da971ae/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:16.105108 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fb021-2bed-48bb-84af-b7954ba9a0da admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce4a43293b9b451396245bd394a1911f, user_id=901818501d804ef1a7a3379d2da971ae, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:16.108130 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fb021-2bed-48bb-84af-b7954ba9a0da admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:16.232770 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1146/2260] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:16:16 2022] PUT /identity/v3/projects/ce4a43293b9b451396245bd394a1911f/users/901818501d804ef1a7a3379d2da971ae/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:16:16.239993 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987814d-bed0-4ba9-b00c-84fd524efc22 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:16.258874 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987814d-bed0-4ba9-b00c-84fd524efc22 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:16.354020 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b97d838-d715-4e0f-95b4-670e89d29560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:16.354928 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97d838-d715-4e0f-95b4-670e89d29560 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:16.355478 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97d838-d715-4e0f-95b4-670e89d29560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:16.355885 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97d838-d715-4e0f-95b4-670e89d29560 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:16.357020 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b97d838-d715-4e0f-95b4-670e89d29560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:16.359060 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b97d838-d715-4e0f-95b4-670e89d29560 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:16.371699 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1115/2261] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:16:16.376780 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fb021-2bed-48bb-84af-b7954ba9a0da admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:16.394283 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fb021-2bed-48bb-84af-b7954ba9a0da admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:16.400319 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64971462-c20b-4f50-a685-52dfad0c0ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:16.401174 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64971462-c20b-4f50-a685-52dfad0c0ac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:16.407758 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64971462-c20b-4f50-a685-52dfad0c0ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:16.408189 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64971462-c20b-4f50-a685-52dfad0c0ac2 admin admin] PATH_INFO: `/v3/projects/ce4a43293b9b451396245bd394a1911f/users/901818501d804ef1a7a3379d2da971ae/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:16.410935 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64971462-c20b-4f50-a685-52dfad0c0ac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce4a43293b9b451396245bd394a1911f, user_id=901818501d804ef1a7a3379d2da971ae, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:16.414002 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64971462-c20b-4f50-a685-52dfad0c0ac2 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:16.425410 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:16.436783 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1147/2262] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:16:16 2022] PUT /identity/v3/projects/ce4a43293b9b451396245bd394a1911f/users/901818501d804ef1a7a3379d2da971ae/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:16:16.451178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd8cd6-0dd3-4c96-8bf4-a864f675d31a None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:16.451561 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd8cd6-0dd3-4c96-8bf4-a864f675d31a None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:16.455404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd8cd6-0dd3-4c96-8bf4-a864f675d31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:16.490678 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-c6fd8cd6-0dd3-4c96-8bf4-a864f675d31a None None] MFA Rules not processed for user `901818501d804ef1a7a3379d2da971ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:16:16.495485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-c6fd8cd6-0dd3-4c96-8bf4-a864f675d31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:16.498707 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:16.600264 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1116/2263] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:16:16 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:16:16.617389 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64971462-c20b-4f50-a685-52dfad0c0ac2 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:16.620022 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-64971462-c20b-4f50-a685-52dfad0c0ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:16.712085 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64971462-c20b-4f50-a685-52dfad0c0ac2 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:16.716215 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c244be-71d5-4809-aa4a-c6f7d2f4cc2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:16.717155 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c244be-71d5-4809-aa4a-c6f7d2f4cc2e service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:16.717619 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c244be-71d5-4809-aa4a-c6f7d2f4cc2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:16.717997 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c244be-71d5-4809-aa4a-c6f7d2f4cc2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:16.751263 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c244be-71d5-4809-aa4a-c6f7d2f4cc2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:16.760604 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c244be-71d5-4809-aa4a-c6f7d2f4cc2e service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:16.786051 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1148/2264] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:16:16 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:16:17.159726 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd8cd6-0dd3-4c96-8bf4-a864f675d31a None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:17.176583 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd8cd6-0dd3-4c96-8bf4-a864f675d31a None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:17.190858 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bc93b-30be-47a2-a513-fd76dc6a859e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:17.196523 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bc93b-30be-47a2-a513-fd76dc6a859e service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:17.203290 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bc93b-30be-47a2-a513-fd76dc6a859e service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:17.203290 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bc93b-30be-47a2-a513-fd76dc6a859e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:17.355511 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082bc93b-30be-47a2-a513-fd76dc6a859e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:17.361526 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082bc93b-30be-47a2-a513-fd76dc6a859e service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:17.379008 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1117/2265] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:16:17 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:16:20.967142 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a049e-a6b1-4340-8cfa-1599cd11d66f None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:20.967728 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a049e-a6b1-4340-8cfa-1599cd11d66f None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:20.967728 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a049e-a6b1-4340-8cfa-1599cd11d66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:20.991514 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-762a049e-a6b1-4340-8cfa-1599cd11d66f None None] MFA Rules not processed for user `3bccd348dd13473e82ca33c42b840383`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:16:20.993064 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-762a049e-a6b1-4340-8cfa-1599cd11d66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:21.067079 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1149/2266] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:16:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:16:21.615601 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bc93b-30be-47a2-a513-fd76dc6a859e service cinder] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:21.617276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-082bc93b-30be-47a2-a513-fd76dc6a859e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:21.696554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bc93b-30be-47a2-a513-fd76dc6a859e service cinder] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:21.701163 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23601feb-9d79-423b-a052-a28d3294c2eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:21.701783 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23601feb-9d79-423b-a052-a28d3294c2eb service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:21.702063 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23601feb-9d79-423b-a052-a28d3294c2eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:21.702396 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23601feb-9d79-423b-a052-a28d3294c2eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:21.705087 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-23601feb-9d79-423b-a052-a28d3294c2eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:21.716351 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23601feb-9d79-423b-a052-a28d3294c2eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:21.717861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23601feb-9d79-423b-a052-a28d3294c2eb service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:21.726796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1118/2267] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:16:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:16:22.144606 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a049e-a6b1-4340-8cfa-1599cd11d66f None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:22.146181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-762a049e-a6b1-4340-8cfa-1599cd11d66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:22.272942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0c61e-5b9d-4051-944f-f4309aaa7669 None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:22.273517 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0c61e-5b9d-4051-944f-f4309aaa7669 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:22.273961 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0c61e-5b9d-4051-944f-f4309aaa7669 None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:22.275563 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1119/2268] 10.222.0.20 () {54 vars in 921 bytes} [Tue Aug 2 09:16:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:16:22.282179 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1c058-10c6-4c1a-925d-8c7a485112ea None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:22.282464 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1c058-10c6-4c1a-925d-8c7a485112ea None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:22.282746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1c058-10c6-4c1a-925d-8c7a485112ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:22.303186 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a049e-a6b1-4340-8cfa-1599cd11d66f None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:22.310066 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b161b6a-0d52-4165-95aa-f58879a1e626 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cac76aa21415d8ab0a2524a7049d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:22.310918 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b161b6a-0d52-4165-95aa-f58879a1e626 service placement] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:22.311378 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b161b6a-0d52-4165-95aa-f58879a1e626 service placement] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:22.311800 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b161b6a-0d52-4165-95aa-f58879a1e626 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:22.313906 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-8b161b6a-0d52-4165-95aa-f58879a1e626 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:22.325163 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-38d1c058-10c6-4c1a-925d-8c7a485112ea None None] MFA Rules not processed for user `7bfcddefa71546d28078a38325c723a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:16:22.326647 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-38d1c058-10c6-4c1a-925d-8c7a485112ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:22.329777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b161b6a-0d52-4165-95aa-f58879a1e626 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:22.331627 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b161b6a-0d52-4165-95aa-f58879a1e626 service placement] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:22.336318 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:22.345186 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1150/2269] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:16:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:16:22.384545 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:22.437906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1120/2270] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Aug 2 09:16:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:16:22.451279 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b161b6a-0d52-4165-95aa-f58879a1e626 service placement] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:22.456254 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-8b161b6a-0d52-4165-95aa-f58879a1e626 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:22.468377 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b161b6a-0d52-4165-95aa-f58879a1e626 service placement] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:22.475307 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7086f1f-964e-45fb-9bf6-6cefc3a5d1c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:22.475962 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7086f1f-964e-45fb-9bf6-6cefc3a5d1c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:22.476280 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7086f1f-964e-45fb-9bf6-6cefc3a5d1c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:22.476564 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7086f1f-964e-45fb-9bf6-6cefc3a5d1c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:22.489907 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7086f1f-964e-45fb-9bf6-6cefc3a5d1c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:22.491717 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7086f1f-964e-45fb-9bf6-6cefc3a5d1c4 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:22.510229 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1151/2271] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:16:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:16:23.718370 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1c058-10c6-4c1a-925d-8c7a485112ea None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:23.720203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-38d1c058-10c6-4c1a-925d-8c7a485112ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:23.763150 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1c058-10c6-4c1a-925d-8c7a485112ea None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:23.770712 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8e2b8-6767-484f-a9f2-665aa9363396 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:23.771570 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8e2b8-6767-484f-a9f2-665aa9363396 service nova] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:23.772037 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8e2b8-6767-484f-a9f2-665aa9363396 service nova] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:23.772704 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8e2b8-6767-484f-a9f2-665aa9363396 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:23.776553 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-3dd8e2b8-6767-484f-a9f2-665aa9363396 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:23.793283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8e2b8-6767-484f-a9f2-665aa9363396 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:23.795102 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8e2b8-6767-484f-a9f2-665aa9363396 service nova] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:23.808024 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1121/2272] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:16:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:16:25.679148 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c386a-edc1-48eb-a68b-9d4159f0a98f None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:25.679685 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c386a-edc1-48eb-a68b-9d4159f0a98f None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:25.679685 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c386a-edc1-48eb-a68b-9d4159f0a98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:25.700937 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-f90c386a-edc1-48eb-a68b-9d4159f0a98f None None] MFA Rules not processed for user `ad3a9141e9284bb5a096fb04d3e9d581`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:16:25.702282 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-f90c386a-edc1-48eb-a68b-9d4159f0a98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:25.771829 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1152/2273] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:16:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:16:33.802893 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=28 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:35.380465 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f99655-3bcb-4ed9-ae3a-cb7c509d37cd None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:35.381278 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f99655-3bcb-4ed9-ae3a-cb7c509d37cd None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:35.381278 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f99655-3bcb-4ed9-ae3a-cb7c509d37cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:35.415621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-84f99655-3bcb-4ed9-ae3a-cb7c509d37cd None None] MFA Rules not processed for user `eb640d92cb9b49019f42351a60efe258`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:16:35.416953 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-84f99655-3bcb-4ed9-ae3a-cb7c509d37cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:35.483698 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1122/2274] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Aug 2 09:16:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:16:35.644843 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c386a-edc1-48eb-a68b-9d4159f0a98f None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:35.646116 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-f90c386a-edc1-48eb-a68b-9d4159f0a98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:35.722483 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c386a-edc1-48eb-a68b-9d4159f0a98f None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:35.727570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e27be-4ca6-4290-8d23-69b8ccea7a6c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f8e572550b4ab5955d7a94f1563441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:35.728229 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e27be-4ca6-4290-8d23-69b8ccea7a6c service swift] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:35.728517 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e27be-4ca6-4290-8d23-69b8ccea7a6c service swift] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:35.728811 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e27be-4ca6-4290-8d23-69b8ccea7a6c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:35.737768 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e27be-4ca6-4290-8d23-69b8ccea7a6c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:35.739339 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e27be-4ca6-4290-8d23-69b8ccea7a6c service swift] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:35.749461 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1153/2275] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Aug 2 09:16:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:16:39.651175 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f99655-3bcb-4ed9-ae3a-cb7c509d37cd None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:39.653322 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-84f99655-3bcb-4ed9-ae3a-cb7c509d37cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:39.672050 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f99655-3bcb-4ed9-ae3a-cb7c509d37cd None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:39.679513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea86d1d-664b-4461-9cce-b5bc6e0a31a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:39.680759 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea86d1d-664b-4461-9cce-b5bc6e0a31a4 service nova] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:39.681179 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea86d1d-664b-4461-9cce-b5bc6e0a31a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:39.681729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea86d1d-664b-4461-9cce-b5bc6e0a31a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:39.685496 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-9ea86d1d-664b-4461-9cce-b5bc6e0a31a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:39.710996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea86d1d-664b-4461-9cce-b5bc6e0a31a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:39.713071 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea86d1d-664b-4461-9cce-b5bc6e0a31a4 service nova] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:39.742870 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1123/2276] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:16:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:16:39.842834 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e27be-4ca6-4290-8d23-69b8ccea7a6c service swift] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:40.082519 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e27be-4ca6-4290-8d23-69b8ccea7a6c service swift] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:40.091313 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797c6b0-2f06-4dce-a5c1-afa159af5a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:40.092284 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797c6b0-2f06-4dce-a5c1-afa159af5a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:40.092718 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797c6b0-2f06-4dce-a5c1-afa159af5a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:40.093160 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797c6b0-2f06-4dce-a5c1-afa159af5a19 admin admin] PATH_INFO: `/v3/users/61ea54f037f6493baff18f0389ac37ac` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:40.094564 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2797c6b0-2f06-4dce-a5c1-afa159af5a19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61ea54f037f6493baff18f0389ac37ac)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:40.098394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2797c6b0-2f06-4dce-a5c1-afa159af5a19 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:40.102378 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:40.302183 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-2797c6b0-2f06-4dce-a5c1-afa159af5a19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61ea54f037f6493baff18f0389ac37ac'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:16:40.378660 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-2797c6b0-2f06-4dce-a5c1-afa159af5a19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61ea54f037f6493baff18f0389ac37ac'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:16:40.410207 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-2797c6b0-2f06-4dce-a5c1-afa159af5a19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61ea54f037f6493baff18f0389ac37ac'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:16:40.411474 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-2797c6b0-2f06-4dce-a5c1-afa159af5a19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61ea54f037f6493baff18f0389ac37ac'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:16:40.416229 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-2797c6b0-2f06-4dce-a5c1-afa159af5a19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61ea54f037f6493baff18f0389ac37ac'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:16:40.474864 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1154/2277] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:16:39 2022] DELETE /identity/v3/users/61ea54f037f6493baff18f0389ac37ac => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:16:40.479654 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a52f7-fb65-4698-a7a7-c2f4fc3921e5 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:40.480535 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a52f7-fb65-4698-a7a7-c2f4fc3921e5 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:40.480995 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a52f7-fb65-4698-a7a7-c2f4fc3921e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:40.577214 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-ce3a52f7-fb65-4698-a7a7-c2f4fc3921e5 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:16:40.579371 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-ce3a52f7-fb65-4698-a7a7-c2f4fc3921e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:40.758169 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1124/2278] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:16:40.759510 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797c6b0-2f06-4dce-a5c1-afa159af5a19 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:40.761217 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-2797c6b0-2f06-4dce-a5c1-afa159af5a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:40.921764 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797c6b0-2f06-4dce-a5c1-afa159af5a19 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:40.927139 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669722a-05ca-41c9-8a3a-e838cc83c41e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:40.927922 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669722a-05ca-41c9-8a3a-e838cc83c41e service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:40.928424 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669722a-05ca-41c9-8a3a-e838cc83c41e service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:40.929026 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669722a-05ca-41c9-8a3a-e838cc83c41e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:40.959643 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669722a-05ca-41c9-8a3a-e838cc83c41e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:40.962168 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669722a-05ca-41c9-8a3a-e838cc83c41e service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:40.983675 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1155/2279] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:16:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:16:41.722865 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a52f7-fb65-4698-a7a7-c2f4fc3921e5 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:41.724497 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-ce3a52f7-fb65-4698-a7a7-c2f4fc3921e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:41.765781 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a52f7-fb65-4698-a7a7-c2f4fc3921e5 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:41.776082 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd93afd-b662-42ed-a6f4-b10854e36dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:41.777967 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd93afd-b662-42ed-a6f4-b10854e36dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:41.778808 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd93afd-b662-42ed-a6f4-b10854e36dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:41.779477 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd93afd-b662-42ed-a6f4-b10854e36dd4 admin admin] PATH_INFO: `/v3/projects/092f5fef38fe49b6891521ed8cf2ebf5` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:41.783053 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd93afd-b662-42ed-a6f4-b10854e36dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=092f5fef38fe49b6891521ed8cf2ebf5)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:41.785682 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd93afd-b662-42ed-a6f4-b10854e36dd4 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:42.006358 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-bcd93afd-b662-42ed-a6f4-b10854e36dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '092f5fef38fe49b6891521ed8cf2ebf5', 'request_id': 'req-bcd93afd-b662-42ed-a6f4-b10854e36dd4'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:16:42.022097 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-bcd93afd-b662-42ed-a6f4-b10854e36dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '092f5fef38fe49b6891521ed8cf2ebf5', 'request_id': 'req-bcd93afd-b662-42ed-a6f4-b10854e36dd4'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:16:42.026857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:42.038286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-bcd93afd-b662-42ed-a6f4-b10854e36dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '092f5fef38fe49b6891521ed8cf2ebf5', 'request_id': 'req-bcd93afd-b662-42ed-a6f4-b10854e36dd4'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:16:42.128778 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-bcd93afd-b662-42ed-a6f4-b10854e36dd4 admin admin] The token cache is being invalidate because project 092f5fef38fe49b6891521ed8cf2ebf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:16:42.129781 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-bcd93afd-b662-42ed-a6f4-b10854e36dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:16:42.137451 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-bcd93afd-b662-42ed-a6f4-b10854e36dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:16:42.140609 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1125/2280] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:16:41 2022] DELETE /identity/v3/projects/092f5fef38fe49b6891521ed8cf2ebf5 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:16:42.144943 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669722a-05ca-41c9-8a3a-e838cc83c41e service neutron] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:42.158589 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669722a-05ca-41c9-8a3a-e838cc83c41e service neutron] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:42.241782 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aae5a1-ba9c-48dc-b271-a1e2645be0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:42.242370 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aae5a1-ba9c-48dc-b271-a1e2645be0b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:42.242647 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aae5a1-ba9c-48dc-b271-a1e2645be0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:42.242928 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aae5a1-ba9c-48dc-b271-a1e2645be0b5 admin admin] PATH_INFO: `/v3/users/901818501d804ef1a7a3379d2da971ae` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:42.244381 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aae5a1-ba9c-48dc-b271-a1e2645be0b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=901818501d804ef1a7a3379d2da971ae)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:42.246360 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aae5a1-ba9c-48dc-b271-a1e2645be0b5 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:42.255154 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:42.510245 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-78aae5a1-ba9c-48dc-b271-a1e2645be0b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '901818501d804ef1a7a3379d2da971ae'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:16:42.600064 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-78aae5a1-ba9c-48dc-b271-a1e2645be0b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '901818501d804ef1a7a3379d2da971ae'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:16:42.611950 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-78aae5a1-ba9c-48dc-b271-a1e2645be0b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '901818501d804ef1a7a3379d2da971ae'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:16:42.612780 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-78aae5a1-ba9c-48dc-b271-a1e2645be0b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '901818501d804ef1a7a3379d2da971ae'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:16:42.613476 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-78aae5a1-ba9c-48dc-b271-a1e2645be0b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '901818501d804ef1a7a3379d2da971ae'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:16:42.651745 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1156/2281] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:16:42 2022] DELETE /identity/v3/users/901818501d804ef1a7a3379d2da971ae => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:16:43.490653 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd93afd-b662-42ed-a6f4-b10854e36dd4 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:43.493568 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-bcd93afd-b662-42ed-a6f4-b10854e36dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:43.524547 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd93afd-b662-42ed-a6f4-b10854e36dd4 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:43.661472 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf80039-5e37-45bb-b23c-cc742b848f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:43.662596 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf80039-5e37-45bb-b23c-cc742b848f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:43.663101 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf80039-5e37-45bb-b23c-cc742b848f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:43.663646 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf80039-5e37-45bb-b23c-cc742b848f2d admin admin] PATH_INFO: `/v3/projects/ce4a43293b9b451396245bd394a1911f` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:43.665411 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf80039-5e37-45bb-b23c-cc742b848f2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce4a43293b9b451396245bd394a1911f)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:43.667599 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf80039-5e37-45bb-b23c-cc742b848f2d admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:43.831225 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-edf80039-5e37-45bb-b23c-cc742b848f2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce4a43293b9b451396245bd394a1911f', 'request_id': 'req-edf80039-5e37-45bb-b23c-cc742b848f2d'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:16:43.845196 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-edf80039-5e37-45bb-b23c-cc742b848f2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce4a43293b9b451396245bd394a1911f', 'request_id': 'req-edf80039-5e37-45bb-b23c-cc742b848f2d'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:16:43.854841 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-edf80039-5e37-45bb-b23c-cc742b848f2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce4a43293b9b451396245bd394a1911f', 'request_id': 'req-edf80039-5e37-45bb-b23c-cc742b848f2d'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:16:44.313017 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-edf80039-5e37-45bb-b23c-cc742b848f2d admin admin] The token cache is being invalidate because project ce4a43293b9b451396245bd394a1911f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:16:44.316345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-edf80039-5e37-45bb-b23c-cc742b848f2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:16:44.316345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-edf80039-5e37-45bb-b23c-cc742b848f2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:16:44.316345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1126/2282] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:16:43 2022] DELETE /identity/v3/projects/ce4a43293b9b451396245bd394a1911f => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:16:44.321265 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd0c4f-7f6a-4e4e-9c75-f741fa79fd4d None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:44.321821 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd0c4f-7f6a-4e4e-9c75-f741fa79fd4d None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:44.321821 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd0c4f-7f6a-4e4e-9c75-f741fa79fd4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:44.373413 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-8ecd0c4f-7f6a-4e4e-9c75-f741fa79fd4d None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:16:44.375026 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-8ecd0c4f-7f6a-4e4e-9c75-f741fa79fd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:44.446898 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1157/2283] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:16:44.455261 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fe0c1-eb4e-450a-b2fb-eeb645cb3af5 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:44.455479 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fe0c1-eb4e-450a-b2fb-eeb645cb3af5 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:44.455789 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fe0c1-eb4e-450a-b2fb-eeb645cb3af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:44.479852 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-183fe0c1-eb4e-450a-b2fb-eeb645cb3af5 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:16:44.481372 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-183fe0c1-eb4e-450a-b2fb-eeb645cb3af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:44.493323 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1127/2284] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:16:44.494543 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd0c4f-7f6a-4e4e-9c75-f741fa79fd4d None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:44.506413 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd0c4f-7f6a-4e4e-9c75-f741fa79fd4d None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:44.517420 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b6e0e-9f17-49eb-95fb-155ae09d666d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:44.518483 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b6e0e-9f17-49eb-95fb-155ae09d666d admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:44.519560 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b6e0e-9f17-49eb-95fb-155ae09d666d admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:44.520099 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b6e0e-9f17-49eb-95fb-155ae09d666d admin admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:44.521169 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b6e0e-9f17-49eb-95fb-155ae09d666d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:16:44.521748 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b6e0e-9f17-49eb-95fb-155ae09d666d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:44.523663 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b6e0e-9f17-49eb-95fb-155ae09d666d admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:44.542651 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1158/2285] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:16:44.547253 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fe0c1-eb4e-450a-b2fb-eeb645cb3af5 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:44.565176 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fe0c1-eb4e-450a-b2fb-eeb645cb3af5 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:44.570658 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57084fb-6c26-4a9b-bfd1-a82948d613ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:44.571292 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57084fb-6c26-4a9b-bfd1-a82948d613ec admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:44.571568 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57084fb-6c26-4a9b-bfd1-a82948d613ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:44.571836 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57084fb-6c26-4a9b-bfd1-a82948d613ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:44.572536 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57084fb-6c26-4a9b-bfd1-a82948d613ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:44.574768 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57084fb-6c26-4a9b-bfd1-a82948d613ec admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:44.915237 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1128/2286] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:16:44 2022] POST /identity/v3/projects => generated 377 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:16:44.921269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b6e0e-9f17-49eb-95fb-155ae09d666d admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:44.933308 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b6e0e-9f17-49eb-95fb-155ae09d666d admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:45.106465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:45.115461 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994798a-a164-4416-9334-eb10eafdbbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:45.116297 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994798a-a164-4416-9334-eb10eafdbbf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:45.116973 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994798a-a164-4416-9334-eb10eafdbbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:45.117354 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994798a-a164-4416-9334-eb10eafdbbf3 admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:45.118163 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994798a-a164-4416-9334-eb10eafdbbf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:45.121826 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994798a-a164-4416-9334-eb10eafdbbf3 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:45.240865 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1159/2287] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:16:44 2022] POST /identity/v3/users => generated 289 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:16:45.253159 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57084fb-6c26-4a9b-bfd1-a82948d613ec admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:45.265308 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57084fb-6c26-4a9b-bfd1-a82948d613ec admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:45.274745 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930b6eb-f966-4a62-86f0-ef0dfadac731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:45.277493 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930b6eb-f966-4a62-86f0-ef0dfadac731 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:45.278190 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930b6eb-f966-4a62-86f0-ef0dfadac731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:45.278814 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930b6eb-f966-4a62-86f0-ef0dfadac731 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:45.280477 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930b6eb-f966-4a62-86f0-ef0dfadac731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:45.282709 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930b6eb-f966-4a62-86f0-ef0dfadac731 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:45.300952 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1129/2288] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:16:45.321797 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994798a-a164-4416-9334-eb10eafdbbf3 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:45.347321 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994798a-a164-4416-9334-eb10eafdbbf3 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:45.354866 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a7bf1-502b-4808-a6c4-ffd5e4727734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:45.356077 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a7bf1-502b-4808-a6c4-ffd5e4727734 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:45.356524 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a7bf1-502b-4808-a6c4-ffd5e4727734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:45.356814 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a7bf1-502b-4808-a6c4-ffd5e4727734 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:45.357721 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a7bf1-502b-4808-a6c4-ffd5e4727734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:45.363809 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a7bf1-502b-4808-a6c4-ffd5e4727734 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:45.401093 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1160/2289] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:16:45.402781 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930b6eb-f966-4a62-86f0-ef0dfadac731 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:45.434301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930b6eb-f966-4a62-86f0-ef0dfadac731 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:45.448376 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee3fdf-b417-411b-aa7c-528a9fa4b103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:45.449861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee3fdf-b417-411b-aa7c-528a9fa4b103 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:45.450517 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee3fdf-b417-411b-aa7c-528a9fa4b103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:45.451024 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee3fdf-b417-411b-aa7c-528a9fa4b103 admin admin] PATH_INFO: `/v3/projects/4a03bac61482463ea886809bdb41ba8f/users/156d54d67b994de9a6c10393bcac5b47/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:45.479339 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee3fdf-b417-411b-aa7c-528a9fa4b103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a03bac61482463ea886809bdb41ba8f, user_id=156d54d67b994de9a6c10393bcac5b47, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:45.486524 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee3fdf-b417-411b-aa7c-528a9fa4b103 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:45.689621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1130/2290] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:16:45 2022] PUT /identity/v3/projects/4a03bac61482463ea886809bdb41ba8f/users/156d54d67b994de9a6c10393bcac5b47/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:16:45.711418 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0af70-be38-41d4-a01f-0cc96cd7d7ef None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:45.712015 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0af70-be38-41d4-a01f-0cc96cd7d7ef None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:45.712317 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0af70-be38-41d4-a01f-0cc96cd7d7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:45.756330 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-05b0af70-be38-41d4-a01f-0cc96cd7d7ef None None] MFA Rules not processed for user `156d54d67b994de9a6c10393bcac5b47`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:16:45.757268 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-05b0af70-be38-41d4-a01f-0cc96cd7d7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:45.900251 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1161/2291] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:16:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:16:45.905474 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee3fdf-b417-411b-aa7c-528a9fa4b103 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:45.933642 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:46.044048 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee3fdf-b417-411b-aa7c-528a9fa4b103 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:46.054845 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223a8a3-0a9b-400f-b5fa-47c039d9b9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:46.055435 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223a8a3-0a9b-400f-b5fa-47c039d9b9df admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:46.056600 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223a8a3-0a9b-400f-b5fa-47c039d9b9df admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:46.057670 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223a8a3-0a9b-400f-b5fa-47c039d9b9df admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:46.059203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a223a8a3-0a9b-400f-b5fa-47c039d9b9df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:46.061215 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a223a8a3-0a9b-400f-b5fa-47c039d9b9df admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:46.163660 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1131/2292] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:16:45 2022] POST /identity/v3/projects => generated 375 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:16:46.167973 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0af70-be38-41d4-a01f-0cc96cd7d7ef None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:46.184713 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0af70-be38-41d4-a01f-0cc96cd7d7ef None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:46.301634 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177b3e6-17ad-4620-a784-ee46899ae287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:46.302209 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177b3e6-17ad-4620-a784-ee46899ae287 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:46.302494 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177b3e6-17ad-4620-a784-ee46899ae287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:46.302775 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177b3e6-17ad-4620-a784-ee46899ae287 admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:46.303482 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177b3e6-17ad-4620-a784-ee46899ae287 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:46.305598 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177b3e6-17ad-4620-a784-ee46899ae287 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:46.429146 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1162/2293] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:16:46 2022] POST /identity/v3/users => generated 294 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:16:46.433299 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223a8a3-0a9b-400f-b5fa-47c039d9b9df admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:46.444990 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223a8a3-0a9b-400f-b5fa-47c039d9b9df admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:46.457116 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c20b9-e316-48aa-9097-a4676318e998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:46.458453 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c20b9-e316-48aa-9097-a4676318e998 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:46.459092 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c20b9-e316-48aa-9097-a4676318e998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:46.459576 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c20b9-e316-48aa-9097-a4676318e998 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:46.461048 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c20b9-e316-48aa-9097-a4676318e998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:46.463384 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c20b9-e316-48aa-9097-a4676318e998 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:46.484507 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177b3e6-17ad-4620-a784-ee46899ae287 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:46.494104 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1132/2294] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:16:46.499674 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177b3e6-17ad-4620-a784-ee46899ae287 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:46.506189 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb86e67-39b4-49af-95c7-101c72273fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:46.506907 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb86e67-39b4-49af-95c7-101c72273fb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:46.507255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb86e67-39b4-49af-95c7-101c72273fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:46.507537 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb86e67-39b4-49af-95c7-101c72273fb4 admin admin] PATH_INFO: `/v3/projects/e87678f6ecae47a284cfe622db4a23e0/users/925531ea3d8841d2a773331e62efba68/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:46.556093 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb86e67-39b4-49af-95c7-101c72273fb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e87678f6ecae47a284cfe622db4a23e0, user_id=925531ea3d8841d2a773331e62efba68, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:46.562006 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb86e67-39b4-49af-95c7-101c72273fb4 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:46.673399 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1163/2295] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:16:46 2022] PUT /identity/v3/projects/e87678f6ecae47a284cfe622db4a23e0/users/925531ea3d8841d2a773331e62efba68/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:16:46.680211 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c20b9-e316-48aa-9097-a4676318e998 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:46.702164 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c20b9-e316-48aa-9097-a4676318e998 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:46.859097 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43e7f7-9a26-4ae5-94ae-b0d2b76037bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:46.866331 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43e7f7-9a26-4ae5-94ae-b0d2b76037bc admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:46.866856 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43e7f7-9a26-4ae5-94ae-b0d2b76037bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:46.867683 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43e7f7-9a26-4ae5-94ae-b0d2b76037bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:46.868894 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec43e7f7-9a26-4ae5-94ae-b0d2b76037bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:46.874541 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec43e7f7-9a26-4ae5-94ae-b0d2b76037bc admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:46.905764 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1133/2296] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:16:46.906862 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb86e67-39b4-49af-95c7-101c72273fb4 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:46.926898 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb86e67-39b4-49af-95c7-101c72273fb4 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:46.932995 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551ab5f-09c7-4a5d-9176-34aa546631a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:46.934466 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551ab5f-09c7-4a5d-9176-34aa546631a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:46.934945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551ab5f-09c7-4a5d-9176-34aa546631a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:46.935465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551ab5f-09c7-4a5d-9176-34aa546631a2 admin admin] PATH_INFO: `/v3/projects/e87678f6ecae47a284cfe622db4a23e0/users/925531ea3d8841d2a773331e62efba68/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:46.942692 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9551ab5f-09c7-4a5d-9176-34aa546631a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e87678f6ecae47a284cfe622db4a23e0, user_id=925531ea3d8841d2a773331e62efba68, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:46.947658 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9551ab5f-09c7-4a5d-9176-34aa546631a2 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:46.964516 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1164/2297] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:16:46 2022] PUT /identity/v3/projects/e87678f6ecae47a284cfe622db4a23e0/users/925531ea3d8841d2a773331e62efba68/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:16:46.978366 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dae8cc-9dd3-4289-b07c-a6b423211114 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:46.978627 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dae8cc-9dd3-4289-b07c-a6b423211114 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:46.978908 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dae8cc-9dd3-4289-b07c-a6b423211114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:47.034130 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-33dae8cc-9dd3-4289-b07c-a6b423211114 None None] MFA Rules not processed for user `925531ea3d8841d2a773331e62efba68`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:16:47.036295 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-33dae8cc-9dd3-4289-b07c-a6b423211114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:47.210921 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1134/2298] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:16:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:16:47.228808 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551ab5f-09c7-4a5d-9176-34aa546631a2 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:47.231610 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-9551ab5f-09c7-4a5d-9176-34aa546631a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:47.291270 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:47.429411 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551ab5f-09c7-4a5d-9176-34aa546631a2 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:47.440064 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb0732-722c-493f-bf76-e5565dd83e99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:47.442235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb0732-722c-493f-bf76-e5565dd83e99 service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:47.442864 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb0732-722c-493f-bf76-e5565dd83e99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:47.443424 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb0732-722c-493f-bf76-e5565dd83e99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:47.567747 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb0732-722c-493f-bf76-e5565dd83e99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:47.569039 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb0732-722c-493f-bf76-e5565dd83e99 service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:47.581565 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1165/2299] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:16:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:16:54.919859 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dae8cc-9dd3-4289-b07c-a6b423211114 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:54.921587 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-33dae8cc-9dd3-4289-b07c-a6b423211114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:54.930668 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:54.936922 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dae8cc-9dd3-4289-b07c-a6b423211114 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:54.941093 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f137b8f-e30e-4919-b376-8e7e9c17b730 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:54.941731 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f137b8f-e30e-4919-b376-8e7e9c17b730 service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:54.942009 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f137b8f-e30e-4919-b376-8e7e9c17b730 service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:54.942280 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f137b8f-e30e-4919-b376-8e7e9c17b730 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:54.952457 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f137b8f-e30e-4919-b376-8e7e9c17b730 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:54.953905 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f137b8f-e30e-4919-b376-8e7e9c17b730 service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:54.988964 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1135/2300] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:16:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:16:57.575565 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=50 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:02.087814 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321c0a4-d23f-4bab-954c-3ed3cdde4009 None None] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:02.088866 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321c0a4-d23f-4bab-954c-3ed3cdde4009 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:02.088866 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321c0a4-d23f-4bab-954c-3ed3cdde4009 None None] PATH_INFO: `/` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:02.092240 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1166/2301] 10.222.0.20 () {54 vars in 921 bytes} [Tue Aug 2 09:17:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:17:02.098524 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca66ab-7a0d-40a3-a217-a1fd55089a2d None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:02.099113 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca66ab-7a0d-40a3-a217-a1fd55089a2d None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:02.099113 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca66ab-7a0d-40a3-a217-a1fd55089a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:02.123682 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-2eca66ab-7a0d-40a3-a217-a1fd55089a2d None None] MFA Rules not processed for user `7bfcddefa71546d28078a38325c723a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:17:02.126251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-2eca66ab-7a0d-40a3-a217-a1fd55089a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:02.217164 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1136/2302] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Aug 2 09:17:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:17:02.229306 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321c0a4-d23f-4bab-954c-3ed3cdde4009 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:02.231089 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-4321c0a4-d23f-4bab-954c-3ed3cdde4009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:02.312900 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321c0a4-d23f-4bab-954c-3ed3cdde4009 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:02.317075 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c19f727-af5b-4272-b629-876a54f14d39 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca8afe2c10f4db58716aacfd373504b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:02.317732 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19f727-af5b-4272-b629-876a54f14d39 service glance] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:02.318016 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19f727-af5b-4272-b629-876a54f14d39 service glance] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:02.318289 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19f727-af5b-4272-b629-876a54f14d39 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:02.331054 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c19f727-af5b-4272-b629-876a54f14d39 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:02.332652 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c19f727-af5b-4272-b629-876a54f14d39 service glance] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:02.344683 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1167/2303] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:17:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:17:02.600611 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebd484-b8a9-4eb4-a0a4-f1b261f8cd1b None None] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:02.600845 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebd484-b8a9-4eb4-a0a4-f1b261f8cd1b None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:02.601068 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebd484-b8a9-4eb4-a0a4-f1b261f8cd1b None None] PATH_INFO: `/` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:02.602434 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1137/2304] 10.222.0.20 () {54 vars in 921 bytes} [Tue Aug 2 09:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:17:02.608641 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908ccb0-1c15-48d5-8fa3-496f2bc7e0e2 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:02.608926 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908ccb0-1c15-48d5-8fa3-496f2bc7e0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:02.609208 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908ccb0-1c15-48d5-8fa3-496f2bc7e0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:02.631576 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-d908ccb0-1c15-48d5-8fa3-496f2bc7e0e2 None None] MFA Rules not processed for user `6128f07ffd5f4357968b0e2e300f2e09`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:17:02.632828 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-d908ccb0-1c15-48d5-8fa3-496f2bc7e0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:02.692855 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1168/2305] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Aug 2 09:17:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:17:02.705387 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebd484-b8a9-4eb4-a0a4-f1b261f8cd1b None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:02.709201 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-adebd484-b8a9-4eb4-a0a4-f1b261f8cd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:02.727811 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebd484-b8a9-4eb4-a0a4-f1b261f8cd1b None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:02.731739 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73188366-8dce-4b10-aa66-51088af267cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:02.732472 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73188366-8dce-4b10-aa66-51088af267cb service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:02.732892 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73188366-8dce-4b10-aa66-51088af267cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:02.733067 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73188366-8dce-4b10-aa66-51088af267cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:02.742062 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73188366-8dce-4b10-aa66-51088af267cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:02.743538 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73188366-8dce-4b10-aa66-51088af267cb service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:02.752372 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1138/2306] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:17:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:17:06.754740 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c64bef-7c62-441c-9912-d0c5aa0dd114 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:06.755211 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c64bef-7c62-441c-9912-d0c5aa0dd114 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:06.755303 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c64bef-7c62-441c-9912-d0c5aa0dd114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:06.775907 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-95c64bef-7c62-441c-9912-d0c5aa0dd114 None None] MFA Rules not processed for user `eb640d92cb9b49019f42351a60efe258`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:17:06.777141 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-95c64bef-7c62-441c-9912-d0c5aa0dd114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:06.858579 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1169/2307] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Aug 2 09:17:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:17:06.871581 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73188366-8dce-4b10-aa66-51088af267cb service neutron] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:06.873081 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-73188366-8dce-4b10-aa66-51088af267cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:06.965194 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73188366-8dce-4b10-aa66-51088af267cb service neutron] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:06.974869 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c7c38-ad78-4ca5-9d66-9055d5981a64 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f8e572550b4ab5955d7a94f1563441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:06.975560 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c7c38-ad78-4ca5-9d66-9055d5981a64 service swift] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:06.975833 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c7c38-ad78-4ca5-9d66-9055d5981a64 service swift] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:06.976136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c7c38-ad78-4ca5-9d66-9055d5981a64 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:06.985367 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c7c38-ad78-4ca5-9d66-9055d5981a64 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:06.987019 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c7c38-ad78-4ca5-9d66-9055d5981a64 service swift] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:06.997946 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1139/2308] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Aug 2 09:17:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 02 09:17:16.850972 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=74 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:16.993358 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=74 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:23.139180 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c64bef-7c62-441c-9912-d0c5aa0dd114 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:23.217527 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c64bef-7c62-441c-9912-d0c5aa0dd114 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:23.224757 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ab9ef-2d37-40bd-a2db-274f9c52f086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:23.225442 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ab9ef-2d37-40bd-a2db-274f9c52f086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:23.225746 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ab9ef-2d37-40bd-a2db-274f9c52f086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:23.226079 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ab9ef-2d37-40bd-a2db-274f9c52f086 admin admin] PATH_INFO: `/v3/users/156d54d67b994de9a6c10393bcac5b47` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:23.227586 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ab9ef-2d37-40bd-a2db-274f9c52f086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=156d54d67b994de9a6c10393bcac5b47)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:23.230673 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ab9ef-2d37-40bd-a2db-274f9c52f086 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:23.427396 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-563ab9ef-2d37-40bd-a2db-274f9c52f086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '156d54d67b994de9a6c10393bcac5b47'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:23.494826 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-563ab9ef-2d37-40bd-a2db-274f9c52f086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '156d54d67b994de9a6c10393bcac5b47'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:23.503565 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-563ab9ef-2d37-40bd-a2db-274f9c52f086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '156d54d67b994de9a6c10393bcac5b47'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:23.507547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-563ab9ef-2d37-40bd-a2db-274f9c52f086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '156d54d67b994de9a6c10393bcac5b47'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:23.507547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-563ab9ef-2d37-40bd-a2db-274f9c52f086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '156d54d67b994de9a6c10393bcac5b47'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:23.530442 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1170/2309] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:17:23 2022] DELETE /identity/v3/users/156d54d67b994de9a6c10393bcac5b47 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:17:23.534017 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488696ed-6de8-4bf8-b3f0-dad6a0cf4fb8 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:23.534875 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488696ed-6de8-4bf8-b3f0-dad6a0cf4fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:23.534875 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488696ed-6de8-4bf8-b3f0-dad6a0cf4fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:23.555202 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-488696ed-6de8-4bf8-b3f0-dad6a0cf4fb8 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:17:23.556526 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-488696ed-6de8-4bf8-b3f0-dad6a0cf4fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:23.621874 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1140/2310] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:17:23.633140 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ab9ef-2d37-40bd-a2db-274f9c52f086 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:23.634618 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-563ab9ef-2d37-40bd-a2db-274f9c52f086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:23.711730 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ab9ef-2d37-40bd-a2db-274f9c52f086 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:23.715690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf0750-5859-4416-b63a-c1116c067a2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:23.716378 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf0750-5859-4416-b63a-c1116c067a2f service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:23.716667 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf0750-5859-4416-b63a-c1116c067a2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:23.716948 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf0750-5859-4416-b63a-c1116c067a2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:23.727412 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf0750-5859-4416-b63a-c1116c067a2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:23.728910 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf0750-5859-4416-b63a-c1116c067a2f service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:23.739755 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1171/2311] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:17:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:17:24.196308 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488696ed-6de8-4bf8-b3f0-dad6a0cf4fb8 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:24.198346 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-488696ed-6de8-4bf8-b3f0-dad6a0cf4fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:24.221201 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488696ed-6de8-4bf8-b3f0-dad6a0cf4fb8 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:24.230433 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10201d-3a67-4b49-a494-99c8f4e9f366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:24.231558 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10201d-3a67-4b49-a494-99c8f4e9f366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:24.232103 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10201d-3a67-4b49-a494-99c8f4e9f366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:24.232822 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10201d-3a67-4b49-a494-99c8f4e9f366 admin admin] PATH_INFO: `/v3/projects/4a03bac61482463ea886809bdb41ba8f` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:24.234794 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10201d-3a67-4b49-a494-99c8f4e9f366 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a03bac61482463ea886809bdb41ba8f)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:24.237084 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10201d-3a67-4b49-a494-99c8f4e9f366 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:24.350797 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-0d10201d-3a67-4b49-a494-99c8f4e9f366 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a03bac61482463ea886809bdb41ba8f', 'request_id': 'req-0d10201d-3a67-4b49-a494-99c8f4e9f366'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:24.358441 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-0d10201d-3a67-4b49-a494-99c8f4e9f366 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a03bac61482463ea886809bdb41ba8f', 'request_id': 'req-0d10201d-3a67-4b49-a494-99c8f4e9f366'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:24.366140 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-0d10201d-3a67-4b49-a494-99c8f4e9f366 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a03bac61482463ea886809bdb41ba8f', 'request_id': 'req-0d10201d-3a67-4b49-a494-99c8f4e9f366'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:24.490032 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-0d10201d-3a67-4b49-a494-99c8f4e9f366 admin admin] The token cache is being invalidate because project 4a03bac61482463ea886809bdb41ba8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:17:24.490371 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-0d10201d-3a67-4b49-a494-99c8f4e9f366 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:24.491054 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-0d10201d-3a67-4b49-a494-99c8f4e9f366 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:24.492644 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1141/2312] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:17:24 2022] DELETE /identity/v3/projects/4a03bac61482463ea886809bdb41ba8f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:17:24.496909 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf0750-5859-4416-b63a-c1116c067a2f service neutron] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:24.507533 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf0750-5859-4416-b63a-c1116c067a2f service neutron] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:24.531961 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:24.578979 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad9ea3-7104-440d-9412-b1cfa30c463e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:24.579698 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad9ea3-7104-440d-9412-b1cfa30c463e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:24.579978 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad9ea3-7104-440d-9412-b1cfa30c463e admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:24.580361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad9ea3-7104-440d-9412-b1cfa30c463e admin admin] PATH_INFO: `/v3/users/925531ea3d8841d2a773331e62efba68` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:24.581583 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad9ea3-7104-440d-9412-b1cfa30c463e admin admin] RBAC: Authorizing `identity:delete_user(user_id=925531ea3d8841d2a773331e62efba68)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:24.583851 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad9ea3-7104-440d-9412-b1cfa30c463e admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:24.888557 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-72ad9ea3-7104-440d-9412-b1cfa30c463e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '925531ea3d8841d2a773331e62efba68'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:24.952129 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-72ad9ea3-7104-440d-9412-b1cfa30c463e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '925531ea3d8841d2a773331e62efba68'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:24.961062 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-72ad9ea3-7104-440d-9412-b1cfa30c463e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '925531ea3d8841d2a773331e62efba68'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:24.961842 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-72ad9ea3-7104-440d-9412-b1cfa30c463e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '925531ea3d8841d2a773331e62efba68'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:24.964008 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-72ad9ea3-7104-440d-9412-b1cfa30c463e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '925531ea3d8841d2a773331e62efba68'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:24.982935 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1172/2313] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:17:24 2022] DELETE /identity/v3/users/925531ea3d8841d2a773331e62efba68 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:17:25.459053 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10201d-3a67-4b49-a494-99c8f4e9f366 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:25.461427 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-0d10201d-3a67-4b49-a494-99c8f4e9f366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:25.493378 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10201d-3a67-4b49-a494-99c8f4e9f366 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:25.560365 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167d7e0-6792-4ac0-b84b-47dfc3cd5394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:25.561027 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167d7e0-6792-4ac0-b84b-47dfc3cd5394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:25.561306 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167d7e0-6792-4ac0-b84b-47dfc3cd5394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:25.561717 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167d7e0-6792-4ac0-b84b-47dfc3cd5394 admin admin] PATH_INFO: `/v3/projects/e87678f6ecae47a284cfe622db4a23e0` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:25.562775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7167d7e0-6792-4ac0-b84b-47dfc3cd5394 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e87678f6ecae47a284cfe622db4a23e0)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:25.564771 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7167d7e0-6792-4ac0-b84b-47dfc3cd5394 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:25.667912 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:25.687515 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-7167d7e0-6792-4ac0-b84b-47dfc3cd5394 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e87678f6ecae47a284cfe622db4a23e0', 'request_id': 'req-7167d7e0-6792-4ac0-b84b-47dfc3cd5394'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:25.695117 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-7167d7e0-6792-4ac0-b84b-47dfc3cd5394 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e87678f6ecae47a284cfe622db4a23e0', 'request_id': 'req-7167d7e0-6792-4ac0-b84b-47dfc3cd5394'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:25.702869 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-7167d7e0-6792-4ac0-b84b-47dfc3cd5394 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e87678f6ecae47a284cfe622db4a23e0', 'request_id': 'req-7167d7e0-6792-4ac0-b84b-47dfc3cd5394'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:25.808693 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea1089-a8e1-4dd2-befc-192543ddc184 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:25.809267 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea1089-a8e1-4dd2-befc-192543ddc184 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:25.809267 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea1089-a8e1-4dd2-befc-192543ddc184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:25.829831 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-7167d7e0-6792-4ac0-b84b-47dfc3cd5394 admin admin] The token cache is being invalidate because project e87678f6ecae47a284cfe622db4a23e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:17:25.830272 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-7167d7e0-6792-4ac0-b84b-47dfc3cd5394 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:25.833587 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-7167d7e0-6792-4ac0-b84b-47dfc3cd5394 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:25.833732 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-50ea1089-a8e1-4dd2-befc-192543ddc184 None None] MFA Rules not processed for user `eb640d92cb9b49019f42351a60efe258`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:17:25.833836 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1142/2314] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:17:25 2022] DELETE /identity/v3/projects/e87678f6ecae47a284cfe622db4a23e0 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:17:25.834240 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-50ea1089-a8e1-4dd2-befc-192543ddc184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:25.840157 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565f22e-4e7f-4a4e-abe3-3909fb28411e None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:25.840468 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565f22e-4e7f-4a4e-abe3-3909fb28411e None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:25.840774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565f22e-4e7f-4a4e-abe3-3909fb28411e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:25.867857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-9565f22e-4e7f-4a4e-abe3-3909fb28411e None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:17:25.871111 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-9565f22e-4e7f-4a4e-abe3-3909fb28411e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:25.898824 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1173/2315] 10.222.0.20 () {58 vars in 967 bytes} [Tue Aug 2 09:17:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:17:25.911802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea1089-a8e1-4dd2-befc-192543ddc184 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:25.913269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-50ea1089-a8e1-4dd2-befc-192543ddc184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:25.959591 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1143/2316] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:17:25.967597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:25.969118 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af57c3-c37a-4054-a435-a76ee97875c0 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:25.969419 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af57c3-c37a-4054-a435-a76ee97875c0 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:25.970045 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af57c3-c37a-4054-a435-a76ee97875c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:25.991264 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-70af57c3-c37a-4054-a435-a76ee97875c0 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:17:25.992529 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-70af57c3-c37a-4054-a435-a76ee97875c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:26.000845 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1144/2317] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:17:26.005339 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af57c3-c37a-4054-a435-a76ee97875c0 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:26.009796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea1089-a8e1-4dd2-befc-192543ddc184 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:26.015224 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af57c3-c37a-4054-a435-a76ee97875c0 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:26.019916 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7d2dc-99a9-48c7-9119-bf6dbb651809 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f8e572550b4ab5955d7a94f1563441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:26.021907 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11766cc-90fa-48cd-aa15-fe63c7198966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:26.022508 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7d2dc-99a9-48c7-9119-bf6dbb651809 service swift] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:26.022729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11766cc-90fa-48cd-aa15-fe63c7198966 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:26.022832 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7d2dc-99a9-48c7-9119-bf6dbb651809 service swift] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:26.023001 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11766cc-90fa-48cd-aa15-fe63c7198966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:26.023095 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7d2dc-99a9-48c7-9119-bf6dbb651809 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:26.023195 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11766cc-90fa-48cd-aa15-fe63c7198966 admin admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:26.023195 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11766cc-90fa-48cd-aa15-fe63c7198966 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:17:26.023195 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11766cc-90fa-48cd-aa15-fe63c7198966 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:26.024736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11766cc-90fa-48cd-aa15-fe63c7198966 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:26.031735 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7d2dc-99a9-48c7-9119-bf6dbb651809 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:26.033503 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7d2dc-99a9-48c7-9119-bf6dbb651809 service swift] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:26.038328 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1145/2318] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:17:26.042956 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11766cc-90fa-48cd-aa15-fe63c7198966 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:26.044326 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1174/2319] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Aug 2 09:17:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:17:26.060147 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11766cc-90fa-48cd-aa15-fe63c7198966 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:26.060147 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169010e-6a08-4dcc-a0ec-6279860e3cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:26.060147 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169010e-6a08-4dcc-a0ec-6279860e3cbf admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:26.060147 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169010e-6a08-4dcc-a0ec-6279860e3cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:26.060598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169010e-6a08-4dcc-a0ec-6279860e3cbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:26.061382 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169010e-6a08-4dcc-a0ec-6279860e3cbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:26.062821 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169010e-6a08-4dcc-a0ec-6279860e3cbf admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:26.160099 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1146/2320] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:17:26 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:17:26.169300 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7d2dc-99a9-48c7-9119-bf6dbb651809 service swift] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:26.180304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7d2dc-99a9-48c7-9119-bf6dbb651809 service swift] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:26.257248 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8deb6b-5adf-44ad-a06f-b19091ac8f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:26.257893 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8deb6b-5adf-44ad-a06f-b19091ac8f30 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:26.258189 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8deb6b-5adf-44ad-a06f-b19091ac8f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:26.258714 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8deb6b-5adf-44ad-a06f-b19091ac8f30 admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:26.259159 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8deb6b-5adf-44ad-a06f-b19091ac8f30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:26.261455 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8deb6b-5adf-44ad-a06f-b19091ac8f30 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:26.428266 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1175/2321] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:17:26 2022] POST /identity/v3/users => generated 293 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:17:26.432632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169010e-6a08-4dcc-a0ec-6279860e3cbf admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:26.443626 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169010e-6a08-4dcc-a0ec-6279860e3cbf admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:26.449829 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7b70c-e79b-4790-8890-1145080768fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:26.450492 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7b70c-e79b-4790-8890-1145080768fc admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:26.450773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7b70c-e79b-4790-8890-1145080768fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:26.451055 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7b70c-e79b-4790-8890-1145080768fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:26.451795 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7b70c-e79b-4790-8890-1145080768fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:26.453603 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7b70c-e79b-4790-8890-1145080768fc admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:26.465111 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1147/2322] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:17:26.469287 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8deb6b-5adf-44ad-a06f-b19091ac8f30 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:26.483990 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8deb6b-5adf-44ad-a06f-b19091ac8f30 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:26.493094 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454c5db-7e98-478e-bb65-f4c295cc3918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:26.494202 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454c5db-7e98-478e-bb65-f4c295cc3918 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:26.494713 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454c5db-7e98-478e-bb65-f4c295cc3918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:26.495249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454c5db-7e98-478e-bb65-f4c295cc3918 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:26.496627 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454c5db-7e98-478e-bb65-f4c295cc3918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:26.499815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454c5db-7e98-478e-bb65-f4c295cc3918 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:26.514061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1176/2323] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:17:26.518573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7b70c-e79b-4790-8890-1145080768fc admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:26.530619 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7b70c-e79b-4790-8890-1145080768fc admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:26.536080 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb546b1-a195-490c-80c1-aca3babb33bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:26.536614 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb546b1-a195-490c-80c1-aca3babb33bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:26.536899 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb546b1-a195-490c-80c1-aca3babb33bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:26.537173 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb546b1-a195-490c-80c1-aca3babb33bd admin admin] PATH_INFO: `/v3/projects/a42382ff39064d0fa87b944820c6d3d9/users/0d45330185c74aeb9f3226f76d6c8e61/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:26.555379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb546b1-a195-490c-80c1-aca3babb33bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a42382ff39064d0fa87b944820c6d3d9, user_id=0d45330185c74aeb9f3226f76d6c8e61, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:26.558177 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb546b1-a195-490c-80c1-aca3babb33bd admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:26.728145 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1148/2324] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:17:26 2022] PUT /identity/v3/projects/a42382ff39064d0fa87b944820c6d3d9/users/0d45330185c74aeb9f3226f76d6c8e61/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:17:26.740513 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c1f87-8e46-4a10-90f9-39ee34b66e3e None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:26.740848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c1f87-8e46-4a10-90f9-39ee34b66e3e None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:26.741252 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c1f87-8e46-4a10-90f9-39ee34b66e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:26.794927 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-4d1c1f87-8e46-4a10-90f9-39ee34b66e3e None None] MFA Rules not processed for user `0d45330185c74aeb9f3226f76d6c8e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:17:26.797083 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-4d1c1f87-8e46-4a10-90f9-39ee34b66e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:26.881449 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1177/2325] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:17:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:17:26.886268 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb546b1-a195-490c-80c1-aca3babb33bd admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:26.939110 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:26.969011 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb546b1-a195-490c-80c1-aca3babb33bd admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:26.975630 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022a45f-97c8-4362-919b-bce319e829c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:26.976861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022a45f-97c8-4362-919b-bce319e829c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:26.977266 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022a45f-97c8-4362-919b-bce319e829c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:26.977643 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022a45f-97c8-4362-919b-bce319e829c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:26.978528 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022a45f-97c8-4362-919b-bce319e829c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:26.980860 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022a45f-97c8-4362-919b-bce319e829c1 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:27.104360 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1149/2326] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:17:26 2022] POST /identity/v3/projects => generated 387 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:17:27.106249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c1f87-8e46-4a10-90f9-39ee34b66e3e None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:27.131648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c1f87-8e46-4a10-90f9-39ee34b66e3e None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:27.181193 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:27.202992 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd67802-806a-4c3e-8b32-87fe6a615909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:27.214386 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd67802-806a-4c3e-8b32-87fe6a615909 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:27.214386 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd67802-806a-4c3e-8b32-87fe6a615909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:27.214386 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd67802-806a-4c3e-8b32-87fe6a615909 admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:27.214386 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd67802-806a-4c3e-8b32-87fe6a615909 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:27.214386 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd67802-806a-4c3e-8b32-87fe6a615909 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:27.316152 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1178/2327] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:17:27 2022] POST /identity/v3/users => generated 300 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:17:27.320769 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022a45f-97c8-4362-919b-bce319e829c1 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:27.332105 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022a45f-97c8-4362-919b-bce319e829c1 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:27.337720 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7748f88-2a94-41ee-a76e-74a28f060f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:27.338358 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7748f88-2a94-41ee-a76e-74a28f060f71 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:27.338687 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7748f88-2a94-41ee-a76e-74a28f060f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:27.338969 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7748f88-2a94-41ee-a76e-74a28f060f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:27.339671 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7748f88-2a94-41ee-a76e-74a28f060f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:27.341322 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7748f88-2a94-41ee-a76e-74a28f060f71 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:27.357171 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1150/2328] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:17:27.358714 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd67802-806a-4c3e-8b32-87fe6a615909 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:27.373500 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd67802-806a-4c3e-8b32-87fe6a615909 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:27.380268 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ab4ca-bd66-4224-ae66-84d118ac1517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:27.381058 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ab4ca-bd66-4224-ae66-84d118ac1517 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:27.381391 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ab4ca-bd66-4224-ae66-84d118ac1517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:27.381595 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ab4ca-bd66-4224-ae66-84d118ac1517 admin admin] PATH_INFO: `/v3/projects/4c759693e44b4367a3b33f6c8b063d9f/users/93fc5621348c4ced899451b42b5c1c1a/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:27.404181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285ab4ca-bd66-4224-ae66-84d118ac1517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c759693e44b4367a3b33f6c8b063d9f, user_id=93fc5621348c4ced899451b42b5c1c1a, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:27.408179 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285ab4ca-bd66-4224-ae66-84d118ac1517 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:27.489799 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1179/2329] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:17:27 2022] PUT /identity/v3/projects/4c759693e44b4367a3b33f6c8b063d9f/users/93fc5621348c4ced899451b42b5c1c1a/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:17:27.494126 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7748f88-2a94-41ee-a76e-74a28f060f71 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:27.505701 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7748f88-2a94-41ee-a76e-74a28f060f71 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:27.568672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a7bcc-f1ff-4b46-af86-aa2b7eecf5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:27.569336 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a7bcc-f1ff-4b46-af86-aa2b7eecf5cf admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:27.569615 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a7bcc-f1ff-4b46-af86-aa2b7eecf5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:27.569889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a7bcc-f1ff-4b46-af86-aa2b7eecf5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:27.570583 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a7bcc-f1ff-4b46-af86-aa2b7eecf5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:27.572370 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a7bcc-f1ff-4b46-af86-aa2b7eecf5cf admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:27.584041 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1151/2330] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:17:27.596037 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ab4ca-bd66-4224-ae66-84d118ac1517 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:27.610180 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ab4ca-bd66-4224-ae66-84d118ac1517 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:27.617468 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19508c6-7564-40be-936b-67c649834fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:27.618164 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19508c6-7564-40be-936b-67c649834fbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:27.618445 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19508c6-7564-40be-936b-67c649834fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:27.618782 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19508c6-7564-40be-936b-67c649834fbe admin admin] PATH_INFO: `/v3/projects/4c759693e44b4367a3b33f6c8b063d9f/users/93fc5621348c4ced899451b42b5c1c1a/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:27.620850 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19508c6-7564-40be-936b-67c649834fbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c759693e44b4367a3b33f6c8b063d9f, user_id=93fc5621348c4ced899451b42b5c1c1a, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:27.623523 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19508c6-7564-40be-936b-67c649834fbe admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:27.636339 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1180/2331] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:17:27 2022] PUT /identity/v3/projects/4c759693e44b4367a3b33f6c8b063d9f/users/93fc5621348c4ced899451b42b5c1c1a/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:17:27.648283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc970800-ef95-41da-87a6-a127ce06fe78 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:27.648569 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc970800-ef95-41da-87a6-a127ce06fe78 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:27.648844 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc970800-ef95-41da-87a6-a127ce06fe78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:27.679351 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-fc970800-ef95-41da-87a6-a127ce06fe78 None None] MFA Rules not processed for user `93fc5621348c4ced899451b42b5c1c1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:17:27.680614 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-fc970800-ef95-41da-87a6-a127ce06fe78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:27.761042 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1152/2332] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:17:27 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:17:27.775789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19508c6-7564-40be-936b-67c649834fbe admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:27.777994 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-b19508c6-7564-40be-936b-67c649834fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:27.874582 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19508c6-7564-40be-936b-67c649834fbe admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:27.881991 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd49b73-11a7-4ad7-a3c8-0a9d2cb89741 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:27.883099 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd49b73-11a7-4ad7-a3c8-0a9d2cb89741 service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:27.883599 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd49b73-11a7-4ad7-a3c8-0a9d2cb89741 service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:27.884096 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd49b73-11a7-4ad7-a3c8-0a9d2cb89741 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:27.902583 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd49b73-11a7-4ad7-a3c8-0a9d2cb89741 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:27.905496 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd49b73-11a7-4ad7-a3c8-0a9d2cb89741 service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:27.925404 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1181/2333] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:17:27 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:17:27.960032 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc970800-ef95-41da-87a6-a127ce06fe78 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:28.008930 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:28.039206 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc970800-ef95-41da-87a6-a127ce06fe78 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:28.044184 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7985c56-1743-4c53-9bf4-0b74c0a5221d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:28.044859 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7985c56-1743-4c53-9bf4-0b74c0a5221d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:28.045146 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7985c56-1743-4c53-9bf4-0b74c0a5221d admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:28.045424 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7985c56-1743-4c53-9bf4-0b74c0a5221d admin admin] PATH_INFO: `/v3/users/0d45330185c74aeb9f3226f76d6c8e61` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:28.046632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7985c56-1743-4c53-9bf4-0b74c0a5221d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d45330185c74aeb9f3226f76d6c8e61)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:28.048670 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7985c56-1743-4c53-9bf4-0b74c0a5221d admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:28.218239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-a7985c56-1743-4c53-9bf4-0b74c0a5221d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d45330185c74aeb9f3226f76d6c8e61'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:28.228390 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-a7985c56-1743-4c53-9bf4-0b74c0a5221d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d45330185c74aeb9f3226f76d6c8e61'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:28.229249 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-a7985c56-1743-4c53-9bf4-0b74c0a5221d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d45330185c74aeb9f3226f76d6c8e61'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:28.306029 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-a7985c56-1743-4c53-9bf4-0b74c0a5221d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d45330185c74aeb9f3226f76d6c8e61'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:28.322884 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-a7985c56-1743-4c53-9bf4-0b74c0a5221d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d45330185c74aeb9f3226f76d6c8e61'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:28.329943 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1153/2334] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:17:27 2022] DELETE /identity/v3/users/0d45330185c74aeb9f3226f76d6c8e61 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:17:28.335315 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacdcb3-3f57-42e2-bc44-104442a359ca None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:28.335678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacdcb3-3f57-42e2-bc44-104442a359ca None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:28.335998 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacdcb3-3f57-42e2-bc44-104442a359ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:28.358181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-bfacdcb3-3f57-42e2-bc44-104442a359ca None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:17:28.359449 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-bfacdcb3-3f57-42e2-bc44-104442a359ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:28.435158 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1182/2335] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:17:28.448960 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7985c56-1743-4c53-9bf4-0b74c0a5221d admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:28.450560 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-a7985c56-1743-4c53-9bf4-0b74c0a5221d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:28.527456 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7985c56-1743-4c53-9bf4-0b74c0a5221d admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:28.531265 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ffe7f-09c5-409d-bf77-603e5beefd07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:28.531908 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ffe7f-09c5-409d-bf77-603e5beefd07 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:28.532210 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ffe7f-09c5-409d-bf77-603e5beefd07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:28.532483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ffe7f-09c5-409d-bf77-603e5beefd07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:28.543592 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ffe7f-09c5-409d-bf77-603e5beefd07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:28.545120 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ffe7f-09c5-409d-bf77-603e5beefd07 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:28.556787 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1154/2336] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:17:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:17:28.999215 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacdcb3-3f57-42e2-bc44-104442a359ca None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:29.000975 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-bfacdcb3-3f57-42e2-bc44-104442a359ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:29.014850 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacdcb3-3f57-42e2-bc44-104442a359ca None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:29.024205 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e13fea-38bd-4200-80e6-e4a943e1496f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:29.025380 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e13fea-38bd-4200-80e6-e4a943e1496f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:29.025749 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e13fea-38bd-4200-80e6-e4a943e1496f admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:29.026034 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e13fea-38bd-4200-80e6-e4a943e1496f admin admin] PATH_INFO: `/v3/projects/a42382ff39064d0fa87b944820c6d3d9` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:29.027762 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e13fea-38bd-4200-80e6-e4a943e1496f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a42382ff39064d0fa87b944820c6d3d9)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:29.030252 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e13fea-38bd-4200-80e6-e4a943e1496f admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:29.140679 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:29.159673 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-f6e13fea-38bd-4200-80e6-e4a943e1496f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a42382ff39064d0fa87b944820c6d3d9', 'request_id': 'req-f6e13fea-38bd-4200-80e6-e4a943e1496f'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:29.214919 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-f6e13fea-38bd-4200-80e6-e4a943e1496f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a42382ff39064d0fa87b944820c6d3d9', 'request_id': 'req-f6e13fea-38bd-4200-80e6-e4a943e1496f'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:29.222446 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-f6e13fea-38bd-4200-80e6-e4a943e1496f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a42382ff39064d0fa87b944820c6d3d9', 'request_id': 'req-f6e13fea-38bd-4200-80e6-e4a943e1496f'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:29.236378 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-f6e13fea-38bd-4200-80e6-e4a943e1496f admin admin] The token cache is being invalidate because project a42382ff39064d0fa87b944820c6d3d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:17:29.236680 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-f6e13fea-38bd-4200-80e6-e4a943e1496f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:29.237432 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-f6e13fea-38bd-4200-80e6-e4a943e1496f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:29.239060 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1183/2337] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:17:28 2022] DELETE /identity/v3/projects/a42382ff39064d0fa87b944820c6d3d9 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:17:29.243610 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ffe7f-09c5-409d-bf77-603e5beefd07 service neutron] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:29.254443 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ffe7f-09c5-409d-bf77-603e5beefd07 service neutron] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:29.325712 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:29.335210 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c5cb5-8f54-42c0-bdf6-5c02026fbbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:29.338674 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c5cb5-8f54-42c0-bdf6-5c02026fbbe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:29.338674 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c5cb5-8f54-42c0-bdf6-5c02026fbbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:29.338674 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c5cb5-8f54-42c0-bdf6-5c02026fbbe1 admin admin] PATH_INFO: `/v3/users/93fc5621348c4ced899451b42b5c1c1a` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:29.338674 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c5cb5-8f54-42c0-bdf6-5c02026fbbe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93fc5621348c4ced899451b42b5c1c1a)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:29.339771 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c5cb5-8f54-42c0-bdf6-5c02026fbbe1 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:29.585500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-e79c5cb5-8f54-42c0-bdf6-5c02026fbbe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93fc5621348c4ced899451b42b5c1c1a'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:29.595152 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-e79c5cb5-8f54-42c0-bdf6-5c02026fbbe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93fc5621348c4ced899451b42b5c1c1a'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:29.595986 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-e79c5cb5-8f54-42c0-bdf6-5c02026fbbe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93fc5621348c4ced899451b42b5c1c1a'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:29.666389 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-e79c5cb5-8f54-42c0-bdf6-5c02026fbbe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93fc5621348c4ced899451b42b5c1c1a'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:29.681486 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-e79c5cb5-8f54-42c0-bdf6-5c02026fbbe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93fc5621348c4ced899451b42b5c1c1a'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:29.688084 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1155/2338] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:17:29 2022] DELETE /identity/v3/users/93fc5621348c4ced899451b42b5c1c1a => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:17:30.200431 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e13fea-38bd-4200-80e6-e4a943e1496f admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:30.202218 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-f6e13fea-38bd-4200-80e6-e4a943e1496f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:30.220932 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e13fea-38bd-4200-80e6-e4a943e1496f admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:30.292122 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3479a92-f00b-4cb7-9b4f-9da57824a113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:30.292800 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3479a92-f00b-4cb7-9b4f-9da57824a113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:30.293815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3479a92-f00b-4cb7-9b4f-9da57824a113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:30.293815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3479a92-f00b-4cb7-9b4f-9da57824a113 admin admin] PATH_INFO: `/v3/projects/4c759693e44b4367a3b33f6c8b063d9f` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:30.294600 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3479a92-f00b-4cb7-9b4f-9da57824a113 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c759693e44b4367a3b33f6c8b063d9f)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:30.296567 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3479a92-f00b-4cb7-9b4f-9da57824a113 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:30.445838 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d3479a92-f00b-4cb7-9b4f-9da57824a113 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c759693e44b4367a3b33f6c8b063d9f', 'request_id': 'req-d3479a92-f00b-4cb7-9b4f-9da57824a113'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:30.517920 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d3479a92-f00b-4cb7-9b4f-9da57824a113 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c759693e44b4367a3b33f6c8b063d9f', 'request_id': 'req-d3479a92-f00b-4cb7-9b4f-9da57824a113'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:30.527115 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d3479a92-f00b-4cb7-9b4f-9da57824a113 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c759693e44b4367a3b33f6c8b063d9f', 'request_id': 'req-d3479a92-f00b-4cb7-9b4f-9da57824a113'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:30.542324 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d3479a92-f00b-4cb7-9b4f-9da57824a113 admin admin] The token cache is being invalidate because project 4c759693e44b4367a3b33f6c8b063d9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:17:30.542750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d3479a92-f00b-4cb7-9b4f-9da57824a113 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:30.543552 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d3479a92-f00b-4cb7-9b4f-9da57824a113 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:30.545264 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1184/2339] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:17:30 2022] DELETE /identity/v3/projects/4c759693e44b4367a3b33f6c8b063d9f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:17:30.551781 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d6a0b-20d5-4511-84cd-0e51ad3bb782 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:30.552288 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d6a0b-20d5-4511-84cd-0e51ad3bb782 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:30.552737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d6a0b-20d5-4511-84cd-0e51ad3bb782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:30.574850 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-8e4d6a0b-20d5-4511-84cd-0e51ad3bb782 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:17:30.576097 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-8e4d6a0b-20d5-4511-84cd-0e51ad3bb782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:30.650954 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1156/2340] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:17:30.659192 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812c75a-78a7-401d-95d5-238b081d01e7 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:30.659487 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812c75a-78a7-401d-95d5-238b081d01e7 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:30.659775 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812c75a-78a7-401d-95d5-238b081d01e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:30.682535 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-2812c75a-78a7-401d-95d5-238b081d01e7 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:17:30.683795 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-2812c75a-78a7-401d-95d5-238b081d01e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:30.692259 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1185/2341] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:17:30.697971 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d6a0b-20d5-4511-84cd-0e51ad3bb782 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:30.708970 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d6a0b-20d5-4511-84cd-0e51ad3bb782 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:30.714172 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72acd28b-ccec-4b69-9b37-130342081da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:30.714896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72acd28b-ccec-4b69-9b37-130342081da7 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:30.715095 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72acd28b-ccec-4b69-9b37-130342081da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:30.715369 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72acd28b-ccec-4b69-9b37-130342081da7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:30.716084 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72acd28b-ccec-4b69-9b37-130342081da7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:17:30.716423 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72acd28b-ccec-4b69-9b37-130342081da7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:30.718048 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72acd28b-ccec-4b69-9b37-130342081da7 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:30.731877 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1157/2342] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:17:30.737226 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812c75a-78a7-401d-95d5-238b081d01e7 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:30.748024 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812c75a-78a7-401d-95d5-238b081d01e7 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:30.752987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6c9cf-fc3c-4a82-bffc-8e6a2981c47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:30.753634 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6c9cf-fc3c-4a82-bffc-8e6a2981c47d admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:30.753917 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6c9cf-fc3c-4a82-bffc-8e6a2981c47d admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:30.754193 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6c9cf-fc3c-4a82-bffc-8e6a2981c47d admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:30.754911 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c6c9cf-fc3c-4a82-bffc-8e6a2981c47d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:30.756954 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c6c9cf-fc3c-4a82-bffc-8e6a2981c47d admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:30.857473 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1186/2343] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:17:30 2022] POST /identity/v3/projects => generated 387 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:17:30.861757 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72acd28b-ccec-4b69-9b37-130342081da7 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:30.873234 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72acd28b-ccec-4b69-9b37-130342081da7 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:30.944048 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc42fe-0673-44b5-8963-16b89bb4c1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:30.944729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc42fe-0673-44b5-8963-16b89bb4c1c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:30.945014 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc42fe-0673-44b5-8963-16b89bb4c1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:30.945324 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc42fe-0673-44b5-8963-16b89bb4c1c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:30.946023 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc42fe-0673-44b5-8963-16b89bb4c1c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:30.948304 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc42fe-0673-44b5-8963-16b89bb4c1c5 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:30.957305 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:31.094877 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1158/2344] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:17:30 2022] POST /identity/v3/users => generated 294 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:17:31.099389 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6c9cf-fc3c-4a82-bffc-8e6a2981c47d admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:31.110194 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6c9cf-fc3c-4a82-bffc-8e6a2981c47d admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:31.115638 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0add933-21ab-49ab-89d9-580c705f6032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:31.116311 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0add933-21ab-49ab-89d9-580c705f6032 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:31.116593 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0add933-21ab-49ab-89d9-580c705f6032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:31.116999 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0add933-21ab-49ab-89d9-580c705f6032 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:31.117714 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0add933-21ab-49ab-89d9-580c705f6032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:31.119346 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0add933-21ab-49ab-89d9-580c705f6032 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:31.131023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1187/2345] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:17:31.135727 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc42fe-0673-44b5-8963-16b89bb4c1c5 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:31.147026 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc42fe-0673-44b5-8963-16b89bb4c1c5 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:31.151896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaca76f-6088-42a6-b506-91d1cf467889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:31.152564 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaca76f-6088-42a6-b506-91d1cf467889 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:31.152870 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaca76f-6088-42a6-b506-91d1cf467889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:31.153150 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaca76f-6088-42a6-b506-91d1cf467889 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:31.153855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaca76f-6088-42a6-b506-91d1cf467889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:31.155463 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaca76f-6088-42a6-b506-91d1cf467889 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:31.167114 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1159/2346] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:17:31.171720 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0add933-21ab-49ab-89d9-580c705f6032 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:31.183017 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0add933-21ab-49ab-89d9-580c705f6032 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:31.188116 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231368c0-ab3b-402a-baad-74189537d899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:31.188827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231368c0-ab3b-402a-baad-74189537d899 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:31.189107 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231368c0-ab3b-402a-baad-74189537d899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:31.189384 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231368c0-ab3b-402a-baad-74189537d899 admin admin] PATH_INFO: `/v3/projects/d1fd613bf2af4bcf8be15a728bc6102c/users/7593531248c144d99a32fed53cb5831e/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:31.207529 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:31.213557 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231368c0-ab3b-402a-baad-74189537d899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1fd613bf2af4bcf8be15a728bc6102c, user_id=7593531248c144d99a32fed53cb5831e, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:31.227709 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231368c0-ab3b-402a-baad-74189537d899 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:31.312696 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1188/2347] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:17:31 2022] PUT /identity/v3/projects/d1fd613bf2af4bcf8be15a728bc6102c/users/7593531248c144d99a32fed53cb5831e/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:17:31.323900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975dce2-337c-4f47-98c4-f4efe4849e5c None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:31.324237 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975dce2-337c-4f47-98c4-f4efe4849e5c None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:31.324888 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975dce2-337c-4f47-98c4-f4efe4849e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:31.356796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-4975dce2-337c-4f47-98c4-f4efe4849e5c None None] MFA Rules not processed for user `7593531248c144d99a32fed53cb5831e`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:17:31.358023 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-4975dce2-337c-4f47-98c4-f4efe4849e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:31.430245 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1160/2348] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:17:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:17:31.435104 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231368c0-ab3b-402a-baad-74189537d899 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:31.504339 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231368c0-ab3b-402a-baad-74189537d899 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:31.519266 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e0ced-0fa3-4bd1-bc41-187f4367f42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:31.519915 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e0ced-0fa3-4bd1-bc41-187f4367f42a admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:31.520243 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e0ced-0fa3-4bd1-bc41-187f4367f42a admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:31.520522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e0ced-0fa3-4bd1-bc41-187f4367f42a admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:31.521217 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e0ced-0fa3-4bd1-bc41-187f4367f42a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:31.523148 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e0ced-0fa3-4bd1-bc41-187f4367f42a admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:31.622992 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1189/2349] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:17:31 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:17:31.627542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975dce2-337c-4f47-98c4-f4efe4849e5c None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:31.646551 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975dce2-337c-4f47-98c4-f4efe4849e5c None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:31.722581 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4fdda-e189-4a96-aca1-85d38ab04a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:31.723799 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4fdda-e189-4a96-aca1-85d38ab04a27 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:31.723998 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4fdda-e189-4a96-aca1-85d38ab04a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:31.724311 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4fdda-e189-4a96-aca1-85d38ab04a27 admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:31.724994 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4fdda-e189-4a96-aca1-85d38ab04a27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:31.726926 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4fdda-e189-4a96-aca1-85d38ab04a27 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:31.827105 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1161/2350] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:17:31 2022] POST /identity/v3/users => generated 299 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:17:31.831179 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e0ced-0fa3-4bd1-bc41-187f4367f42a admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:31.842337 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e0ced-0fa3-4bd1-bc41-187f4367f42a admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:31.846981 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d51bad-8520-46f9-8eee-5a194e3e6a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:31.847709 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d51bad-8520-46f9-8eee-5a194e3e6a48 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:31.847986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d51bad-8520-46f9-8eee-5a194e3e6a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:31.848870 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d51bad-8520-46f9-8eee-5a194e3e6a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:31.849615 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d51bad-8520-46f9-8eee-5a194e3e6a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:31.851217 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d51bad-8520-46f9-8eee-5a194e3e6a48 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:31.862854 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1190/2351] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:17:31.867679 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4fdda-e189-4a96-aca1-85d38ab04a27 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:31.878541 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4fdda-e189-4a96-aca1-85d38ab04a27 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:31.883664 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911757b-0d58-45c3-a2cf-b676eba7e35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:31.884401 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911757b-0d58-45c3-a2cf-b676eba7e35d admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:31.884687 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911757b-0d58-45c3-a2cf-b676eba7e35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:31.884968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911757b-0d58-45c3-a2cf-b676eba7e35d admin admin] PATH_INFO: `/v3/projects/b080a937c4514472b0df3ca33a939a07/users/7a6532ebffa54e56aeff74ec4ebecb87/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:31.902683 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911757b-0d58-45c3-a2cf-b676eba7e35d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b080a937c4514472b0df3ca33a939a07, user_id=7a6532ebffa54e56aeff74ec4ebecb87, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:31.905396 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911757b-0d58-45c3-a2cf-b676eba7e35d admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:32.038612 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1162/2352] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:17:31 2022] PUT /identity/v3/projects/b080a937c4514472b0df3ca33a939a07/users/7a6532ebffa54e56aeff74ec4ebecb87/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:17:32.042831 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d51bad-8520-46f9-8eee-5a194e3e6a48 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:32.054420 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d51bad-8520-46f9-8eee-5a194e3e6a48 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:32.117339 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29633c-b4d1-4049-8198-356e56804e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:32.117881 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29633c-b4d1-4049-8198-356e56804e97 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:32.118165 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29633c-b4d1-4049-8198-356e56804e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:32.118438 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29633c-b4d1-4049-8198-356e56804e97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:32.119140 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29633c-b4d1-4049-8198-356e56804e97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:32.120784 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29633c-b4d1-4049-8198-356e56804e97 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:32.131900 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1191/2353] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:17:32.136430 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911757b-0d58-45c3-a2cf-b676eba7e35d admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:32.147220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911757b-0d58-45c3-a2cf-b676eba7e35d admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:32.152012 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706fa82-39bb-40ed-910c-ac9220c9c5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:32.152857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706fa82-39bb-40ed-910c-ac9220c9c5ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:32.153004 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706fa82-39bb-40ed-910c-ac9220c9c5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:32.153281 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706fa82-39bb-40ed-910c-ac9220c9c5ea admin admin] PATH_INFO: `/v3/projects/b080a937c4514472b0df3ca33a939a07/users/7a6532ebffa54e56aeff74ec4ebecb87/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:32.155227 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706fa82-39bb-40ed-910c-ac9220c9c5ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=b080a937c4514472b0df3ca33a939a07, user_id=7a6532ebffa54e56aeff74ec4ebecb87, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:32.157947 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706fa82-39bb-40ed-910c-ac9220c9c5ea admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:32.169938 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1163/2354] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:17:32 2022] PUT /identity/v3/projects/b080a937c4514472b0df3ca33a939a07/users/7a6532ebffa54e56aeff74ec4ebecb87/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:17:32.242097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7ea67-b5f1-48a0-9b3a-0161d0e4c75d None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:32.242677 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7ea67-b5f1-48a0-9b3a-0161d0e4c75d None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:32.242677 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7ea67-b5f1-48a0-9b3a-0161d0e4c75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:32.276677 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-9be7ea67-b5f1-48a0-9b3a-0161d0e4c75d None None] MFA Rules not processed for user `7a6532ebffa54e56aeff74ec4ebecb87`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:17:32.278524 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-9be7ea67-b5f1-48a0-9b3a-0161d0e4c75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:32.337598 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:32.361006 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1192/2355] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:17:32 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:17:32.373582 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706fa82-39bb-40ed-910c-ac9220c9c5ea admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:32.375379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-2706fa82-39bb-40ed-910c-ac9220c9c5ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:32.413503 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:32.453201 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706fa82-39bb-40ed-910c-ac9220c9c5ea admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:32.461862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ab75b-8a3a-42fb-a6e6-a3598c5fd077 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:32.462504 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ab75b-8a3a-42fb-a6e6-a3598c5fd077 service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:32.462784 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ab75b-8a3a-42fb-a6e6-a3598c5fd077 service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:32.463051 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ab75b-8a3a-42fb-a6e6-a3598c5fd077 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:32.473127 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ab75b-8a3a-42fb-a6e6-a3598c5fd077 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:32.475364 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ab75b-8a3a-42fb-a6e6-a3598c5fd077 service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:32.487407 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1164/2356] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:17:32 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:17:32.558099 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7ea67-b5f1-48a0-9b3a-0161d0e4c75d None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:32.635117 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7ea67-b5f1-48a0-9b3a-0161d0e4c75d None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:32.640000 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3baf088-9e64-45c9-9bed-e220e84a952a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:32.640706 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3baf088-9e64-45c9-9bed-e220e84a952a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:32.640993 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3baf088-9e64-45c9-9bed-e220e84a952a admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:32.641273 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3baf088-9e64-45c9-9bed-e220e84a952a admin admin] PATH_INFO: `/v3/users/7593531248c144d99a32fed53cb5831e` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:32.642596 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3baf088-9e64-45c9-9bed-e220e84a952a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7593531248c144d99a32fed53cb5831e)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:32.644690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3baf088-9e64-45c9-9bed-e220e84a952a admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:32.877801 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d3baf088-9e64-45c9-9bed-e220e84a952a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7593531248c144d99a32fed53cb5831e'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:32.946210 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d3baf088-9e64-45c9-9bed-e220e84a952a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7593531248c144d99a32fed53cb5831e'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:32.954881 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d3baf088-9e64-45c9-9bed-e220e84a952a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7593531248c144d99a32fed53cb5831e'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:32.955568 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d3baf088-9e64-45c9-9bed-e220e84a952a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7593531248c144d99a32fed53cb5831e'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:32.956206 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d3baf088-9e64-45c9-9bed-e220e84a952a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7593531248c144d99a32fed53cb5831e'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:32.974565 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1193/2357] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:17:32 2022] DELETE /identity/v3/users/7593531248c144d99a32fed53cb5831e => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:17:32.980980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e1a73-1b51-4548-8dc8-672ac5498b7b None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:32.980980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e1a73-1b51-4548-8dc8-672ac5498b7b None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:32.980980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e1a73-1b51-4548-8dc8-672ac5498b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:33.001966 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-664e1a73-1b51-4548-8dc8-672ac5498b7b None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:17:33.003174 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-664e1a73-1b51-4548-8dc8-672ac5498b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:33.064343 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1165/2358] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:17:33.075439 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3baf088-9e64-45c9-9bed-e220e84a952a admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:33.076985 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-d3baf088-9e64-45c9-9bed-e220e84a952a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:33.148104 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3baf088-9e64-45c9-9bed-e220e84a952a admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:33.151919 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7480e-f66d-4186-8b40-5687cb3aaf4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:33.152608 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7480e-f66d-4186-8b40-5687cb3aaf4a service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:33.152896 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7480e-f66d-4186-8b40-5687cb3aaf4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:33.153176 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7480e-f66d-4186-8b40-5687cb3aaf4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:33.165106 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7480e-f66d-4186-8b40-5687cb3aaf4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:33.166450 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7480e-f66d-4186-8b40-5687cb3aaf4a service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:33.177837 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1194/2359] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:17:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:17:33.413918 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e1a73-1b51-4548-8dc8-672ac5498b7b None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:33.416151 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-664e1a73-1b51-4548-8dc8-672ac5498b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:33.518503 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e1a73-1b51-4548-8dc8-672ac5498b7b None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:33.524555 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b78a4-4e94-48ca-b0b0-11bdf45df49c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:33.525239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b78a4-4e94-48ca-b0b0-11bdf45df49c service nova] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:33.525522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b78a4-4e94-48ca-b0b0-11bdf45df49c service nova] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:33.525796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b78a4-4e94-48ca-b0b0-11bdf45df49c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:33.527638 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-427b78a4-4e94-48ca-b0b0-11bdf45df49c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:33.597053 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b78a4-4e94-48ca-b0b0-11bdf45df49c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:33.599386 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b78a4-4e94-48ca-b0b0-11bdf45df49c service nova] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:33.611998 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1166/2360] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:17:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:17:33.621062 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7480e-f66d-4186-8b40-5687cb3aaf4a service neutron] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:33.623506 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-cec7480e-f66d-4186-8b40-5687cb3aaf4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:33.642540 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7480e-f66d-4186-8b40-5687cb3aaf4a service neutron] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:33.651028 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05dcec-e61b-48cc-9986-543bf6b54d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:33.651717 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05dcec-e61b-48cc-9986-543bf6b54d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:33.652006 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05dcec-e61b-48cc-9986-543bf6b54d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:33.652394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05dcec-e61b-48cc-9986-543bf6b54d0c admin admin] PATH_INFO: `/v3/projects/d1fd613bf2af4bcf8be15a728bc6102c` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:33.653764 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05dcec-e61b-48cc-9986-543bf6b54d0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1fd613bf2af4bcf8be15a728bc6102c)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:33.659764 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05dcec-e61b-48cc-9986-543bf6b54d0c admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:33.659764 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:33.815985 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-3d05dcec-e61b-48cc-9986-543bf6b54d0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1fd613bf2af4bcf8be15a728bc6102c', 'request_id': 'req-3d05dcec-e61b-48cc-9986-543bf6b54d0c'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:33.907090 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-3d05dcec-e61b-48cc-9986-543bf6b54d0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1fd613bf2af4bcf8be15a728bc6102c', 'request_id': 'req-3d05dcec-e61b-48cc-9986-543bf6b54d0c'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:33.915390 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-3d05dcec-e61b-48cc-9986-543bf6b54d0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1fd613bf2af4bcf8be15a728bc6102c', 'request_id': 'req-3d05dcec-e61b-48cc-9986-543bf6b54d0c'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:33.928302 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-3d05dcec-e61b-48cc-9986-543bf6b54d0c admin admin] The token cache is being invalidate because project d1fd613bf2af4bcf8be15a728bc6102c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:17:33.928640 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-3d05dcec-e61b-48cc-9986-543bf6b54d0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:33.929265 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-3d05dcec-e61b-48cc-9986-543bf6b54d0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:33.930802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1195/2361] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:17:33 2022] DELETE /identity/v3/projects/d1fd613bf2af4bcf8be15a728bc6102c => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:17:33.935379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b78a4-4e94-48ca-b0b0-11bdf45df49c service nova] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:33.942521 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:33.949518 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b78a4-4e94-48ca-b0b0-11bdf45df49c service nova] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:34.014401 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027def6-a7d8-4a41-a3c5-ee6645d9e8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:34.015067 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027def6-a7d8-4a41-a3c5-ee6645d9e8b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:34.015326 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027def6-a7d8-4a41-a3c5-ee6645d9e8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:34.015595 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027def6-a7d8-4a41-a3c5-ee6645d9e8b9 admin admin] PATH_INFO: `/v3/users/7a6532ebffa54e56aeff74ec4ebecb87` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:34.016949 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027def6-a7d8-4a41-a3c5-ee6645d9e8b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a6532ebffa54e56aeff74ec4ebecb87)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:34.019114 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027def6-a7d8-4a41-a3c5-ee6645d9e8b9 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:34.346957 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4027def6-a7d8-4a41-a3c5-ee6645d9e8b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a6532ebffa54e56aeff74ec4ebecb87'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:34.357025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4027def6-a7d8-4a41-a3c5-ee6645d9e8b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a6532ebffa54e56aeff74ec4ebecb87'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:34.357779 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4027def6-a7d8-4a41-a3c5-ee6645d9e8b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a6532ebffa54e56aeff74ec4ebecb87'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:34.477410 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4027def6-a7d8-4a41-a3c5-ee6645d9e8b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a6532ebffa54e56aeff74ec4ebecb87'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:34.496793 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4027def6-a7d8-4a41-a3c5-ee6645d9e8b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a6532ebffa54e56aeff74ec4ebecb87'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:34.508135 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1167/2362] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:17:33 2022] DELETE /identity/v3/users/7a6532ebffa54e56aeff74ec4ebecb87 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:17:34.953083 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05dcec-e61b-48cc-9986-543bf6b54d0c admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:34.954606 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-3d05dcec-e61b-48cc-9986-543bf6b54d0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:34.969507 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05dcec-e61b-48cc-9986-543bf6b54d0c admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:35.034613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720ba1a-7617-42bf-a710-506da01bc527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:35.035314 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720ba1a-7617-42bf-a710-506da01bc527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:35.035704 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720ba1a-7617-42bf-a710-506da01bc527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:35.036133 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720ba1a-7617-42bf-a710-506da01bc527 admin admin] PATH_INFO: `/v3/projects/b080a937c4514472b0df3ca33a939a07` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:35.037485 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1720ba1a-7617-42bf-a710-506da01bc527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b080a937c4514472b0df3ca33a939a07)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:35.039409 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1720ba1a-7617-42bf-a710-506da01bc527 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:35.172851 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-1720ba1a-7617-42bf-a710-506da01bc527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b080a937c4514472b0df3ca33a939a07', 'request_id': 'req-1720ba1a-7617-42bf-a710-506da01bc527'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:35.231923 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-1720ba1a-7617-42bf-a710-506da01bc527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b080a937c4514472b0df3ca33a939a07', 'request_id': 'req-1720ba1a-7617-42bf-a710-506da01bc527'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:35.239172 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-1720ba1a-7617-42bf-a710-506da01bc527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b080a937c4514472b0df3ca33a939a07', 'request_id': 'req-1720ba1a-7617-42bf-a710-506da01bc527'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:35.253137 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-1720ba1a-7617-42bf-a710-506da01bc527 admin admin] The token cache is being invalidate because project b080a937c4514472b0df3ca33a939a07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:17:35.253415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-1720ba1a-7617-42bf-a710-506da01bc527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:35.253997 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-1720ba1a-7617-42bf-a710-506da01bc527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:35.256365 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1196/2363] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:17:34 2022] DELETE /identity/v3/projects/b080a937c4514472b0df3ca33a939a07 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:17:35.262123 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d81132-553f-4bb0-a074-558db2bd4a8c None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:35.266180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d81132-553f-4bb0-a074-558db2bd4a8c None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:35.266180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d81132-553f-4bb0-a074-558db2bd4a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:35.289437 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-70d81132-553f-4bb0-a074-558db2bd4a8c None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:17:35.290763 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-70d81132-553f-4bb0-a074-558db2bd4a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:35.362053 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1168/2364] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:17:35.371226 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6823aa-adc3-496e-9fa8-2e0b1e72f493 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:35.371732 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6823aa-adc3-496e-9fa8-2e0b1e72f493 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:35.372427 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6823aa-adc3-496e-9fa8-2e0b1e72f493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:35.407815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-fd6823aa-adc3-496e-9fa8-2e0b1e72f493 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:17:35.409224 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-fd6823aa-adc3-496e-9fa8-2e0b1e72f493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:35.420011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1197/2365] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:17:35.425008 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d81132-553f-4bb0-a074-558db2bd4a8c None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:35.436003 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d81132-553f-4bb0-a074-558db2bd4a8c None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:35.441545 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf4444-c530-47bd-b745-08580f9051d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:35.442831 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf4444-c530-47bd-b745-08580f9051d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:35.443115 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf4444-c530-47bd-b745-08580f9051d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:35.443483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf4444-c530-47bd-b745-08580f9051d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:35.444210 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf4444-c530-47bd-b745-08580f9051d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:17:35.444530 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf4444-c530-47bd-b745-08580f9051d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:35.446245 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf4444-c530-47bd-b745-08580f9051d2 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:35.462331 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1169/2366] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:17:35.467695 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6823aa-adc3-496e-9fa8-2e0b1e72f493 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:35.490705 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6823aa-adc3-496e-9fa8-2e0b1e72f493 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:35.497118 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8fdc6-7bec-4721-a11e-0b39d98486c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:35.497772 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8fdc6-7bec-4721-a11e-0b39d98486c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:35.498052 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8fdc6-7bec-4721-a11e-0b39d98486c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:35.498364 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8fdc6-7bec-4721-a11e-0b39d98486c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:35.500274 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8fdc6-7bec-4721-a11e-0b39d98486c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:35.501151 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8fdc6-7bec-4721-a11e-0b39d98486c6 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:35.515402 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:35.617041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1198/2367] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:17:35 2022] POST /identity/v3/projects => generated 367 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:17:35.620875 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf4444-c530-47bd-b745-08580f9051d2 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:35.632505 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf4444-c530-47bd-b745-08580f9051d2 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:35.637986 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:35.702598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b6c18-ec92-4944-a1f5-a87dcfa3e7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:35.703215 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b6c18-ec92-4944-a1f5-a87dcfa3e7ee admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:35.703712 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b6c18-ec92-4944-a1f5-a87dcfa3e7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:35.704128 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b6c18-ec92-4944-a1f5-a87dcfa3e7ee admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:35.704942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b6c18-ec92-4944-a1f5-a87dcfa3e7ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:35.706918 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b6c18-ec92-4944-a1f5-a87dcfa3e7ee admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:35.838257 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1170/2368] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:17:35 2022] POST /identity/v3/users => generated 284 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:17:35.843242 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8fdc6-7bec-4721-a11e-0b39d98486c6 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:35.856627 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8fdc6-7bec-4721-a11e-0b39d98486c6 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:35.861786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01952f62-97a1-4db3-a3e4-94e0effb583c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:35.862437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01952f62-97a1-4db3-a3e4-94e0effb583c admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:35.862713 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01952f62-97a1-4db3-a3e4-94e0effb583c admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:35.863072 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01952f62-97a1-4db3-a3e4-94e0effb583c admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:35.864610 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01952f62-97a1-4db3-a3e4-94e0effb583c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:35.866239 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01952f62-97a1-4db3-a3e4-94e0effb583c admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:35.881507 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1199/2369] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:17:35.886037 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b6c18-ec92-4944-a1f5-a87dcfa3e7ee admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:35.899441 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b6c18-ec92-4944-a1f5-a87dcfa3e7ee admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:35.906369 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518ca00-4d18-4137-b9a8-9ba7c4f08c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:35.907235 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518ca00-4d18-4137-b9a8-9ba7c4f08c43 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:35.907235 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518ca00-4d18-4137-b9a8-9ba7c4f08c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:35.907699 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518ca00-4d18-4137-b9a8-9ba7c4f08c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:35.908266 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0518ca00-4d18-4137-b9a8-9ba7c4f08c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:35.909904 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0518ca00-4d18-4137-b9a8-9ba7c4f08c43 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:35.931442 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1171/2370] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:17:35.936422 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01952f62-97a1-4db3-a3e4-94e0effb583c admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:35.948946 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01952f62-97a1-4db3-a3e4-94e0effb583c admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:35.954476 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a1273-eeb5-4865-a23c-6fb142e411c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:35.955195 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a1273-eeb5-4865-a23c-6fb142e411c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:35.955805 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a1273-eeb5-4865-a23c-6fb142e411c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:35.956057 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a1273-eeb5-4865-a23c-6fb142e411c6 admin admin] PATH_INFO: `/v3/projects/aaf2e8dff6b14bf1956d40a4f7018ed1/users/adadb4c915e84dc6a590874ddaa2bfc4/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:35.974652 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a1273-eeb5-4865-a23c-6fb142e411c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaf2e8dff6b14bf1956d40a4f7018ed1, user_id=adadb4c915e84dc6a590874ddaa2bfc4, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:35.977435 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a1273-eeb5-4865-a23c-6fb142e411c6 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:36.099823 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1200/2371] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:17:35 2022] PUT /identity/v3/projects/aaf2e8dff6b14bf1956d40a4f7018ed1/users/adadb4c915e84dc6a590874ddaa2bfc4/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:17:36.110797 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6f0e8-c9b4-4854-9ecb-85337a67c773 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:36.111076 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6f0e8-c9b4-4854-9ecb-85337a67c773 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:36.111350 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6f0e8-c9b4-4854-9ecb-85337a67c773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:36.148413 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-4df6f0e8-c9b4-4854-9ecb-85337a67c773 None None] MFA Rules not processed for user `adadb4c915e84dc6a590874ddaa2bfc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:17:36.149671 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-4df6f0e8-c9b4-4854-9ecb-85337a67c773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:36.226573 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1172/2372] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:17:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:17:36.232331 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a1273-eeb5-4865-a23c-6fb142e411c6 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:36.321743 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a1273-eeb5-4865-a23c-6fb142e411c6 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:36.327144 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeacb3b-21c8-4ad8-b2ed-c16b3f88034b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:36.327796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeacb3b-21c8-4ad8-b2ed-c16b3f88034b admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:36.328083 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeacb3b-21c8-4ad8-b2ed-c16b3f88034b admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:36.328464 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeacb3b-21c8-4ad8-b2ed-c16b3f88034b admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:36.329169 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeacb3b-21c8-4ad8-b2ed-c16b3f88034b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:36.331117 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeacb3b-21c8-4ad8-b2ed-c16b3f88034b admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:36.459188 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1201/2373] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:17:36 2022] POST /identity/v3/projects => generated 365 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:17:36.464211 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6f0e8-c9b4-4854-9ecb-85337a67c773 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:36.484491 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6f0e8-c9b4-4854-9ecb-85337a67c773 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:36.574390 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f70c2-03df-4e1c-ba66-5e4bb88e1b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:36.575062 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f70c2-03df-4e1c-ba66-5e4bb88e1b02 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:36.575347 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f70c2-03df-4e1c-ba66-5e4bb88e1b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:36.575623 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f70c2-03df-4e1c-ba66-5e4bb88e1b02 admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:36.576504 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f70c2-03df-4e1c-ba66-5e4bb88e1b02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:36.578819 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f70c2-03df-4e1c-ba66-5e4bb88e1b02 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:36.673497 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1173/2374] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:17:36 2022] POST /identity/v3/users => generated 289 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:17:36.678055 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeacb3b-21c8-4ad8-b2ed-c16b3f88034b admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:36.689473 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeacb3b-21c8-4ad8-b2ed-c16b3f88034b admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:36.695286 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1f285-7cae-4318-b864-fa10f3932a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:36.695936 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1f285-7cae-4318-b864-fa10f3932a78 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:36.696250 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1f285-7cae-4318-b864-fa10f3932a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:36.696586 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1f285-7cae-4318-b864-fa10f3932a78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:36.702646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1f285-7cae-4318-b864-fa10f3932a78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:36.702646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1f285-7cae-4318-b864-fa10f3932a78 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:36.714304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1202/2375] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:17:36.718411 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f70c2-03df-4e1c-ba66-5e4bb88e1b02 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:36.730375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f70c2-03df-4e1c-ba66-5e4bb88e1b02 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:36.735652 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27c301-489d-423a-9586-8c8c1d7a7be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:36.736410 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27c301-489d-423a-9586-8c8c1d7a7be5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:36.736695 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27c301-489d-423a-9586-8c8c1d7a7be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:36.737085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27c301-489d-423a-9586-8c8c1d7a7be5 admin admin] PATH_INFO: `/v3/projects/288ee149654e45e1b1af74ca13360ad0/users/9045d3407a3a403aade6a1e42e34005a/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:36.740378 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:36.758324 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27c301-489d-423a-9586-8c8c1d7a7be5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=288ee149654e45e1b1af74ca13360ad0, user_id=9045d3407a3a403aade6a1e42e34005a, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:36.760726 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27c301-489d-423a-9586-8c8c1d7a7be5 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:36.825224 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1174/2376] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:17:36 2022] PUT /identity/v3/projects/288ee149654e45e1b1af74ca13360ad0/users/9045d3407a3a403aade6a1e42e34005a/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:17:36.830111 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1f285-7cae-4318-b864-fa10f3932a78 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:36.844767 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1f285-7cae-4318-b864-fa10f3932a78 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:36.921772 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cff858-fec0-4b70-8ee4-cd6f6232b844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:36.922232 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cff858-fec0-4b70-8ee4-cd6f6232b844 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:36.922562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cff858-fec0-4b70-8ee4-cd6f6232b844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:36.922883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cff858-fec0-4b70-8ee4-cd6f6232b844 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:36.923736 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cff858-fec0-4b70-8ee4-cd6f6232b844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:36.925603 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cff858-fec0-4b70-8ee4-cd6f6232b844 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:36.937572 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1203/2377] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:17:36.942307 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27c301-489d-423a-9586-8c8c1d7a7be5 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:36.954349 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27c301-489d-423a-9586-8c8c1d7a7be5 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:36.960230 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef25e4d-1cca-4c5e-b344-e436528bbb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:36.960943 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef25e4d-1cca-4c5e-b344-e436528bbb90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:36.961234 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef25e4d-1cca-4c5e-b344-e436528bbb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:36.961774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef25e4d-1cca-4c5e-b344-e436528bbb90 admin admin] PATH_INFO: `/v3/projects/288ee149654e45e1b1af74ca13360ad0/users/9045d3407a3a403aade6a1e42e34005a/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:36.964288 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef25e4d-1cca-4c5e-b344-e436528bbb90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=288ee149654e45e1b1af74ca13360ad0, user_id=9045d3407a3a403aade6a1e42e34005a, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:36.966945 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef25e4d-1cca-4c5e-b344-e436528bbb90 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:36.979221 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1175/2378] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:17:36 2022] PUT /identity/v3/projects/288ee149654e45e1b1af74ca13360ad0/users/9045d3407a3a403aade6a1e42e34005a/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:17:36.992216 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7372130-6d84-46e6-ba06-6c6aaa8bed5a None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:36.993186 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7372130-6d84-46e6-ba06-6c6aaa8bed5a None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:36.993479 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7372130-6d84-46e6-ba06-6c6aaa8bed5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:37.025336 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-a7372130-6d84-46e6-ba06-6c6aaa8bed5a None None] MFA Rules not processed for user `9045d3407a3a403aade6a1e42e34005a`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:17:37.026582 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-a7372130-6d84-46e6-ba06-6c6aaa8bed5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:37.040520 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:37.102286 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1204/2379] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:17:36 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:17:37.114830 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef25e4d-1cca-4c5e-b344-e436528bbb90 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:37.117591 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-cef25e4d-1cca-4c5e-b344-e436528bbb90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:37.195200 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef25e4d-1cca-4c5e-b344-e436528bbb90 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:37.199176 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66081842-bbb1-42b0-8649-305356eda53d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:37.199799 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66081842-bbb1-42b0-8649-305356eda53d service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:37.200081 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66081842-bbb1-42b0-8649-305356eda53d service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:37.200380 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66081842-bbb1-42b0-8649-305356eda53d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:37.211472 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66081842-bbb1-42b0-8649-305356eda53d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:37.213536 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66081842-bbb1-42b0-8649-305356eda53d service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:37.223701 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1176/2380] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:17:37 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:17:37.497938 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7372130-6d84-46e6-ba06-6c6aaa8bed5a None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:37.508764 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7372130-6d84-46e6-ba06-6c6aaa8bed5a None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:37.513600 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd93bed-15c4-4a58-912c-706ffdad6d6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:37.514309 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd93bed-15c4-4a58-912c-706ffdad6d6c service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:37.514589 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd93bed-15c4-4a58-912c-706ffdad6d6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:37.514862 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd93bed-15c4-4a58-912c-706ffdad6d6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:37.581769 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd93bed-15c4-4a58-912c-706ffdad6d6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:37.584487 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd93bed-15c4-4a58-912c-706ffdad6d6c service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:37.594892 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1205/2381] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:17:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:17:44.578965 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66081842-bbb1-42b0-8649-305356eda53d service cinder] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:44.704768 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66081842-bbb1-42b0-8649-305356eda53d service cinder] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:44.710834 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7384fd12-c7d6-4cd6-8353-14da8b41a535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:44.716115 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384fd12-c7d6-4cd6-8353-14da8b41a535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:44.716115 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384fd12-c7d6-4cd6-8353-14da8b41a535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:44.716115 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384fd12-c7d6-4cd6-8353-14da8b41a535 admin admin] PATH_INFO: `/v3/users/adadb4c915e84dc6a590874ddaa2bfc4` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:44.716115 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7384fd12-c7d6-4cd6-8353-14da8b41a535 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adadb4c915e84dc6a590874ddaa2bfc4)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:44.716115 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7384fd12-c7d6-4cd6-8353-14da8b41a535 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:44.967997 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-7384fd12-c7d6-4cd6-8353-14da8b41a535 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adadb4c915e84dc6a590874ddaa2bfc4'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:44.976181 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-7384fd12-c7d6-4cd6-8353-14da8b41a535 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adadb4c915e84dc6a590874ddaa2bfc4'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:44.976958 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-7384fd12-c7d6-4cd6-8353-14da8b41a535 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adadb4c915e84dc6a590874ddaa2bfc4'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:45.070067 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-7384fd12-c7d6-4cd6-8353-14da8b41a535 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adadb4c915e84dc6a590874ddaa2bfc4'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:45.103242 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:45.110305 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-7384fd12-c7d6-4cd6-8353-14da8b41a535 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adadb4c915e84dc6a590874ddaa2bfc4'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:45.118367 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1177/2382] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:17:44 2022] DELETE /identity/v3/users/adadb4c915e84dc6a590874ddaa2bfc4 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:17:45.124062 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057679c-808e-457f-a7a6-baba258e88c5 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:45.125066 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057679c-808e-457f-a7a6-baba258e88c5 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:45.125532 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057679c-808e-457f-a7a6-baba258e88c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:45.147544 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-3057679c-808e-457f-a7a6-baba258e88c5 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:17:45.148873 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-3057679c-808e-457f-a7a6-baba258e88c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:45.218876 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1206/2383] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:17:45.254066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7384fd12-c7d6-4cd6-8353-14da8b41a535 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:45.256360 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-7384fd12-c7d6-4cd6-8353-14da8b41a535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:45.506017 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7384fd12-c7d6-4cd6-8353-14da8b41a535 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:45.506017 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8becf8f1-68de-4dab-8b3d-b5b0d9a5daaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:45.506017 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becf8f1-68de-4dab-8b3d-b5b0d9a5daaf service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:45.506017 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becf8f1-68de-4dab-8b3d-b5b0d9a5daaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:45.507499 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becf8f1-68de-4dab-8b3d-b5b0d9a5daaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:45.507499 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8becf8f1-68de-4dab-8b3d-b5b0d9a5daaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:45.507499 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8becf8f1-68de-4dab-8b3d-b5b0d9a5daaf service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:45.507499 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1178/2384] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:17:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:17:45.923214 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057679c-808e-457f-a7a6-baba258e88c5 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:45.932174 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-3057679c-808e-457f-a7a6-baba258e88c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:45.956780 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057679c-808e-457f-a7a6-baba258e88c5 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:45.963908 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b26f6-145b-4def-9d6e-e376806ff233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:45.965173 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b26f6-145b-4def-9d6e-e376806ff233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:45.965173 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b26f6-145b-4def-9d6e-e376806ff233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:45.965433 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b26f6-145b-4def-9d6e-e376806ff233 admin admin] PATH_INFO: `/v3/projects/aaf2e8dff6b14bf1956d40a4f7018ed1` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:45.966688 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b26f6-145b-4def-9d6e-e376806ff233 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaf2e8dff6b14bf1956d40a4f7018ed1)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:45.968774 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b26f6-145b-4def-9d6e-e376806ff233 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:46.139505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:46.144038 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-4c5b26f6-145b-4def-9d6e-e376806ff233 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaf2e8dff6b14bf1956d40a4f7018ed1', 'request_id': 'req-4c5b26f6-145b-4def-9d6e-e376806ff233'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:46.294438 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-4c5b26f6-145b-4def-9d6e-e376806ff233 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaf2e8dff6b14bf1956d40a4f7018ed1', 'request_id': 'req-4c5b26f6-145b-4def-9d6e-e376806ff233'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:46.303287 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-4c5b26f6-145b-4def-9d6e-e376806ff233 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaf2e8dff6b14bf1956d40a4f7018ed1', 'request_id': 'req-4c5b26f6-145b-4def-9d6e-e376806ff233'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:46.327275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-4c5b26f6-145b-4def-9d6e-e376806ff233 admin admin] The token cache is being invalidate because project aaf2e8dff6b14bf1956d40a4f7018ed1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:17:46.327275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-4c5b26f6-145b-4def-9d6e-e376806ff233 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:46.327275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-4c5b26f6-145b-4def-9d6e-e376806ff233 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:46.327275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1207/2385] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:17:45 2022] DELETE /identity/v3/projects/aaf2e8dff6b14bf1956d40a4f7018ed1 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:17:46.330227 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8becf8f1-68de-4dab-8b3d-b5b0d9a5daaf service neutron] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:46.351741 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8becf8f1-68de-4dab-8b3d-b5b0d9a5daaf service neutron] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:46.439390 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d727b9a-dd0d-4ff1-b35b-8d561691c36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:46.439789 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d727b9a-dd0d-4ff1-b35b-8d561691c36d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:46.440071 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d727b9a-dd0d-4ff1-b35b-8d561691c36d admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:46.440377 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d727b9a-dd0d-4ff1-b35b-8d561691c36d admin admin] PATH_INFO: `/v3/users/9045d3407a3a403aade6a1e42e34005a` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:46.441557 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d727b9a-dd0d-4ff1-b35b-8d561691c36d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9045d3407a3a403aade6a1e42e34005a)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:46.443748 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d727b9a-dd0d-4ff1-b35b-8d561691c36d admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:46.755073 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5d727b9a-dd0d-4ff1-b35b-8d561691c36d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9045d3407a3a403aade6a1e42e34005a'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:46.769015 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5d727b9a-dd0d-4ff1-b35b-8d561691c36d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9045d3407a3a403aade6a1e42e34005a'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:46.769876 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5d727b9a-dd0d-4ff1-b35b-8d561691c36d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9045d3407a3a403aade6a1e42e34005a'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:46.934636 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5d727b9a-dd0d-4ff1-b35b-8d561691c36d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9045d3407a3a403aade6a1e42e34005a'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:46.952103 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5d727b9a-dd0d-4ff1-b35b-8d561691c36d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9045d3407a3a403aade6a1e42e34005a'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:46.958804 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1179/2386] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:17:46 2022] DELETE /identity/v3/users/9045d3407a3a403aade6a1e42e34005a => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:17:47.595828 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b26f6-145b-4def-9d6e-e376806ff233 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:47.597980 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-4c5b26f6-145b-4def-9d6e-e376806ff233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:47.625751 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b26f6-145b-4def-9d6e-e376806ff233 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:47.721641 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74090c99-e7b2-4507-80d8-9031be64f3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:47.722441 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74090c99-e7b2-4507-80d8-9031be64f3a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:47.722827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74090c99-e7b2-4507-80d8-9031be64f3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:47.723208 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74090c99-e7b2-4507-80d8-9031be64f3a9 admin admin] PATH_INFO: `/v3/projects/288ee149654e45e1b1af74ca13360ad0` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:47.724613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74090c99-e7b2-4507-80d8-9031be64f3a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=288ee149654e45e1b1af74ca13360ad0)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:47.726747 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74090c99-e7b2-4507-80d8-9031be64f3a9 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:47.944426 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-74090c99-e7b2-4507-80d8-9031be64f3a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '288ee149654e45e1b1af74ca13360ad0', 'request_id': 'req-74090c99-e7b2-4507-80d8-9031be64f3a9'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:48.157548 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-74090c99-e7b2-4507-80d8-9031be64f3a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '288ee149654e45e1b1af74ca13360ad0', 'request_id': 'req-74090c99-e7b2-4507-80d8-9031be64f3a9'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:48.166836 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-74090c99-e7b2-4507-80d8-9031be64f3a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '288ee149654e45e1b1af74ca13360ad0', 'request_id': 'req-74090c99-e7b2-4507-80d8-9031be64f3a9'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:48.181145 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-74090c99-e7b2-4507-80d8-9031be64f3a9 admin admin] The token cache is being invalidate because project 288ee149654e45e1b1af74ca13360ad0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:17:48.181434 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-74090c99-e7b2-4507-80d8-9031be64f3a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:48.182123 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-74090c99-e7b2-4507-80d8-9031be64f3a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:17:48.183726 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1208/2387] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:17:47 2022] DELETE /identity/v3/projects/288ee149654e45e1b1af74ca13360ad0 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:17:48.190939 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f505b92-40d5-4531-9648-323a86602106 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:48.191791 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f505b92-40d5-4531-9648-323a86602106 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:48.191791 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f505b92-40d5-4531-9648-323a86602106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:48.219350 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-9f505b92-40d5-4531-9648-323a86602106 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:17:48.221030 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-9f505b92-40d5-4531-9648-323a86602106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:48.231327 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:48.312269 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1180/2388] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:17:48.334069 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3155af5-1dab-482b-91fb-294a6392bba5 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:48.334069 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3155af5-1dab-482b-91fb-294a6392bba5 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:48.334069 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3155af5-1dab-482b-91fb-294a6392bba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:48.350947 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba0a31-02a1-4c0d-ac23-2d803633eda7 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:48.350947 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba0a31-02a1-4c0d-ac23-2d803633eda7 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:48.350947 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba0a31-02a1-4c0d-ac23-2d803633eda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:48.356014 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-a3155af5-1dab-482b-91fb-294a6392bba5 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:17:48.358641 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-a3155af5-1dab-482b-91fb-294a6392bba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:48.373486 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-30ba0a31-02a1-4c0d-ac23-2d803633eda7 None None] MFA Rules not processed for user `c0a2b49114e0458f9625de698cc89861`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:17:48.375070 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-30ba0a31-02a1-4c0d-ac23-2d803633eda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:48.376073 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1209/2389] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:17:48.381660 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3155af5-1dab-482b-91fb-294a6392bba5 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:48.397768 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3155af5-1dab-482b-91fb-294a6392bba5 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:48.403728 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281e4bf-65cf-4b59-ace6-8e19acdc594e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:48.408828 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281e4bf-65cf-4b59-ace6-8e19acdc594e admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:48.409221 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281e4bf-65cf-4b59-ace6-8e19acdc594e admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:48.409610 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281e4bf-65cf-4b59-ace6-8e19acdc594e admin admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:48.410609 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281e4bf-65cf-4b59-ace6-8e19acdc594e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:17:48.411012 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281e4bf-65cf-4b59-ace6-8e19acdc594e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:48.414642 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281e4bf-65cf-4b59-ace6-8e19acdc594e admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:48.438959 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1210/2390] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:17:48.441293 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281e4bf-65cf-4b59-ace6-8e19acdc594e admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:48.458010 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281e4bf-65cf-4b59-ace6-8e19acdc594e admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:48.464034 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1181/2391] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:17:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:17:48.465154 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346844b-f785-4d41-b4e5-0b153bd94ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:48.465855 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346844b-f785-4d41-b4e5-0b153bd94ba4 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:48.466143 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346844b-f785-4d41-b4e5-0b153bd94ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:48.466463 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346844b-f785-4d41-b4e5-0b153bd94ba4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:48.467167 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b346844b-f785-4d41-b4e5-0b153bd94ba4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:48.469756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b346844b-f785-4d41-b4e5-0b153bd94ba4 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:48.663017 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1211/2392] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:17:48 2022] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:17:48.667947 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba0a31-02a1-4c0d-ac23-2d803633eda7 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:48.680598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba0a31-02a1-4c0d-ac23-2d803633eda7 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:48.764569 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9161054-e7a2-4ccb-b985-8afa616afabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:48.765218 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9161054-e7a2-4ccb-b985-8afa616afabe admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:48.765485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9161054-e7a2-4ccb-b985-8afa616afabe admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:48.765865 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9161054-e7a2-4ccb-b985-8afa616afabe admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:48.766637 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9161054-e7a2-4ccb-b985-8afa616afabe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:48.768538 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9161054-e7a2-4ccb-b985-8afa616afabe admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:48.907288 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1182/2393] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:17:48 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:17:48.912224 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346844b-f785-4d41-b4e5-0b153bd94ba4 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:48.926227 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346844b-f785-4d41-b4e5-0b153bd94ba4 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:48.938084 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525a9a7-22ec-4ec0-9b58-c2bab353a266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:48.938763 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525a9a7-22ec-4ec0-9b58-c2bab353a266 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:48.939012 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525a9a7-22ec-4ec0-9b58-c2bab353a266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:48.939295 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525a9a7-22ec-4ec0-9b58-c2bab353a266 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:48.940003 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525a9a7-22ec-4ec0-9b58-c2bab353a266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:48.941667 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525a9a7-22ec-4ec0-9b58-c2bab353a266 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:48.956340 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1212/2394] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:17:48.957899 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9161054-e7a2-4ccb-b985-8afa616afabe admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:48.969332 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9161054-e7a2-4ccb-b985-8afa616afabe admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:48.974501 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf43bc-5ec6-4ed9-ad9b-7284e0307c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:48.975198 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf43bc-5ec6-4ed9-ad9b-7284e0307c96 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:48.975483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf43bc-5ec6-4ed9-ad9b-7284e0307c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:48.975757 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf43bc-5ec6-4ed9-ad9b-7284e0307c96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:48.976499 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf43bc-5ec6-4ed9-ad9b-7284e0307c96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:48.978443 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf43bc-5ec6-4ed9-ad9b-7284e0307c96 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:48.993727 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1183/2395] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:17:48.995077 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525a9a7-22ec-4ec0-9b58-c2bab353a266 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:49.007356 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525a9a7-22ec-4ec0-9b58-c2bab353a266 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:49.013313 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c2e08-0086-4293-9f26-1077f9183184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:49.014285 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c2e08-0086-4293-9f26-1077f9183184 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:49.014803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c2e08-0086-4293-9f26-1077f9183184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:49.015326 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c2e08-0086-4293-9f26-1077f9183184 admin admin] PATH_INFO: `/v3/projects/6500236f13c34be1afbd04cd239027ca/users/bdb566c2db52470088b9a74c2587ec75/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:49.025666 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:49.035124 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c2e08-0086-4293-9f26-1077f9183184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6500236f13c34be1afbd04cd239027ca, user_id=bdb566c2db52470088b9a74c2587ec75, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:49.038084 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c2e08-0086-4293-9f26-1077f9183184 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:49.114822 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1213/2396] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:17:48 2022] PUT /identity/v3/projects/6500236f13c34be1afbd04cd239027ca/users/bdb566c2db52470088b9a74c2587ec75/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:17:49.127745 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87940532-68f1-4ab1-991e-280fdaf6c818 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:49.128285 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87940532-68f1-4ab1-991e-280fdaf6c818 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:49.128783 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87940532-68f1-4ab1-991e-280fdaf6c818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:49.176896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-87940532-68f1-4ab1-991e-280fdaf6c818 None None] MFA Rules not processed for user `bdb566c2db52470088b9a74c2587ec75`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:17:49.178240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-87940532-68f1-4ab1-991e-280fdaf6c818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:49.211268 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:49.256657 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1184/2397] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:17:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:17:49.268626 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c2e08-0086-4293-9f26-1077f9183184 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:49.271631 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-457c2e08-0086-4293-9f26-1077f9183184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:49.350223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c2e08-0086-4293-9f26-1077f9183184 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:49.354268 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0392c3-9254-4a1b-b85b-a761e076af0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:49.354918 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0392c3-9254-4a1b-b85b-a761e076af0b service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:49.355192 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0392c3-9254-4a1b-b85b-a761e076af0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:49.355468 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0392c3-9254-4a1b-b85b-a761e076af0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:49.366155 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0392c3-9254-4a1b-b85b-a761e076af0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:49.367634 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0392c3-9254-4a1b-b85b-a761e076af0b service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:49.377393 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1214/2398] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:17:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:17:59.534682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=31,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:59.660650 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=15 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:00.447347 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87940532-68f1-4ab1-991e-280fdaf6c818 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:00.533908 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87940532-68f1-4ab1-991e-280fdaf6c818 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:00.539410 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52c03c-9fc7-4a7d-8f26-e88c2a4ab2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:00.540299 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52c03c-9fc7-4a7d-8f26-e88c2a4ab2a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:00.540596 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52c03c-9fc7-4a7d-8f26-e88c2a4ab2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:00.540947 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52c03c-9fc7-4a7d-8f26-e88c2a4ab2a4 admin admin] PATH_INFO: `/v3/users/bdb566c2db52470088b9a74c2587ec75` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:00.542387 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52c03c-9fc7-4a7d-8f26-e88c2a4ab2a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdb566c2db52470088b9a74c2587ec75)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:00.544788 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52c03c-9fc7-4a7d-8f26-e88c2a4ab2a4 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:00.863604 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-aa52c03c-9fc7-4a7d-8f26-e88c2a4ab2a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdb566c2db52470088b9a74c2587ec75'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:00.871632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-aa52c03c-9fc7-4a7d-8f26-e88c2a4ab2a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdb566c2db52470088b9a74c2587ec75'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:00.872346 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-aa52c03c-9fc7-4a7d-8f26-e88c2a4ab2a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdb566c2db52470088b9a74c2587ec75'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:00.974181 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-aa52c03c-9fc7-4a7d-8f26-e88c2a4ab2a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdb566c2db52470088b9a74c2587ec75'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:00.989532 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-aa52c03c-9fc7-4a7d-8f26-e88c2a4ab2a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdb566c2db52470088b9a74c2587ec75'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:00.996635 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1185/2399] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:18:00 2022] DELETE /identity/v3/users/bdb566c2db52470088b9a74c2587ec75 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:01.002187 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f6177-a29d-4b34-8d6d-4c02f4e6a220 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:01.002728 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f6177-a29d-4b34-8d6d-4c02f4e6a220 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:01.003196 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f6177-a29d-4b34-8d6d-4c02f4e6a220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:01.030340 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-e49f6177-a29d-4b34-8d6d-4c02f4e6a220 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:01.031469 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-e49f6177-a29d-4b34-8d6d-4c02f4e6a220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:01.096939 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1215/2400] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:01.121629 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52c03c-9fc7-4a7d-8f26-e88c2a4ab2a4 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:01.123071 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-aa52c03c-9fc7-4a7d-8f26-e88c2a4ab2a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:01.185988 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52c03c-9fc7-4a7d-8f26-e88c2a4ab2a4 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:01.189627 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355b1d4-da5d-45fe-a09a-f2f625033e1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:01.190252 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355b1d4-da5d-45fe-a09a-f2f625033e1f service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:01.190533 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355b1d4-da5d-45fe-a09a-f2f625033e1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:01.190807 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355b1d4-da5d-45fe-a09a-f2f625033e1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:01.201115 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355b1d4-da5d-45fe-a09a-f2f625033e1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:01.202559 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355b1d4-da5d-45fe-a09a-f2f625033e1f service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:01.212318 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1186/2401] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:18:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:18:01.714256 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f6177-a29d-4b34-8d6d-4c02f4e6a220 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:01.716136 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-e49f6177-a29d-4b34-8d6d-4c02f4e6a220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:01.741208 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f6177-a29d-4b34-8d6d-4c02f4e6a220 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:01.747424 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab06e78-1710-4433-a9ed-0fb963cea318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:01.748526 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab06e78-1710-4433-a9ed-0fb963cea318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:01.748985 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab06e78-1710-4433-a9ed-0fb963cea318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:01.749334 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab06e78-1710-4433-a9ed-0fb963cea318 admin admin] PATH_INFO: `/v3/projects/6500236f13c34be1afbd04cd239027ca` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:01.750652 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab06e78-1710-4433-a9ed-0fb963cea318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6500236f13c34be1afbd04cd239027ca)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:01.752775 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab06e78-1710-4433-a9ed-0fb963cea318 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:01.983190 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-1ab06e78-1710-4433-a9ed-0fb963cea318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6500236f13c34be1afbd04cd239027ca', 'request_id': 'req-1ab06e78-1710-4433-a9ed-0fb963cea318'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:02.048184 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-1ab06e78-1710-4433-a9ed-0fb963cea318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6500236f13c34be1afbd04cd239027ca', 'request_id': 'req-1ab06e78-1710-4433-a9ed-0fb963cea318'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:02.054595 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-1ab06e78-1710-4433-a9ed-0fb963cea318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6500236f13c34be1afbd04cd239027ca', 'request_id': 'req-1ab06e78-1710-4433-a9ed-0fb963cea318'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:02.067567 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-1ab06e78-1710-4433-a9ed-0fb963cea318 admin admin] The token cache is being invalidate because project 6500236f13c34be1afbd04cd239027ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:18:02.067860 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-1ab06e78-1710-4433-a9ed-0fb963cea318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:02.068552 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-1ab06e78-1710-4433-a9ed-0fb963cea318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:02.070683 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1216/2402] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:18:01 2022] DELETE /identity/v3/projects/6500236f13c34be1afbd04cd239027ca => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:18:02.076294 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d4fa5-ce48-4153-b11c-bb6ee1659dbb None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:02.076848 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d4fa5-ce48-4153-b11c-bb6ee1659dbb None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:02.076848 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d4fa5-ce48-4153-b11c-bb6ee1659dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:02.097972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-d84d4fa5-ce48-4153-b11c-bb6ee1659dbb None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:02.099087 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-d84d4fa5-ce48-4153-b11c-bb6ee1659dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:02.116122 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:02.165469 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1187/2403] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:02.175212 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269f349-e1a1-42cd-8a5f-71f804f883d8 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:02.175564 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269f349-e1a1-42cd-8a5f-71f804f883d8 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:02.175774 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269f349-e1a1-42cd-8a5f-71f804f883d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:02.198258 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-2269f349-e1a1-42cd-8a5f-71f804f883d8 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:02.199486 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-2269f349-e1a1-42cd-8a5f-71f804f883d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:02.207408 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1217/2404] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:02.213268 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d4fa5-ce48-4153-b11c-bb6ee1659dbb None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:02.222774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d4fa5-ce48-4153-b11c-bb6ee1659dbb None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:02.227551 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e7cbf-5a11-45af-abff-060196016f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:02.229686 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e7cbf-5a11-45af-abff-060196016f95 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:02.229686 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e7cbf-5a11-45af-abff-060196016f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:02.229686 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e7cbf-5a11-45af-abff-060196016f95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:02.229686 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e7cbf-5a11-45af-abff-060196016f95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:18:02.230056 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e7cbf-5a11-45af-abff-060196016f95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:02.231362 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e7cbf-5a11-45af-abff-060196016f95 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:02.243539 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1188/2405] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:18:02.248540 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269f349-e1a1-42cd-8a5f-71f804f883d8 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:02.259535 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269f349-e1a1-42cd-8a5f-71f804f883d8 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:02.264381 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e224285-1a0f-476a-98e9-cb938d1bbaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:02.265006 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e224285-1a0f-476a-98e9-cb938d1bbaba admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:02.265289 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e224285-1a0f-476a-98e9-cb938d1bbaba admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:02.265562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e224285-1a0f-476a-98e9-cb938d1bbaba admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:02.266229 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e224285-1a0f-476a-98e9-cb938d1bbaba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:02.268192 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e224285-1a0f-476a-98e9-cb938d1bbaba admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:02.371584 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1218/2406] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:18:02 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:02.376122 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e7cbf-5a11-45af-abff-060196016f95 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:02.386751 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e7cbf-5a11-45af-abff-060196016f95 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:02.450032 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed45749-1bd4-4ad5-b8e6-e415bf305d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:02.450654 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed45749-1bd4-4ad5-b8e6-e415bf305d3a admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:02.450930 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed45749-1bd4-4ad5-b8e6-e415bf305d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:02.451240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed45749-1bd4-4ad5-b8e6-e415bf305d3a admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:02.451900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed45749-1bd4-4ad5-b8e6-e415bf305d3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:02.453841 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed45749-1bd4-4ad5-b8e6-e415bf305d3a admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:02.575292 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1189/2407] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:18:02 2022] POST /identity/v3/users => generated 286 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:18:02.579689 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e224285-1a0f-476a-98e9-cb938d1bbaba admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:02.591492 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e224285-1a0f-476a-98e9-cb938d1bbaba admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:02.596825 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d83c6e-7784-46e3-b1c1-22821a8f77ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:02.597485 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d83c6e-7784-46e3-b1c1-22821a8f77ab admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:02.597825 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d83c6e-7784-46e3-b1c1-22821a8f77ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:02.598101 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d83c6e-7784-46e3-b1c1-22821a8f77ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:02.598803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d83c6e-7784-46e3-b1c1-22821a8f77ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:02.600462 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d83c6e-7784-46e3-b1c1-22821a8f77ab admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:02.612816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1219/2408] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:18:02.619152 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed45749-1bd4-4ad5-b8e6-e415bf305d3a admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:02.631042 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed45749-1bd4-4ad5-b8e6-e415bf305d3a admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:02.637090 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c28a1-5017-4f96-b62d-cec7310949cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:02.637857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c28a1-5017-4f96-b62d-cec7310949cb admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:02.638141 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c28a1-5017-4f96-b62d-cec7310949cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:02.638436 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c28a1-5017-4f96-b62d-cec7310949cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:02.639140 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c28a1-5017-4f96-b62d-cec7310949cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:02.641414 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c28a1-5017-4f96-b62d-cec7310949cb admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:02.656139 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1190/2409] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:18:02.668725 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d83c6e-7784-46e3-b1c1-22821a8f77ab admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:02.680552 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d83c6e-7784-46e3-b1c1-22821a8f77ab admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:02.685337 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ce6f5-6b88-411d-b9c9-34b371f7f7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:02.686080 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ce6f5-6b88-411d-b9c9-34b371f7f7b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:02.686366 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ce6f5-6b88-411d-b9c9-34b371f7f7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:02.686640 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ce6f5-6b88-411d-b9c9-34b371f7f7b3 admin admin] PATH_INFO: `/v3/projects/889f9a883a91461d8ef9092e6e6fab2d/users/8ff5d1e1b6f14032853a4c5d9d51a452/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:02.705002 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ce6f5-6b88-411d-b9c9-34b371f7f7b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=889f9a883a91461d8ef9092e6e6fab2d, user_id=8ff5d1e1b6f14032853a4c5d9d51a452, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:02.707860 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ce6f5-6b88-411d-b9c9-34b371f7f7b3 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:02.834631 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1220/2410] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:18:02 2022] PUT /identity/v3/projects/889f9a883a91461d8ef9092e6e6fab2d/users/8ff5d1e1b6f14032853a4c5d9d51a452/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:02.836396 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85b17c-5af5-4c60-a04a-df92377ea453 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:02.836678 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85b17c-5af5-4c60-a04a-df92377ea453 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:02.836957 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85b17c-5af5-4c60-a04a-df92377ea453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:02.873049 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-2e85b17c-5af5-4c60-a04a-df92377ea453 None None] MFA Rules not processed for user `8ff5d1e1b6f14032853a4c5d9d51a452`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:02.876058 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-2e85b17c-5af5-4c60-a04a-df92377ea453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:02.979002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1191/2411] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:18:02.984323 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ce6f5-6b88-411d-b9c9-34b371f7f7b3 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:03.016595 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:03.105073 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ce6f5-6b88-411d-b9c9-34b371f7f7b3 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:03.117547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d534d-1785-419a-afa7-e2fb1290b479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:03.118261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d534d-1785-419a-afa7-e2fb1290b479 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:03.118515 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d534d-1785-419a-afa7-e2fb1290b479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:03.118791 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d534d-1785-419a-afa7-e2fb1290b479 admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:03.119544 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d534d-1785-419a-afa7-e2fb1290b479 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:03.121591 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d534d-1785-419a-afa7-e2fb1290b479 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:03.211006 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1221/2412] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:18:02 2022] POST /identity/v3/projects => generated 375 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:03.217883 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85b17c-5af5-4c60-a04a-df92377ea453 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:03.230991 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85b17c-5af5-4c60-a04a-df92377ea453 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:03.246914 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:03.303182 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04d353-8ad1-4a6c-af3b-196b7660683f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:03.303733 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04d353-8ad1-4a6c-af3b-196b7660683f admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:03.304016 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04d353-8ad1-4a6c-af3b-196b7660683f admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:03.304872 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04d353-8ad1-4a6c-af3b-196b7660683f admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:03.305547 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04d353-8ad1-4a6c-af3b-196b7660683f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:03.307468 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04d353-8ad1-4a6c-af3b-196b7660683f admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:03.426397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1192/2413] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:18:03 2022] POST /identity/v3/users => generated 294 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:18:03.431319 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d534d-1785-419a-afa7-e2fb1290b479 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:03.442850 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d534d-1785-419a-afa7-e2fb1290b479 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:03.449300 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ca1f3-ad24-4a45-8f36-ace5da4cd716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:03.450089 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ca1f3-ad24-4a45-8f36-ace5da4cd716 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:03.450470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ca1f3-ad24-4a45-8f36-ace5da4cd716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:03.450851 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ca1f3-ad24-4a45-8f36-ace5da4cd716 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:03.451665 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ca1f3-ad24-4a45-8f36-ace5da4cd716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:03.453601 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ca1f3-ad24-4a45-8f36-ace5da4cd716 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:03.466103 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1222/2414] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:18:03.472829 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04d353-8ad1-4a6c-af3b-196b7660683f admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:03.481395 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04d353-8ad1-4a6c-af3b-196b7660683f admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:03.487540 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb681d-711d-4402-b1b3-bea63b4127b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:03.488370 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb681d-711d-4402-b1b3-bea63b4127b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:03.488721 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb681d-711d-4402-b1b3-bea63b4127b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:03.489038 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb681d-711d-4402-b1b3-bea63b4127b1 admin admin] PATH_INFO: `/v3/projects/ca1ba6097675440b947a47014b668139/users/ade0265857894933b8282ef09ba8015c/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:03.506142 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb681d-711d-4402-b1b3-bea63b4127b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca1ba6097675440b947a47014b668139, user_id=ade0265857894933b8282ef09ba8015c, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:03.509859 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb681d-711d-4402-b1b3-bea63b4127b1 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:03.587823 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1193/2415] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:18:03 2022] PUT /identity/v3/projects/ca1ba6097675440b947a47014b668139/users/ade0265857894933b8282ef09ba8015c/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:03.592381 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ca1f3-ad24-4a45-8f36-ace5da4cd716 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:03.606659 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ca1f3-ad24-4a45-8f36-ace5da4cd716 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:03.679134 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a51529-f728-4e3e-87dc-ce31c8200ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:03.680106 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a51529-f728-4e3e-87dc-ce31c8200ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:03.680516 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a51529-f728-4e3e-87dc-ce31c8200ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:03.680799 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a51529-f728-4e3e-87dc-ce31c8200ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:03.681511 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a51529-f728-4e3e-87dc-ce31c8200ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:03.683306 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a51529-f728-4e3e-87dc-ce31c8200ec5 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:03.699030 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1223/2416] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:18:03.700737 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb681d-711d-4402-b1b3-bea63b4127b1 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:03.713096 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb681d-711d-4402-b1b3-bea63b4127b1 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:03.718059 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f07b8-7930-464c-b321-6bbbb4ed0418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:03.718776 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f07b8-7930-464c-b321-6bbbb4ed0418 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:03.719073 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f07b8-7930-464c-b321-6bbbb4ed0418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:03.719354 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f07b8-7930-464c-b321-6bbbb4ed0418 admin admin] PATH_INFO: `/v3/projects/ca1ba6097675440b947a47014b668139/users/ade0265857894933b8282ef09ba8015c/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:03.721378 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f07b8-7930-464c-b321-6bbbb4ed0418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca1ba6097675440b947a47014b668139, user_id=ade0265857894933b8282ef09ba8015c, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:03.724072 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f07b8-7930-464c-b321-6bbbb4ed0418 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:03.736289 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1194/2417] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:18:03 2022] PUT /identity/v3/projects/ca1ba6097675440b947a47014b668139/users/ade0265857894933b8282ef09ba8015c/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:18:03.748787 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009debd8-1e22-4506-97a7-7479916784a7 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:03.749198 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009debd8-1e22-4506-97a7-7479916784a7 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:03.749477 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009debd8-1e22-4506-97a7-7479916784a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:03.786051 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-009debd8-1e22-4506-97a7-7479916784a7 None None] MFA Rules not processed for user `ade0265857894933b8282ef09ba8015c`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:03.787285 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-009debd8-1e22-4506-97a7-7479916784a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:03.864148 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1224/2418] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:03.874936 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f07b8-7930-464c-b321-6bbbb4ed0418 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:03.876793 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-052f07b8-7930-464c-b321-6bbbb4ed0418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:03.942569 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f07b8-7930-464c-b321-6bbbb4ed0418 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:03.947206 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1158f3-fbde-4e23-8593-02ad88c5ddfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:03.947842 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1158f3-fbde-4e23-8593-02ad88c5ddfe service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:03.948127 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1158f3-fbde-4e23-8593-02ad88c5ddfe service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:03.948434 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1158f3-fbde-4e23-8593-02ad88c5ddfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:04.013606 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1158f3-fbde-4e23-8593-02ad88c5ddfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:04.015044 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1158f3-fbde-4e23-8593-02ad88c5ddfe service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:04.025667 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1195/2419] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:18:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:18:07.449704 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009debd8-1e22-4506-97a7-7479916784a7 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:07.471894 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:07.519906 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009debd8-1e22-4506-97a7-7479916784a7 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:07.525418 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0dbf8-b670-4bf6-9481-0647c2191e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:07.526110 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0dbf8-b670-4bf6-9481-0647c2191e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:07.526394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0dbf8-b670-4bf6-9481-0647c2191e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:07.526671 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0dbf8-b670-4bf6-9481-0647c2191e0d admin admin] PATH_INFO: `/v3/users/8ff5d1e1b6f14032853a4c5d9d51a452` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:07.527888 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0dbf8-b670-4bf6-9481-0647c2191e0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ff5d1e1b6f14032853a4c5d9d51a452)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:07.529862 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0dbf8-b670-4bf6-9481-0647c2191e0d admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:07.823406 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-53e0dbf8-b670-4bf6-9481-0647c2191e0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff5d1e1b6f14032853a4c5d9d51a452'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:07.934161 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-53e0dbf8-b670-4bf6-9481-0647c2191e0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff5d1e1b6f14032853a4c5d9d51a452'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:07.942301 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-53e0dbf8-b670-4bf6-9481-0647c2191e0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff5d1e1b6f14032853a4c5d9d51a452'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:07.943095 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-53e0dbf8-b670-4bf6-9481-0647c2191e0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff5d1e1b6f14032853a4c5d9d51a452'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:07.943737 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-53e0dbf8-b670-4bf6-9481-0647c2191e0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff5d1e1b6f14032853a4c5d9d51a452'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:07.964098 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1225/2420] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:18:07 2022] DELETE /identity/v3/users/8ff5d1e1b6f14032853a4c5d9d51a452 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:07.968625 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20baf60b-3816-4e19-aa96-c72739d4a676 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:07.969205 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20baf60b-3816-4e19-aa96-c72739d4a676 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:07.969393 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20baf60b-3816-4e19-aa96-c72739d4a676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:07.990146 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-20baf60b-3816-4e19-aa96-c72739d4a676 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:07.991982 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-20baf60b-3816-4e19-aa96-c72739d4a676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:08.012433 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:08.057115 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1196/2421] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:08.067217 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0dbf8-b670-4bf6-9481-0647c2191e0d admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:08.068974 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-53e0dbf8-b670-4bf6-9481-0647c2191e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:08.156539 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0dbf8-b670-4bf6-9481-0647c2191e0d admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:08.164699 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0664e-11ee-4a65-b8ac-1636ef3ca05e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:08.166044 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0664e-11ee-4a65-b8ac-1636ef3ca05e service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:08.166453 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0664e-11ee-4a65-b8ac-1636ef3ca05e service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:08.166836 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0664e-11ee-4a65-b8ac-1636ef3ca05e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:08.181107 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0664e-11ee-4a65-b8ac-1636ef3ca05e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:08.183136 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0664e-11ee-4a65-b8ac-1636ef3ca05e service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:08.196479 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1226/2422] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:18:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:18:09.358550 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20baf60b-3816-4e19-aa96-c72739d4a676 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:09.360120 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-20baf60b-3816-4e19-aa96-c72739d4a676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:09.403753 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20baf60b-3816-4e19-aa96-c72739d4a676 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:09.433250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7362e0-b321-4617-85ff-d90e25bfa5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:09.434380 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7362e0-b321-4617-85ff-d90e25bfa5fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:09.435105 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7362e0-b321-4617-85ff-d90e25bfa5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:09.435873 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7362e0-b321-4617-85ff-d90e25bfa5fe admin admin] PATH_INFO: `/v3/projects/889f9a883a91461d8ef9092e6e6fab2d` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:09.438230 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7362e0-b321-4617-85ff-d90e25bfa5fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=889f9a883a91461d8ef9092e6e6fab2d)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:09.441979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7362e0-b321-4617-85ff-d90e25bfa5fe admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:09.634107 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4b7362e0-b321-4617-85ff-d90e25bfa5fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '889f9a883a91461d8ef9092e6e6fab2d', 'request_id': 'req-4b7362e0-b321-4617-85ff-d90e25bfa5fe'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:09.647090 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4b7362e0-b321-4617-85ff-d90e25bfa5fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '889f9a883a91461d8ef9092e6e6fab2d', 'request_id': 'req-4b7362e0-b321-4617-85ff-d90e25bfa5fe'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:09.658285 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4b7362e0-b321-4617-85ff-d90e25bfa5fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '889f9a883a91461d8ef9092e6e6fab2d', 'request_id': 'req-4b7362e0-b321-4617-85ff-d90e25bfa5fe'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:09.767303 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4b7362e0-b321-4617-85ff-d90e25bfa5fe admin admin] The token cache is being invalidate because project 889f9a883a91461d8ef9092e6e6fab2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:18:09.768244 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4b7362e0-b321-4617-85ff-d90e25bfa5fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:09.769439 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4b7362e0-b321-4617-85ff-d90e25bfa5fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:09.772010 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1197/2423] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:18:09 2022] DELETE /identity/v3/projects/889f9a883a91461d8ef9092e6e6fab2d => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:09.779954 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0664e-11ee-4a65-b8ac-1636ef3ca05e service neutron] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:09.793170 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0664e-11ee-4a65-b8ac-1636ef3ca05e service neutron] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:09.838201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:09.863949 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed409ca5-50e9-4c53-82ab-18569f644e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:09.864764 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed409ca5-50e9-4c53-82ab-18569f644e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:09.865117 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed409ca5-50e9-4c53-82ab-18569f644e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:09.865396 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed409ca5-50e9-4c53-82ab-18569f644e2f admin admin] PATH_INFO: `/v3/users/ade0265857894933b8282ef09ba8015c` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:09.866827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed409ca5-50e9-4c53-82ab-18569f644e2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ade0265857894933b8282ef09ba8015c)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:09.868890 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed409ca5-50e9-4c53-82ab-18569f644e2f admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:10.087901 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-ed409ca5-50e9-4c53-82ab-18569f644e2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ade0265857894933b8282ef09ba8015c'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:10.146001 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-ed409ca5-50e9-4c53-82ab-18569f644e2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ade0265857894933b8282ef09ba8015c'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:10.157755 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-ed409ca5-50e9-4c53-82ab-18569f644e2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ade0265857894933b8282ef09ba8015c'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:10.158843 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-ed409ca5-50e9-4c53-82ab-18569f644e2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ade0265857894933b8282ef09ba8015c'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:10.159936 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-ed409ca5-50e9-4c53-82ab-18569f644e2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ade0265857894933b8282ef09ba8015c'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:10.188072 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1227/2424] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:18:09 2022] DELETE /identity/v3/users/ade0265857894933b8282ef09ba8015c => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:10.923580 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7362e0-b321-4617-85ff-d90e25bfa5fe admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:10.925515 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-4b7362e0-b321-4617-85ff-d90e25bfa5fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:10.940154 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7362e0-b321-4617-85ff-d90e25bfa5fe admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:11.050808 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed6756-0a01-4014-bb4c-f8cd90db6def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:11.050808 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed6756-0a01-4014-bb4c-f8cd90db6def admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:11.050808 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed6756-0a01-4014-bb4c-f8cd90db6def admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:11.050808 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed6756-0a01-4014-bb4c-f8cd90db6def admin admin] PATH_INFO: `/v3/projects/ca1ba6097675440b947a47014b668139` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:11.051246 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed6756-0a01-4014-bb4c-f8cd90db6def admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca1ba6097675440b947a47014b668139)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:11.051246 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed6756-0a01-4014-bb4c-f8cd90db6def admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:11.222004 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-14ed6756-0a01-4014-bb4c-f8cd90db6def admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca1ba6097675440b947a47014b668139', 'request_id': 'req-14ed6756-0a01-4014-bb4c-f8cd90db6def'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:11.223389 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:11.230023 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-14ed6756-0a01-4014-bb4c-f8cd90db6def admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca1ba6097675440b947a47014b668139', 'request_id': 'req-14ed6756-0a01-4014-bb4c-f8cd90db6def'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:11.236621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-14ed6756-0a01-4014-bb4c-f8cd90db6def admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca1ba6097675440b947a47014b668139', 'request_id': 'req-14ed6756-0a01-4014-bb4c-f8cd90db6def'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:11.405531 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-14ed6756-0a01-4014-bb4c-f8cd90db6def admin admin] The token cache is being invalidate because project ca1ba6097675440b947a47014b668139 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:18:11.405837 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-14ed6756-0a01-4014-bb4c-f8cd90db6def admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:11.407186 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-14ed6756-0a01-4014-bb4c-f8cd90db6def admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:11.409667 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1198/2425] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:18:10 2022] DELETE /identity/v3/projects/ca1ba6097675440b947a47014b668139 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:11.416189 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fd1fa-aae1-4242-bc76-cc175939ec53 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:11.416656 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fd1fa-aae1-4242-bc76-cc175939ec53 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:11.416742 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fd1fa-aae1-4242-bc76-cc175939ec53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:11.439462 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-dd9fd1fa-aae1-4242-bc76-cc175939ec53 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:11.440765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-dd9fd1fa-aae1-4242-bc76-cc175939ec53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:11.517098 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1228/2426] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:11.527040 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d25f56-977d-4c30-b2af-603456797565 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:11.527040 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d25f56-977d-4c30-b2af-603456797565 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:11.527409 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d25f56-977d-4c30-b2af-603456797565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:11.549581 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-c3d25f56-977d-4c30-b2af-603456797565 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:11.551130 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-c3d25f56-977d-4c30-b2af-603456797565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:11.561361 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1199/2427] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:18:11.564758 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9fd1fa-aae1-4242-bc76-cc175939ec53 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:11.575515 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9fd1fa-aae1-4242-bc76-cc175939ec53 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:11.581091 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a5a89-0ff0-4370-a3a2-942fed87f668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:11.581758 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a5a89-0ff0-4370-a3a2-942fed87f668 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:11.582039 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a5a89-0ff0-4370-a3a2-942fed87f668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:11.582312 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a5a89-0ff0-4370-a3a2-942fed87f668 admin admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:11.583019 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a5a89-0ff0-4370-a3a2-942fed87f668 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:18:11.583324 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a5a89-0ff0-4370-a3a2-942fed87f668 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:11.585797 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a5a89-0ff0-4370-a3a2-942fed87f668 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:11.603265 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1229/2428] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:18:11.607762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d25f56-977d-4c30-b2af-603456797565 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:11.616986 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d25f56-977d-4c30-b2af-603456797565 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:11.623028 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4affe-1db1-425d-b216-8baf383e9ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:11.623664 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4affe-1db1-425d-b216-8baf383e9ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:11.623938 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4affe-1db1-425d-b216-8baf383e9ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:11.624235 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4affe-1db1-425d-b216-8baf383e9ba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:11.624954 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4affe-1db1-425d-b216-8baf383e9ba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:11.626859 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4affe-1db1-425d-b216-8baf383e9ba1 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:11.760259 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1200/2429] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:18:11 2022] POST /identity/v3/projects => generated 371 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:11.765243 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a5a89-0ff0-4370-a3a2-942fed87f668 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:11.777312 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a5a89-0ff0-4370-a3a2-942fed87f668 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:11.838245 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:11.867565 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b8ef4-4809-41ca-b7c8-32f80a7572ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:11.868427 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b8ef4-4809-41ca-b7c8-32f80a7572ba admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:11.868955 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b8ef4-4809-41ca-b7c8-32f80a7572ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:11.869397 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b8ef4-4809-41ca-b7c8-32f80a7572ba admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:11.870870 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b8ef4-4809-41ca-b7c8-32f80a7572ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:11.873477 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b8ef4-4809-41ca-b7c8-32f80a7572ba admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:12.015726 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1230/2430] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:18:11 2022] POST /identity/v3/users => generated 286 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:12.020142 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4affe-1db1-425d-b216-8baf383e9ba1 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:12.032640 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4affe-1db1-425d-b216-8baf383e9ba1 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:12.041619 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deba146-45ea-4c2a-94a2-7c7a3f385fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:12.042463 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deba146-45ea-4c2a-94a2-7c7a3f385fad admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:12.042748 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deba146-45ea-4c2a-94a2-7c7a3f385fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:12.043033 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deba146-45ea-4c2a-94a2-7c7a3f385fad admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:12.043918 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deba146-45ea-4c2a-94a2-7c7a3f385fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:12.045430 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deba146-45ea-4c2a-94a2-7c7a3f385fad admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:12.068059 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1201/2431] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:18:12.078322 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b8ef4-4809-41ca-b7c8-32f80a7572ba admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:12.091433 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b8ef4-4809-41ca-b7c8-32f80a7572ba admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:12.100150 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a90366-d5c7-42f3-8f8a-bc1b97403ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:12.100150 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a90366-d5c7-42f3-8f8a-bc1b97403ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:12.100150 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a90366-d5c7-42f3-8f8a-bc1b97403ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:12.100963 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a90366-d5c7-42f3-8f8a-bc1b97403ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:12.101112 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a90366-d5c7-42f3-8f8a-bc1b97403ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:12.103257 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a90366-d5c7-42f3-8f8a-bc1b97403ed1 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:12.104485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deba146-45ea-4c2a-94a2-7c7a3f385fad admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:12.110251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-1deba146-45ea-4c2a-94a2-7c7a3f385fad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:12.120944 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1231/2432] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:18:12.126478 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a90366-d5c7-42f3-8f8a-bc1b97403ed1 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:12.164827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a90366-d5c7-42f3-8f8a-bc1b97403ed1 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:12.174449 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1ed9b-6e9f-4f79-b1da-fc90a4feea06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:12.175775 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1ed9b-6e9f-4f79-b1da-fc90a4feea06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:12.176321 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1ed9b-6e9f-4f79-b1da-fc90a4feea06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:12.176871 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1ed9b-6e9f-4f79-b1da-fc90a4feea06 admin admin] PATH_INFO: `/v3/projects/f15f389a69d249adaa55b25d60e54ab0/users/6cd2f7ae47fd42929ccfaed668c5a55f/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:12.208073 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1ed9b-6e9f-4f79-b1da-fc90a4feea06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f15f389a69d249adaa55b25d60e54ab0, user_id=6cd2f7ae47fd42929ccfaed668c5a55f, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:12.214530 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1ed9b-6e9f-4f79-b1da-fc90a4feea06 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:12.221357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deba146-45ea-4c2a-94a2-7c7a3f385fad admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:12.227614 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e264bd9-fbd9-4757-be55-fa1ef7f2c843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:12.228749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e264bd9-fbd9-4757-be55-fa1ef7f2c843 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:12.229255 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e264bd9-fbd9-4757-be55-fa1ef7f2c843 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:12.229748 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e264bd9-fbd9-4757-be55-fa1ef7f2c843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:12.232947 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-0e264bd9-fbd9-4757-be55-fa1ef7f2c843 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:12.344027 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e264bd9-fbd9-4757-be55-fa1ef7f2c843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:12.346789 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e264bd9-fbd9-4757-be55-fa1ef7f2c843 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:12.364204 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1202/2433] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:18:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:18:12.480668 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1232/2434] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:18:12 2022] PUT /identity/v3/projects/f15f389a69d249adaa55b25d60e54ab0/users/6cd2f7ae47fd42929ccfaed668c5a55f/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:12.487721 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fbb0e-d57e-41cc-9688-c02f61b52fd1 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:12.487721 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fbb0e-d57e-41cc-9688-c02f61b52fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:12.487721 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fbb0e-d57e-41cc-9688-c02f61b52fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:12.518498 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-ee0fbb0e-d57e-41cc-9688-c02f61b52fd1 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:12.526055 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-ee0fbb0e-d57e-41cc-9688-c02f61b52fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:12.677028 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:12.693224 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1203/2435] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:12.694173 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1ed9b-6e9f-4f79-b1da-fc90a4feea06 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:12.697134 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-b2a1ed9b-6e9f-4f79-b1da-fc90a4feea06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:12.712276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fbb0e-d57e-41cc-9688-c02f61b52fd1 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:12.790199 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1ed9b-6e9f-4f79-b1da-fc90a4feea06 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:12.796753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb6187-2d3f-4915-8286-8b3a8cb8f13a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:12.801814 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb6187-2d3f-4915-8286-8b3a8cb8f13a service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:12.801814 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb6187-2d3f-4915-8286-8b3a8cb8f13a service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:12.801814 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb6187-2d3f-4915-8286-8b3a8cb8f13a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:12.801814 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-c1bb6187-2d3f-4915-8286-8b3a8cb8f13a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:12.805889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fbb0e-d57e-41cc-9688-c02f61b52fd1 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:12.810186 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293d7fd-4c00-48a4-a801-c9bab376e06a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:12.812436 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293d7fd-4c00-48a4-a801-c9bab376e06a service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:12.812925 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293d7fd-4c00-48a4-a801-c9bab376e06a service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:12.813392 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293d7fd-4c00-48a4-a801-c9bab376e06a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:12.832753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb6187-2d3f-4915-8286-8b3a8cb8f13a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:12.833634 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb6187-2d3f-4915-8286-8b3a8cb8f13a service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:12.837364 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293d7fd-4c00-48a4-a801-c9bab376e06a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:12.839926 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293d7fd-4c00-48a4-a801-c9bab376e06a service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:12.853754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1233/2436] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:18:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:18:12.854662 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1204/2437] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:18:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:18:15.432386 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a8117-39c7-488a-a2ea-5f9facdf673f None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:15.432908 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a8117-39c7-488a-a2ea-5f9facdf673f None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:15.432995 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a8117-39c7-488a-a2ea-5f9facdf673f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:15.510926 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-7c8a8117-39c7-488a-a2ea-5f9facdf673f None None] MFA Rules not processed for user `6cd2f7ae47fd42929ccfaed668c5a55f`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:15.512937 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-7c8a8117-39c7-488a-a2ea-5f9facdf673f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:15.715332 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1234/2438] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:15.722912 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293d7fd-4c00-48a4-a801-c9bab376e06a service neutron] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:15.727007 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-4293d7fd-4c00-48a4-a801-c9bab376e06a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:15.883445 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293d7fd-4c00-48a4-a801-c9bab376e06a service neutron] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:15.890862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543922ac-bb90-4c8c-89f7-591f46fbf87b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:15.892319 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543922ac-bb90-4c8c-89f7-591f46fbf87b service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:15.892781 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543922ac-bb90-4c8c-89f7-591f46fbf87b service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:15.893130 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543922ac-bb90-4c8c-89f7-591f46fbf87b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:15.906343 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543922ac-bb90-4c8c-89f7-591f46fbf87b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:15.909293 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543922ac-bb90-4c8c-89f7-591f46fbf87b service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:15.922905 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1205/2439] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:18:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:18:17.558296 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a8117-39c7-488a-a2ea-5f9facdf673f None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:17.572295 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a8117-39c7-488a-a2ea-5f9facdf673f None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:17.577322 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e2fc5-67ae-4560-8d31-a676d0e9f57f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:17.578980 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e2fc5-67ae-4560-8d31-a676d0e9f57f service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:17.579273 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e2fc5-67ae-4560-8d31-a676d0e9f57f service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:17.579553 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e2fc5-67ae-4560-8d31-a676d0e9f57f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:17.581616 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-515e2fc5-67ae-4560-8d31-a676d0e9f57f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:17.599013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e2fc5-67ae-4560-8d31-a676d0e9f57f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:17.601739 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e2fc5-67ae-4560-8d31-a676d0e9f57f service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:17.615372 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1235/2440] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:18:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:18:18.157208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a871666-7afc-4fd6-984e-25ce754b8407 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:18.158912 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a871666-7afc-4fd6-984e-25ce754b8407 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:18.160114 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a871666-7afc-4fd6-984e-25ce754b8407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:18.197364 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-2a871666-7afc-4fd6-984e-25ce754b8407 None None] MFA Rules not processed for user `6cd2f7ae47fd42929ccfaed668c5a55f`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:18.199326 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-2a871666-7afc-4fd6-984e-25ce754b8407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:18.207767 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1206/2441] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:19.219997 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e2fc5-67ae-4560-8d31-a676d0e9f57f service neutron] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:19.237648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e2fc5-67ae-4560-8d31-a676d0e9f57f service neutron] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:19.250422 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7294b12-ffe1-463c-94ee-d38a002e2180 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:19.251077 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7294b12-ffe1-463c-94ee-d38a002e2180 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:19.251361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7294b12-ffe1-463c-94ee-d38a002e2180 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:19.251830 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7294b12-ffe1-463c-94ee-d38a002e2180 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:19.261078 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-d7294b12-ffe1-463c-94ee-d38a002e2180 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:19.286923 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7294b12-ffe1-463c-94ee-d38a002e2180 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:19.291631 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7294b12-ffe1-463c-94ee-d38a002e2180 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:19.315816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1236/2442] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:18:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:18:20.148850 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a871666-7afc-4fd6-984e-25ce754b8407 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:20.157455 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-2a871666-7afc-4fd6-984e-25ce754b8407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:20.491395 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a871666-7afc-4fd6-984e-25ce754b8407 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:20.502081 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a5c10-2ae8-4e78-bebb-bac441923746 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cac76aa21415d8ab0a2524a7049d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:20.505459 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a5c10-2ae8-4e78-bebb-bac441923746 service placement] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:20.505844 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a5c10-2ae8-4e78-bebb-bac441923746 service placement] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:20.506189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a5c10-2ae8-4e78-bebb-bac441923746 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:20.514811 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-875a5c10-2ae8-4e78-bebb-bac441923746 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:20.540862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a5c10-2ae8-4e78-bebb-bac441923746 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:20.542836 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a5c10-2ae8-4e78-bebb-bac441923746 service placement] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:20.572658 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1207/2443] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:18:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:18:20.622601 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7294b12-ffe1-463c-94ee-d38a002e2180 service neutron] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:20.624341 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-d7294b12-ffe1-463c-94ee-d38a002e2180 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:20.643306 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:20.666610 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7294b12-ffe1-463c-94ee-d38a002e2180 service neutron] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:20.703118 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68017a5e-5306-4f6b-9b8c-35dbfffb8e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:20.704194 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68017a5e-5306-4f6b-9b8c-35dbfffb8e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:20.704474 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68017a5e-5306-4f6b-9b8c-35dbfffb8e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:20.705006 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68017a5e-5306-4f6b-9b8c-35dbfffb8e84 admin admin] PATH_INFO: `/v3/users/4a1a40ef55434cd48a2dc4385880fe0b` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:20.733160 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68017a5e-5306-4f6b-9b8c-35dbfffb8e84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a1a40ef55434cd48a2dc4385880fe0b)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:20.735232 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68017a5e-5306-4f6b-9b8c-35dbfffb8e84 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:21.141333 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-68017a5e-5306-4f6b-9b8c-35dbfffb8e84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a1a40ef55434cd48a2dc4385880fe0b'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:21.264630 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-68017a5e-5306-4f6b-9b8c-35dbfffb8e84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a1a40ef55434cd48a2dc4385880fe0b'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:21.277468 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-68017a5e-5306-4f6b-9b8c-35dbfffb8e84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a1a40ef55434cd48a2dc4385880fe0b'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:21.287007 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-68017a5e-5306-4f6b-9b8c-35dbfffb8e84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a1a40ef55434cd48a2dc4385880fe0b'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:21.287720 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-68017a5e-5306-4f6b-9b8c-35dbfffb8e84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a1a40ef55434cd48a2dc4385880fe0b'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:21.357460 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1237/2444] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:18:20 2022] DELETE /identity/v3/users/4a1a40ef55434cd48a2dc4385880fe0b => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:21.970489 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a5c10-2ae8-4e78-bebb-bac441923746 service placement] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:21.978722 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:21.992644 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a5c10-2ae8-4e78-bebb-bac441923746 service placement] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:22.107659 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22faec-8d70-460d-899b-58d375cdd289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:22.108508 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22faec-8d70-460d-899b-58d375cdd289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:22.108785 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22faec-8d70-460d-899b-58d375cdd289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:22.109410 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22faec-8d70-460d-899b-58d375cdd289 admin admin] PATH_INFO: `/v3/projects/06061d6914ac4b86841d45162ceeb89f` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:22.113303 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22faec-8d70-460d-899b-58d375cdd289 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06061d6914ac4b86841d45162ceeb89f)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:22.118837 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22faec-8d70-460d-899b-58d375cdd289 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:22.266009 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-cb22faec-8d70-460d-899b-58d375cdd289 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06061d6914ac4b86841d45162ceeb89f', 'request_id': 'req-cb22faec-8d70-460d-899b-58d375cdd289'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:22.280283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-cb22faec-8d70-460d-899b-58d375cdd289 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06061d6914ac4b86841d45162ceeb89f', 'request_id': 'req-cb22faec-8d70-460d-899b-58d375cdd289'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:22.296692 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-cb22faec-8d70-460d-899b-58d375cdd289 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06061d6914ac4b86841d45162ceeb89f', 'request_id': 'req-cb22faec-8d70-460d-899b-58d375cdd289'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:22.419592 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-cb22faec-8d70-460d-899b-58d375cdd289 admin admin] The token cache is being invalidate because project 06061d6914ac4b86841d45162ceeb89f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:18:22.420561 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-cb22faec-8d70-460d-899b-58d375cdd289 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:22.436511 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-cb22faec-8d70-460d-899b-58d375cdd289 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:22.443515 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1208/2445] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:18:21 2022] DELETE /identity/v3/projects/06061d6914ac4b86841d45162ceeb89f => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:22.449673 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3262c69-145c-4cbd-b794-62b980b8fe64 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:22.451188 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3262c69-145c-4cbd-b794-62b980b8fe64 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:22.451784 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3262c69-145c-4cbd-b794-62b980b8fe64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:22.479628 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-e3262c69-145c-4cbd-b794-62b980b8fe64 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:22.490353 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-e3262c69-145c-4cbd-b794-62b980b8fe64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:22.622773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22faec-8d70-460d-899b-58d375cdd289 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:22.624381 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-cb22faec-8d70-460d-899b-58d375cdd289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:22.783519 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1238/2446] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:22.799119 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3beb0-eb5c-46b2-af26-3dd66946e7c0 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:22.801902 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3beb0-eb5c-46b2-af26-3dd66946e7c0 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:22.803196 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3beb0-eb5c-46b2-af26-3dd66946e7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:22.862180 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-96c3beb0-eb5c-46b2-af26-3dd66946e7c0 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:22.864090 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-96c3beb0-eb5c-46b2-af26-3dd66946e7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:22.884493 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1239/2447] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:22.890033 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3beb0-eb5c-46b2-af26-3dd66946e7c0 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:22.892355 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22faec-8d70-460d-899b-58d375cdd289 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:22.897972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ac39e-94b5-4b16-9dc0-c3b9567afad7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cac76aa21415d8ab0a2524a7049d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:22.898794 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ac39e-94b5-4b16-9dc0-c3b9567afad7 service placement] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:22.899105 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ac39e-94b5-4b16-9dc0-c3b9567afad7 service placement] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:22.899371 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ac39e-94b5-4b16-9dc0-c3b9567afad7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:22.901666 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-9e8ac39e-94b5-4b16-9dc0-c3b9567afad7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:22.905598 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3beb0-eb5c-46b2-af26-3dd66946e7c0 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:22.911979 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e908e-e5b4-4250-a66d-9841df9f356a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:22.913638 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e908e-e5b4-4250-a66d-9841df9f356a admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:22.914203 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e908e-e5b4-4250-a66d-9841df9f356a admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:22.914384 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e908e-e5b4-4250-a66d-9841df9f356a admin admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:22.915507 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e908e-e5b4-4250-a66d-9841df9f356a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:18:22.916127 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e908e-e5b4-4250-a66d-9841df9f356a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:22.918002 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e908e-e5b4-4250-a66d-9841df9f356a admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:22.926385 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ac39e-94b5-4b16-9dc0-c3b9567afad7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:22.931872 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ac39e-94b5-4b16-9dc0-c3b9567afad7 service placement] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:22.954750 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1240/2448] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:18:22.978180 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e908e-e5b4-4250-a66d-9841df9f356a admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:22.985290 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e908e-e5b4-4250-a66d-9841df9f356a admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:22.991781 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf873a-5197-4c38-8fad-9d4784f72ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:22.993320 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf873a-5197-4c38-8fad-9d4784f72ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:22.993790 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf873a-5197-4c38-8fad-9d4784f72ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:22.994238 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf873a-5197-4c38-8fad-9d4784f72ce9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:22.995230 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf873a-5197-4c38-8fad-9d4784f72ce9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:22.997510 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf873a-5197-4c38-8fad-9d4784f72ce9 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:23.011356 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1209/2449] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:18:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:18:23.020050 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ac39e-94b5-4b16-9dc0-c3b9567afad7 service placement] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:23.021875 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-9e8ac39e-94b5-4b16-9dc0-c3b9567afad7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:23.052134 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ac39e-94b5-4b16-9dc0-c3b9567afad7 service placement] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:23.059796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252bac1-c977-48a0-9d02-e67a6ddb0621 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cac76aa21415d8ab0a2524a7049d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:23.060521 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252bac1-c977-48a0-9d02-e67a6ddb0621 service placement] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:23.061428 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252bac1-c977-48a0-9d02-e67a6ddb0621 service placement] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:23.061934 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252bac1-c977-48a0-9d02-e67a6ddb0621 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:23.077220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f252bac1-c977-48a0-9d02-e67a6ddb0621 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:23.078987 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f252bac1-c977-48a0-9d02-e67a6ddb0621 service placement] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:23.112094 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1241/2450] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:18:22 2022] POST /identity/v3/projects => generated 365 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:23.114734 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1210/2451] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:18:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:18:23.117775 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf873a-5197-4c38-8fad-9d4784f72ce9 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:23.179320 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:23.223616 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf873a-5197-4c38-8fad-9d4784f72ce9 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:23.233518 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37fb96-8d26-4501-8ac5-5a1787fbcf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:23.234329 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37fb96-8d26-4501-8ac5-5a1787fbcf71 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:23.236510 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37fb96-8d26-4501-8ac5-5a1787fbcf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:23.237262 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37fb96-8d26-4501-8ac5-5a1787fbcf71 admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:23.238170 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37fb96-8d26-4501-8ac5-5a1787fbcf71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:23.242086 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37fb96-8d26-4501-8ac5-5a1787fbcf71 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:23.349219 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1242/2452] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:18:23 2022] POST /identity/v3/users => generated 283 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:23.349452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252bac1-c977-48a0-9d02-e67a6ddb0621 service placement] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:23.379504 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252bac1-c977-48a0-9d02-e67a6ddb0621 service placement] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:23.400857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc9941-2aff-45d6-9074-e28db489a73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:23.404704 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc9941-2aff-45d6-9074-e28db489a73a admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:23.405662 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc9941-2aff-45d6-9074-e28db489a73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:23.407819 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc9941-2aff-45d6-9074-e28db489a73a admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:23.411557 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc9941-2aff-45d6-9074-e28db489a73a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:23.420413 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc9941-2aff-45d6-9074-e28db489a73a admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:23.429110 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:23.465673 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1211/2453] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:18:23.466220 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37fb96-8d26-4501-8ac5-5a1787fbcf71 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:23.475936 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc9941-2aff-45d6-9074-e28db489a73a admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:23.482637 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-6fdc9941-2aff-45d6-9074-e28db489a73a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:23.504539 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37fb96-8d26-4501-8ac5-5a1787fbcf71 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:23.521124 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6ab16-f652-4998-8323-c6ed661bb13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:23.522047 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6ab16-f652-4998-8323-c6ed661bb13d admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:23.522647 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6ab16-f652-4998-8323-c6ed661bb13d admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:23.523168 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6ab16-f652-4998-8323-c6ed661bb13d admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:23.524447 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6ab16-f652-4998-8323-c6ed661bb13d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:23.526445 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6ab16-f652-4998-8323-c6ed661bb13d admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:23.549875 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1243/2454] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:18:23.550893 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6ab16-f652-4998-8323-c6ed661bb13d admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:23.566474 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6ab16-f652-4998-8323-c6ed661bb13d admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:23.577660 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03735acb-a798-46e7-94f9-74411d9f1725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:23.578160 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03735acb-a798-46e7-94f9-74411d9f1725 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:23.578751 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03735acb-a798-46e7-94f9-74411d9f1725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:23.579244 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03735acb-a798-46e7-94f9-74411d9f1725 admin admin] PATH_INFO: `/v3/projects/74f98da96c354a67a3a50b77240f83f6/users/45e1888288484e32b68c51416116f3a2/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:23.597072 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc9941-2aff-45d6-9074-e28db489a73a admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:23.603051 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03735acb-a798-46e7-94f9-74411d9f1725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74f98da96c354a67a3a50b77240f83f6, user_id=45e1888288484e32b68c51416116f3a2, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:23.603832 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e2f8c-133c-4c77-82ad-be41823fb554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:23.604648 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e2f8c-133c-4c77-82ad-be41823fb554 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:23.604999 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e2f8c-133c-4c77-82ad-be41823fb554 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:23.605364 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e2f8c-133c-4c77-82ad-be41823fb554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:23.607527 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03735acb-a798-46e7-94f9-74411d9f1725 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:23.609372 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-1b8e2f8c-133c-4c77-82ad-be41823fb554 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:23.626663 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e2f8c-133c-4c77-82ad-be41823fb554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:23.629251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e2f8c-133c-4c77-82ad-be41823fb554 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:23.641471 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1212/2455] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:18:23.745823 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1244/2456] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:18:23 2022] PUT /identity/v3/projects/74f98da96c354a67a3a50b77240f83f6/users/45e1888288484e32b68c51416116f3a2/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:18:23.757553 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a16148-2696-414d-b881-4be6d2fc8bd5 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:23.757979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a16148-2696-414d-b881-4be6d2fc8bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:23.758450 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a16148-2696-414d-b881-4be6d2fc8bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:23.837973 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-71a16148-2696-414d-b881-4be6d2fc8bd5 None None] MFA Rules not processed for user `45e1888288484e32b68c51416116f3a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:23.837973 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-71a16148-2696-414d-b881-4be6d2fc8bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:23.984227 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1213/2457] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:24.013962 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03735acb-a798-46e7-94f9-74411d9f1725 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:24.016016 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-03735acb-a798-46e7-94f9-74411d9f1725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:24.160448 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03735acb-a798-46e7-94f9-74411d9f1725 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:24.167711 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433bdc6-58e2-4c14-8f37-6299f39adca7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:24.168926 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433bdc6-58e2-4c14-8f37-6299f39adca7 service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:24.169422 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433bdc6-58e2-4c14-8f37-6299f39adca7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:24.169909 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433bdc6-58e2-4c14-8f37-6299f39adca7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:24.189067 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433bdc6-58e2-4c14-8f37-6299f39adca7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:24.191581 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433bdc6-58e2-4c14-8f37-6299f39adca7 service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:24.220539 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1245/2458] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:18:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:18:24.925595 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a16148-2696-414d-b881-4be6d2fc8bd5 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:24.927211 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-71a16148-2696-414d-b881-4be6d2fc8bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:25.056145 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a16148-2696-414d-b881-4be6d2fc8bd5 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:25.063970 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131e052-0f5b-4d13-85be-669f76cf019e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:25.065090 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131e052-0f5b-4d13-85be-669f76cf019e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:25.065380 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131e052-0f5b-4d13-85be-669f76cf019e admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:25.066485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131e052-0f5b-4d13-85be-669f76cf019e admin admin] PATH_INFO: `/v3/users/ad3a9141e9284bb5a096fb04d3e9d581` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:25.067896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131e052-0f5b-4d13-85be-669f76cf019e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad3a9141e9284bb5a096fb04d3e9d581)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:25.072294 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131e052-0f5b-4d13-85be-669f76cf019e admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:25.324426 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:25.339495 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-0131e052-0f5b-4d13-85be-669f76cf019e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad3a9141e9284bb5a096fb04d3e9d581'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:25.347894 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-0131e052-0f5b-4d13-85be-669f76cf019e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad3a9141e9284bb5a096fb04d3e9d581'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:25.349175 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-0131e052-0f5b-4d13-85be-669f76cf019e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad3a9141e9284bb5a096fb04d3e9d581'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:25.482015 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-0131e052-0f5b-4d13-85be-669f76cf019e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad3a9141e9284bb5a096fb04d3e9d581'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:25.496136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-0131e052-0f5b-4d13-85be-669f76cf019e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad3a9141e9284bb5a096fb04d3e9d581'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:25.506331 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1214/2459] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:18:24 2022] DELETE /identity/v3/users/ad3a9141e9284bb5a096fb04d3e9d581 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:25.844573 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433bdc6-58e2-4c14-8f37-6299f39adca7 service cinder] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:25.857787 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433bdc6-58e2-4c14-8f37-6299f39adca7 service cinder] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:25.967469 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5783d9-f8d6-44fe-a556-e7ba01f07c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:25.968207 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5783d9-f8d6-44fe-a556-e7ba01f07c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:25.968576 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5783d9-f8d6-44fe-a556-e7ba01f07c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:25.968862 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5783d9-f8d6-44fe-a556-e7ba01f07c6d admin admin] PATH_INFO: `/v3/projects/b6fc6b07497a48eeb263b3a9b8aa7499` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:25.970077 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5783d9-f8d6-44fe-a556-e7ba01f07c6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6fc6b07497a48eeb263b3a9b8aa7499)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:25.972012 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5783d9-f8d6-44fe-a556-e7ba01f07c6d admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:26.099652 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:26.110547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-ce5783d9-f8d6-44fe-a556-e7ba01f07c6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'request_id': 'req-ce5783d9-f8d6-44fe-a556-e7ba01f07c6d'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:26.230686 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-ce5783d9-f8d6-44fe-a556-e7ba01f07c6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'request_id': 'req-ce5783d9-f8d6-44fe-a556-e7ba01f07c6d'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:26.242842 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-ce5783d9-f8d6-44fe-a556-e7ba01f07c6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'request_id': 'req-ce5783d9-f8d6-44fe-a556-e7ba01f07c6d'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:26.257879 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-ce5783d9-f8d6-44fe-a556-e7ba01f07c6d admin admin] The token cache is being invalidate because project b6fc6b07497a48eeb263b3a9b8aa7499 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:18:26.264301 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-ce5783d9-f8d6-44fe-a556-e7ba01f07c6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:26.264301 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-ce5783d9-f8d6-44fe-a556-e7ba01f07c6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:26.264301 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1246/2460] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:18:25 2022] DELETE /identity/v3/projects/b6fc6b07497a48eeb263b3a9b8aa7499 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:26.267667 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65263f5c-97e0-486c-b752-4988401e74a8 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:26.268704 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65263f5c-97e0-486c-b752-4988401e74a8 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:26.269124 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65263f5c-97e0-486c-b752-4988401e74a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:26.306720 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-65263f5c-97e0-486c-b752-4988401e74a8 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:26.308503 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-65263f5c-97e0-486c-b752-4988401e74a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:26.430085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1215/2461] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:18:26.438578 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834cf25-e0a9-426a-a793-a189ba02cafc None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:26.439326 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834cf25-e0a9-426a-a793-a189ba02cafc None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:26.439326 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834cf25-e0a9-426a-a793-a189ba02cafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:26.464141 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-7834cf25-e0a9-426a-a793-a189ba02cafc None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:26.465838 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-7834cf25-e0a9-426a-a793-a189ba02cafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:26.476143 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1247/2462] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:26.482920 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65263f5c-97e0-486c-b752-4988401e74a8 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:26.495341 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65263f5c-97e0-486c-b752-4988401e74a8 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:26.501617 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea0145-ba85-4aa3-b7ac-b11622e24db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:26.503260 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea0145-ba85-4aa3-b7ac-b11622e24db6 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:26.503552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea0145-ba85-4aa3-b7ac-b11622e24db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:26.503829 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea0145-ba85-4aa3-b7ac-b11622e24db6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:26.504583 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea0145-ba85-4aa3-b7ac-b11622e24db6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:18:26.504921 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea0145-ba85-4aa3-b7ac-b11622e24db6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:26.507145 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea0145-ba85-4aa3-b7ac-b11622e24db6 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:26.524203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1216/2463] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:18:26.528295 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834cf25-e0a9-426a-a793-a189ba02cafc None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:26.543231 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834cf25-e0a9-426a-a793-a189ba02cafc None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:26.548348 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa380e8-35d3-44ed-a7ae-a7972338610f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:26.549086 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa380e8-35d3-44ed-a7ae-a7972338610f admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:26.549374 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa380e8-35d3-44ed-a7ae-a7972338610f admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:26.549648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa380e8-35d3-44ed-a7ae-a7972338610f admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:26.550320 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa380e8-35d3-44ed-a7ae-a7972338610f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:26.552490 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa380e8-35d3-44ed-a7ae-a7972338610f admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:26.760123 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1248/2464] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:18:26 2022] POST /identity/v3/projects => generated 373 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:26.765892 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea0145-ba85-4aa3-b7ac-b11622e24db6 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:26.783022 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea0145-ba85-4aa3-b7ac-b11622e24db6 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:26.867024 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d4abc-805a-4ebb-990c-7c5b16e00807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:26.867770 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d4abc-805a-4ebb-990c-7c5b16e00807 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:26.868140 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d4abc-805a-4ebb-990c-7c5b16e00807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:26.868556 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d4abc-805a-4ebb-990c-7c5b16e00807 admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:26.869859 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3d4abc-805a-4ebb-990c-7c5b16e00807 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:26.872431 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3d4abc-805a-4ebb-990c-7c5b16e00807 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:26.981626 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1217/2465] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:18:26 2022] POST /identity/v3/users => generated 287 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:26.983436 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa380e8-35d3-44ed-a7ae-a7972338610f admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:27.002872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa380e8-35d3-44ed-a7ae-a7972338610f admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:27.009637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e238c3-6af8-4b97-9e36-b691f45d409b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:27.010607 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e238c3-6af8-4b97-9e36-b691f45d409b admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:27.011158 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e238c3-6af8-4b97-9e36-b691f45d409b admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:27.011606 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e238c3-6af8-4b97-9e36-b691f45d409b admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:27.012455 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e238c3-6af8-4b97-9e36-b691f45d409b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:27.014292 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e238c3-6af8-4b97-9e36-b691f45d409b admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:27.029936 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1249/2466] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:18:27.031649 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d4abc-805a-4ebb-990c-7c5b16e00807 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:27.045693 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d4abc-805a-4ebb-990c-7c5b16e00807 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:27.051314 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00e3de-6386-40e6-a344-a8f78af7703e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:27.052277 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00e3de-6386-40e6-a344-a8f78af7703e admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:27.052568 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00e3de-6386-40e6-a344-a8f78af7703e admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:27.053301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00e3de-6386-40e6-a344-a8f78af7703e admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:27.054419 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00e3de-6386-40e6-a344-a8f78af7703e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:27.056359 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00e3de-6386-40e6-a344-a8f78af7703e admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:27.074810 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1218/2467] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:18:27.079810 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e238c3-6af8-4b97-9e36-b691f45d409b admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:27.094098 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e238c3-6af8-4b97-9e36-b691f45d409b admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:27.104062 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e85814-fad1-4656-8a4b-6fc05a132d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:27.105330 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e85814-fad1-4656-8a4b-6fc05a132d77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:27.106121 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e85814-fad1-4656-8a4b-6fc05a132d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:27.106701 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e85814-fad1-4656-8a4b-6fc05a132d77 admin admin] PATH_INFO: `/v3/projects/1a4ff11abfb542228b187adce5b9e2d1/users/a732f16918a94426a1add97e1e8b3105/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:27.137422 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e85814-fad1-4656-8a4b-6fc05a132d77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a4ff11abfb542228b187adce5b9e2d1, user_id=a732f16918a94426a1add97e1e8b3105, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:27.142086 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e85814-fad1-4656-8a4b-6fc05a132d77 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:27.242100 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1250/2468] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:18:27 2022] PUT /identity/v3/projects/1a4ff11abfb542228b187adce5b9e2d1/users/a732f16918a94426a1add97e1e8b3105/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:27.258015 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c4a31-52cb-4cc7-868d-f9afa2ae9e13 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:27.259430 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c4a31-52cb-4cc7-868d-f9afa2ae9e13 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:27.260099 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c4a31-52cb-4cc7-868d-f9afa2ae9e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:27.317036 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-056c4a31-52cb-4cc7-868d-f9afa2ae9e13 None None] MFA Rules not processed for user `a732f16918a94426a1add97e1e8b3105`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:27.320212 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-056c4a31-52cb-4cc7-868d-f9afa2ae9e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:27.326859 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:27.437318 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1219/2469] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:27.458458 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e85814-fad1-4656-8a4b-6fc05a132d77 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:27.460370 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-63e85814-fad1-4656-8a4b-6fc05a132d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:27.729338 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e85814-fad1-4656-8a4b-6fc05a132d77 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:27.736979 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea8d53-0dbf-4238-b5fb-3c80b20105bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:27.737736 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea8d53-0dbf-4238-b5fb-3c80b20105bf service nova] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:27.738060 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea8d53-0dbf-4238-b5fb-3c80b20105bf service nova] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:27.738621 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea8d53-0dbf-4238-b5fb-3c80b20105bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:27.748833 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea8d53-0dbf-4238-b5fb-3c80b20105bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:27.750586 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea8d53-0dbf-4238-b5fb-3c80b20105bf service nova] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:27.765656 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1251/2470] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:18:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:18:30.761798 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c4a31-52cb-4cc7-868d-f9afa2ae9e13 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:30.763284 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-056c4a31-52cb-4cc7-868d-f9afa2ae9e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:30.886843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c4a31-52cb-4cc7-868d-f9afa2ae9e13 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:30.891816 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4821990-849f-4fcb-93b1-3c8d29e1bb65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:30.893009 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4821990-849f-4fcb-93b1-3c8d29e1bb65 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:30.893421 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4821990-849f-4fcb-93b1-3c8d29e1bb65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:30.893970 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4821990-849f-4fcb-93b1-3c8d29e1bb65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:30.898220 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-c4821990-849f-4fcb-93b1-3c8d29e1bb65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:31.071239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4821990-849f-4fcb-93b1-3c8d29e1bb65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:31.072993 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4821990-849f-4fcb-93b1-3c8d29e1bb65 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:31.092592 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1220/2471] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:18:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:18:31.783762 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea8d53-0dbf-4238-b5fb-3c80b20105bf service nova] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:31.797537 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea8d53-0dbf-4238-b5fb-3c80b20105bf service nova] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:31.804442 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961500ca-4eb2-4490-8c97-4d907e19daf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:31.805044 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961500ca-4eb2-4490-8c97-4d907e19daf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:31.805323 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961500ca-4eb2-4490-8c97-4d907e19daf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:31.806320 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961500ca-4eb2-4490-8c97-4d907e19daf7 admin admin] PATH_INFO: `/v3/users/a732f16918a94426a1add97e1e8b3105` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:31.808358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961500ca-4eb2-4490-8c97-4d907e19daf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a732f16918a94426a1add97e1e8b3105)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:31.811028 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961500ca-4eb2-4490-8c97-4d907e19daf7 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:31.830417 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:32.047858 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-961500ca-4eb2-4490-8c97-4d907e19daf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a732f16918a94426a1add97e1e8b3105'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:32.122292 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-961500ca-4eb2-4490-8c97-4d907e19daf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a732f16918a94426a1add97e1e8b3105'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:32.132575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-961500ca-4eb2-4490-8c97-4d907e19daf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a732f16918a94426a1add97e1e8b3105'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:32.133977 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-961500ca-4eb2-4490-8c97-4d907e19daf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a732f16918a94426a1add97e1e8b3105'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:32.144721 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-961500ca-4eb2-4490-8c97-4d907e19daf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a732f16918a94426a1add97e1e8b3105'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:32.178263 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1252/2472] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:18:31 2022] DELETE /identity/v3/users/a732f16918a94426a1add97e1e8b3105 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:32.182594 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356769a8-29b8-4b7b-b537-a1cab1c578be None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:32.183810 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356769a8-29b8-4b7b-b537-a1cab1c578be None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:32.183810 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356769a8-29b8-4b7b-b537-a1cab1c578be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:32.221402 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-356769a8-29b8-4b7b-b537-a1cab1c578be None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:32.223460 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-356769a8-29b8-4b7b-b537-a1cab1c578be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:32.311724 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:32.339261 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1221/2473] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:18:32.352015 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961500ca-4eb2-4490-8c97-4d907e19daf7 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:32.354029 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-961500ca-4eb2-4490-8c97-4d907e19daf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:32.449273 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961500ca-4eb2-4490-8c97-4d907e19daf7 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:32.453576 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357530e-ebc4-49c1-863b-1398dbafc610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:32.453987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357530e-ebc4-49c1-863b-1398dbafc610 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:32.454935 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357530e-ebc4-49c1-863b-1398dbafc610 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:32.454935 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357530e-ebc4-49c1-863b-1398dbafc610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:32.466961 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6357530e-ebc4-49c1-863b-1398dbafc610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:32.468754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6357530e-ebc4-49c1-863b-1398dbafc610 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:32.480378 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1253/2474] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:18:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:18:33.031416 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356769a8-29b8-4b7b-b537-a1cab1c578be None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:33.034107 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-356769a8-29b8-4b7b-b537-a1cab1c578be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:33.057315 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356769a8-29b8-4b7b-b537-a1cab1c578be None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:33.065240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ba306-e64c-4ba0-8a8a-b25cd0b0bf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:33.066036 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ba306-e64c-4ba0-8a8a-b25cd0b0bf50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:33.066262 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ba306-e64c-4ba0-8a8a-b25cd0b0bf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:33.066538 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ba306-e64c-4ba0-8a8a-b25cd0b0bf50 admin admin] PATH_INFO: `/v3/projects/1a4ff11abfb542228b187adce5b9e2d1` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:33.067900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ba306-e64c-4ba0-8a8a-b25cd0b0bf50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a4ff11abfb542228b187adce5b9e2d1)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:33.071157 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ba306-e64c-4ba0-8a8a-b25cd0b0bf50 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:33.233025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-6f1ba306-e64c-4ba0-8a8a-b25cd0b0bf50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a4ff11abfb542228b187adce5b9e2d1', 'request_id': 'req-6f1ba306-e64c-4ba0-8a8a-b25cd0b0bf50'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:33.239755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-6f1ba306-e64c-4ba0-8a8a-b25cd0b0bf50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a4ff11abfb542228b187adce5b9e2d1', 'request_id': 'req-6f1ba306-e64c-4ba0-8a8a-b25cd0b0bf50'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:33.249022 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-6f1ba306-e64c-4ba0-8a8a-b25cd0b0bf50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a4ff11abfb542228b187adce5b9e2d1', 'request_id': 'req-6f1ba306-e64c-4ba0-8a8a-b25cd0b0bf50'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:33.322763 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-6f1ba306-e64c-4ba0-8a8a-b25cd0b0bf50 admin admin] The token cache is being invalidate because project 1a4ff11abfb542228b187adce5b9e2d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:18:33.323234 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-6f1ba306-e64c-4ba0-8a8a-b25cd0b0bf50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:33.324315 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-6f1ba306-e64c-4ba0-8a8a-b25cd0b0bf50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:33.327431 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1222/2475] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:18:33 2022] DELETE /identity/v3/projects/1a4ff11abfb542228b187adce5b9e2d1 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:33.333332 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e8efd-1ac0-42f6-983e-4e0e1e140b28 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:33.333938 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e8efd-1ac0-42f6-983e-4e0e1e140b28 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:33.334050 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e8efd-1ac0-42f6-983e-4e0e1e140b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:33.358852 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-a17e8efd-1ac0-42f6-983e-4e0e1e140b28 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:33.360226 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-a17e8efd-1ac0-42f6-983e-4e0e1e140b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:33.442264 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1254/2476] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:33.451882 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c8964-ac5d-49ee-987f-22c307b8f225 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:33.452355 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c8964-ac5d-49ee-987f-22c307b8f225 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:33.452636 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c8964-ac5d-49ee-987f-22c307b8f225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:33.473732 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-576c8964-ac5d-49ee-987f-22c307b8f225 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:33.475607 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-576c8964-ac5d-49ee-987f-22c307b8f225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:33.483974 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1223/2477] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:33.488696 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e8efd-1ac0-42f6-983e-4e0e1e140b28 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:33.502118 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e8efd-1ac0-42f6-983e-4e0e1e140b28 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:33.508243 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12ee3e-8edd-4c28-84f4-10a672ee49d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:33.508971 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12ee3e-8edd-4c28-84f4-10a672ee49d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:33.509222 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12ee3e-8edd-4c28-84f4-10a672ee49d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:33.509501 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12ee3e-8edd-4c28-84f4-10a672ee49d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:33.510209 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12ee3e-8edd-4c28-84f4-10a672ee49d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:18:33.510849 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12ee3e-8edd-4c28-84f4-10a672ee49d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:33.512325 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12ee3e-8edd-4c28-84f4-10a672ee49d6 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:33.527329 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1255/2478] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:18:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:18:33.531927 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c8964-ac5d-49ee-987f-22c307b8f225 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:33.542091 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c8964-ac5d-49ee-987f-22c307b8f225 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:33.547614 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a92fa-101b-4f47-bd67-a2fe2ec10c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:33.548371 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a92fa-101b-4f47-bd67-a2fe2ec10c51 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:33.548682 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a92fa-101b-4f47-bd67-a2fe2ec10c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:33.549041 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a92fa-101b-4f47-bd67-a2fe2ec10c51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:33.549713 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a92fa-101b-4f47-bd67-a2fe2ec10c51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:33.551638 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a92fa-101b-4f47-bd67-a2fe2ec10c51 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:33.652988 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1224/2479] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:18:33 2022] POST /identity/v3/projects => generated 405 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:33.659624 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12ee3e-8edd-4c28-84f4-10a672ee49d6 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:33.677676 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12ee3e-8edd-4c28-84f4-10a672ee49d6 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:33.701800 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:33.755491 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d0cd5-7ce3-4d8e-a42f-7865c4287b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:33.756784 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d0cd5-7ce3-4d8e-a42f-7865c4287b34 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:33.757074 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d0cd5-7ce3-4d8e-a42f-7865c4287b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:33.757347 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d0cd5-7ce3-4d8e-a42f-7865c4287b34 admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:33.758020 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d0cd5-7ce3-4d8e-a42f-7865c4287b34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:33.759995 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d0cd5-7ce3-4d8e-a42f-7865c4287b34 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:33.959018 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1256/2480] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:18:33 2022] POST /identity/v3/users => generated 303 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:33.964142 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a92fa-101b-4f47-bd67-a2fe2ec10c51 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:33.978569 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a92fa-101b-4f47-bd67-a2fe2ec10c51 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:33.987786 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f28fe-e8a1-4ffd-a2c2-288308a6b6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:33.988456 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f28fe-e8a1-4ffd-a2c2-288308a6b6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:33.988775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f28fe-e8a1-4ffd-a2c2-288308a6b6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:33.989051 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f28fe-e8a1-4ffd-a2c2-288308a6b6f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:33.989762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f28fe-e8a1-4ffd-a2c2-288308a6b6f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:33.992034 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f28fe-e8a1-4ffd-a2c2-288308a6b6f8 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:34.003683 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1225/2481] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:18:34.009549 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d0cd5-7ce3-4d8e-a42f-7865c4287b34 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:34.020776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d0cd5-7ce3-4d8e-a42f-7865c4287b34 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:34.026412 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22a5bc-a30d-4e80-9865-92adc8eef1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:34.032747 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22a5bc-a30d-4e80-9865-92adc8eef1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:34.032747 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22a5bc-a30d-4e80-9865-92adc8eef1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:34.032747 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22a5bc-a30d-4e80-9865-92adc8eef1a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:34.032747 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d22a5bc-a30d-4e80-9865-92adc8eef1a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:34.032747 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d22a5bc-a30d-4e80-9865-92adc8eef1a4 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:34.046506 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1257/2482] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:18:34.051125 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f28fe-e8a1-4ffd-a2c2-288308a6b6f8 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:34.062726 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f28fe-e8a1-4ffd-a2c2-288308a6b6f8 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:34.070239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebdf4f-74dd-4e1e-b68c-003999d97767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:34.070239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebdf4f-74dd-4e1e-b68c-003999d97767 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:34.070502 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebdf4f-74dd-4e1e-b68c-003999d97767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:34.070765 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebdf4f-74dd-4e1e-b68c-003999d97767 admin admin] PATH_INFO: `/v3/projects/9ef4ff4d3baf4cf69d37f6b574cb90a3/users/5749741da5a2420094d03856871c45ef/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:34.088300 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ebdf4f-74dd-4e1e-b68c-003999d97767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ef4ff4d3baf4cf69d37f6b574cb90a3, user_id=5749741da5a2420094d03856871c45ef, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:34.090916 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ebdf4f-74dd-4e1e-b68c-003999d97767 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:34.203067 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1226/2483] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:18:34 2022] PUT /identity/v3/projects/9ef4ff4d3baf4cf69d37f6b574cb90a3/users/5749741da5a2420094d03856871c45ef/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:34.208905 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54cc43-3b4b-4552-90ad-2e9e971acb2f None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:34.210417 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54cc43-3b4b-4552-90ad-2e9e971acb2f None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:34.210962 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54cc43-3b4b-4552-90ad-2e9e971acb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:34.236080 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-db54cc43-3b4b-4552-90ad-2e9e971acb2f None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:34.237591 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-db54cc43-3b4b-4552-90ad-2e9e971acb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:34.375941 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1258/2484] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:34.386121 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebdf4f-74dd-4e1e-b68c-003999d97767 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:34.388944 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-b5ebdf4f-74dd-4e1e-b68c-003999d97767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:34.500757 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebdf4f-74dd-4e1e-b68c-003999d97767 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:34.505137 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e1b280-73af-4f37-ae21-da0a6e1aa6c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:34.505782 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1b280-73af-4f37-ae21-da0a6e1aa6c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:34.506133 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1b280-73af-4f37-ae21-da0a6e1aa6c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:34.506915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1b280-73af-4f37-ae21-da0a6e1aa6c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:34.517236 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e1b280-73af-4f37-ae21-da0a6e1aa6c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:34.518670 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e1b280-73af-4f37-ae21-da0a6e1aa6c8 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:34.529328 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1227/2485] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:18:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:18:36.175458 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54cc43-3b4b-4552-90ad-2e9e971acb2f None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:36.178969 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-db54cc43-3b4b-4552-90ad-2e9e971acb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:36.206082 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54cc43-3b4b-4552-90ad-2e9e971acb2f None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:36.213525 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca7095-e7fa-43f7-90db-5a4a70ceac73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:36.214548 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca7095-e7fa-43f7-90db-5a4a70ceac73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:36.215342 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca7095-e7fa-43f7-90db-5a4a70ceac73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:36.215839 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca7095-e7fa-43f7-90db-5a4a70ceac73 admin admin] PATH_INFO: `/v3/users/45e1888288484e32b68c51416116f3a2` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:36.217384 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca7095-e7fa-43f7-90db-5a4a70ceac73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45e1888288484e32b68c51416116f3a2)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:36.219863 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca7095-e7fa-43f7-90db-5a4a70ceac73 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:36.477901 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3bbb1-bdc6-427d-b887-7d4f3b60fb0d None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:36.479375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3bbb1-bdc6-427d-b887-7d4f3b60fb0d None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:36.479778 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3bbb1-bdc6-427d-b887-7d4f3b60fb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:36.541355 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-97c3bbb1-bdc6-427d-b887-7d4f3b60fb0d None None] MFA Rules not processed for user `5749741da5a2420094d03856871c45ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:36.542951 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-97c3bbb1-bdc6-427d-b887-7d4f3b60fb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:36.558439 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:36.578287 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-74ca7095-e7fa-43f7-90db-5a4a70ceac73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45e1888288484e32b68c51416116f3a2'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:36.642969 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-74ca7095-e7fa-43f7-90db-5a4a70ceac73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45e1888288484e32b68c51416116f3a2'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:36.664659 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-74ca7095-e7fa-43f7-90db-5a4a70ceac73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45e1888288484e32b68c51416116f3a2'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:36.665756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-74ca7095-e7fa-43f7-90db-5a4a70ceac73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45e1888288484e32b68c51416116f3a2'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:36.666616 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-74ca7095-e7fa-43f7-90db-5a4a70ceac73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45e1888288484e32b68c51416116f3a2'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:36.710537 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1259/2486] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:18:36 2022] DELETE /identity/v3/users/45e1888288484e32b68c51416116f3a2 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:36.713698 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ce0a4-7482-422a-95b7-3f46d6458098 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:36.715204 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ce0a4-7482-422a-95b7-3f46d6458098 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:36.715789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ce0a4-7482-422a-95b7-3f46d6458098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:36.720553 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1228/2487] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:36 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:36.722242 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3bbb1-bdc6-427d-b887-7d4f3b60fb0d None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:36.731648 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-97c3bbb1-bdc6-427d-b887-7d4f3b60fb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:36.748509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3bbb1-bdc6-427d-b887-7d4f3b60fb0d None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:36.773943 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-de9ce0a4-7482-422a-95b7-3f46d6458098 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:36.779972 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-de9ce0a4-7482-422a-95b7-3f46d6458098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:36.795886 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:36.840637 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facfcde7-d6f1-4951-ae62-f4bba206f712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:36.841515 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfcde7-d6f1-4951-ae62-f4bba206f712 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:36.841982 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfcde7-d6f1-4951-ae62-f4bba206f712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:36.842425 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfcde7-d6f1-4951-ae62-f4bba206f712 admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:36.843276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facfcde7-d6f1-4951-ae62-f4bba206f712 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:36.845631 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facfcde7-d6f1-4951-ae62-f4bba206f712 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:36.991989 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1229/2488] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:18:36 2022] POST /identity/v3/projects => generated 403 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:36.993820 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facfcde7-d6f1-4951-ae62-f4bba206f712 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:37.057562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1260/2489] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:37.093265 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ce0a4-7482-422a-95b7-3f46d6458098 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:37.095868 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-de9ce0a4-7482-422a-95b7-3f46d6458098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:37.185016 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facfcde7-d6f1-4951-ae62-f4bba206f712 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:37.191796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26499634-031e-4ec2-a78d-f8c9a2f1065d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:37.192802 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26499634-031e-4ec2-a78d-f8c9a2f1065d admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:37.194699 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26499634-031e-4ec2-a78d-f8c9a2f1065d admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:37.195260 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26499634-031e-4ec2-a78d-f8c9a2f1065d admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:37.196495 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26499634-031e-4ec2-a78d-f8c9a2f1065d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:37.200743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26499634-031e-4ec2-a78d-f8c9a2f1065d admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:37.297563 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ce0a4-7482-422a-95b7-3f46d6458098 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:37.342616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1230/2490] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:18:36 2022] POST /identity/v3/users => generated 308 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:37.346983 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26499634-031e-4ec2-a78d-f8c9a2f1065d admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:37.375661 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26499634-031e-4ec2-a78d-f8c9a2f1065d admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:37.383398 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d735cc4-d2ad-4423-aa59-42c2375e527f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:37.384244 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d735cc4-d2ad-4423-aa59-42c2375e527f admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:37.384567 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d735cc4-d2ad-4423-aa59-42c2375e527f admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:37.384871 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d735cc4-d2ad-4423-aa59-42c2375e527f admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:37.385816 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d735cc4-d2ad-4423-aa59-42c2375e527f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:37.388087 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d735cc4-d2ad-4423-aa59-42c2375e527f admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:37.404213 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1231/2491] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:18:37.410003 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d735cc4-d2ad-4423-aa59-42c2375e527f admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:37.444121 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d735cc4-d2ad-4423-aa59-42c2375e527f admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:37.450915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5248a0-fde1-4129-bc76-77a9f5e71320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:37.457849 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5248a0-fde1-4129-bc76-77a9f5e71320 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:37.457849 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5248a0-fde1-4129-bc76-77a9f5e71320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:37.457849 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5248a0-fde1-4129-bc76-77a9f5e71320 admin admin] PATH_INFO: `/v3/projects/f862e8b2b5dc42bc9ea59f81a845596e/users/162e65199d1b431ab694dc0213aecd7c/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:37.460635 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f56bd-f2c6-43e2-a6d1-b5d75540ca1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:37.460635 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f56bd-f2c6-43e2-a6d1-b5d75540ca1b service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:37.460635 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f56bd-f2c6-43e2-a6d1-b5d75540ca1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:37.460635 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f56bd-f2c6-43e2-a6d1-b5d75540ca1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:37.483681 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5248a0-fde1-4129-bc76-77a9f5e71320 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f862e8b2b5dc42bc9ea59f81a845596e, user_id=162e65199d1b431ab694dc0213aecd7c, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:37.486608 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5248a0-fde1-4129-bc76-77a9f5e71320 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:37.508845 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f56bd-f2c6-43e2-a6d1-b5d75540ca1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:37.508845 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f56bd-f2c6-43e2-a6d1-b5d75540ca1b service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:37.524258 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1261/2492] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:18:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:18:37.577295 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1232/2493] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:18:37 2022] PUT /identity/v3/projects/f862e8b2b5dc42bc9ea59f81a845596e/users/162e65199d1b431ab694dc0213aecd7c/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:37.581072 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f56bd-f2c6-43e2-a6d1-b5d75540ca1b service neutron] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:37.593721 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f56bd-f2c6-43e2-a6d1-b5d75540ca1b service neutron] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:37.660730 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:37.696062 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db8332-cdb1-46f7-b3d7-fced0b3bf908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:37.696981 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db8332-cdb1-46f7-b3d7-fced0b3bf908 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:37.702183 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db8332-cdb1-46f7-b3d7-fced0b3bf908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:37.702183 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db8332-cdb1-46f7-b3d7-fced0b3bf908 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:37.702183 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db8332-cdb1-46f7-b3d7-fced0b3bf908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:37.702183 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db8332-cdb1-46f7-b3d7-fced0b3bf908 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:37.716117 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1262/2494] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:18:37.721669 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5248a0-fde1-4129-bc76-77a9f5e71320 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:37.736637 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5248a0-fde1-4129-bc76-77a9f5e71320 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:37.743975 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0599c4-7837-42de-84f5-28398e1c5574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:37.753824 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0599c4-7837-42de-84f5-28398e1c5574 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:37.753824 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0599c4-7837-42de-84f5-28398e1c5574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:37.753824 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0599c4-7837-42de-84f5-28398e1c5574 admin admin] PATH_INFO: `/v3/projects/f862e8b2b5dc42bc9ea59f81a845596e/users/162e65199d1b431ab694dc0213aecd7c/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:37.753824 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0599c4-7837-42de-84f5-28398e1c5574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f862e8b2b5dc42bc9ea59f81a845596e, user_id=162e65199d1b431ab694dc0213aecd7c, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:37.753824 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0599c4-7837-42de-84f5-28398e1c5574 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:37.777729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1233/2495] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:18:37 2022] PUT /identity/v3/projects/f862e8b2b5dc42bc9ea59f81a845596e/users/162e65199d1b431ab694dc0213aecd7c/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:38.710376 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db8332-cdb1-46f7-b3d7-fced0b3bf908 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:38.712544 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-07db8332-cdb1-46f7-b3d7-fced0b3bf908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:38.769201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db8332-cdb1-46f7-b3d7-fced0b3bf908 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:38.800755 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:38.919809 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad64ae7-184c-46db-9dbe-32b540ecd90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:38.922650 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad64ae7-184c-46db-9dbe-32b540ecd90b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:38.923776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad64ae7-184c-46db-9dbe-32b540ecd90b admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:38.924632 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad64ae7-184c-46db-9dbe-32b540ecd90b admin admin] PATH_INFO: `/v3/projects/74f98da96c354a67a3a50b77240f83f6` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:38.927547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad64ae7-184c-46db-9dbe-32b540ecd90b admin admin] RBAC: Authorizing `identity:delete_project(project_id=74f98da96c354a67a3a50b77240f83f6)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:38.932715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad64ae7-184c-46db-9dbe-32b540ecd90b admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:39.214805 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-3ad64ae7-184c-46db-9dbe-32b540ecd90b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74f98da96c354a67a3a50b77240f83f6', 'request_id': 'req-3ad64ae7-184c-46db-9dbe-32b540ecd90b'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:39.328932 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-3ad64ae7-184c-46db-9dbe-32b540ecd90b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74f98da96c354a67a3a50b77240f83f6', 'request_id': 'req-3ad64ae7-184c-46db-9dbe-32b540ecd90b'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:39.336427 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-3ad64ae7-184c-46db-9dbe-32b540ecd90b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74f98da96c354a67a3a50b77240f83f6', 'request_id': 'req-3ad64ae7-184c-46db-9dbe-32b540ecd90b'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:39.355597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-3ad64ae7-184c-46db-9dbe-32b540ecd90b admin admin] The token cache is being invalidate because project 74f98da96c354a67a3a50b77240f83f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:18:39.356100 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-3ad64ae7-184c-46db-9dbe-32b540ecd90b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:39.356879 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-3ad64ae7-184c-46db-9dbe-32b540ecd90b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:39.363685 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1263/2496] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:18:38 2022] DELETE /identity/v3/projects/74f98da96c354a67a3a50b77240f83f6 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:39.365817 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83da8af-c9e8-489c-8efc-fd1d7d2af22d None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:39.366507 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83da8af-c9e8-489c-8efc-fd1d7d2af22d None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:39.366771 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83da8af-c9e8-489c-8efc-fd1d7d2af22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:39.406504 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-f83da8af-c9e8-489c-8efc-fd1d7d2af22d None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:39.409039 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-f83da8af-c9e8-489c-8efc-fd1d7d2af22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:39.581198 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1234/2497] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:39.602085 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d3bad-a7cb-4cf8-91e1-3a5bb461dc92 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:39.602487 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d3bad-a7cb-4cf8-91e1-3a5bb461dc92 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:39.602924 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d3bad-a7cb-4cf8-91e1-3a5bb461dc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:39.639855 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-bd8d3bad-a7cb-4cf8-91e1-3a5bb461dc92 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:39.642136 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-bd8d3bad-a7cb-4cf8-91e1-3a5bb461dc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:39.655261 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1264/2498] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:18:39.662073 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83da8af-c9e8-489c-8efc-fd1d7d2af22d None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:39.682262 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83da8af-c9e8-489c-8efc-fd1d7d2af22d None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:39.692549 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c7f1c-7707-43c2-b449-23988d1c2a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:39.695467 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c7f1c-7707-43c2-b449-23988d1c2a56 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:39.696291 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c7f1c-7707-43c2-b449-23988d1c2a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:39.696745 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c7f1c-7707-43c2-b449-23988d1c2a56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:39.698592 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c7f1c-7707-43c2-b449-23988d1c2a56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:18:39.699430 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c7f1c-7707-43c2-b449-23988d1c2a56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:39.729117 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c7f1c-7707-43c2-b449-23988d1c2a56 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:39.752033 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1235/2499] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:18:39.755661 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d3bad-a7cb-4cf8-91e1-3a5bb461dc92 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:39.769518 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d3bad-a7cb-4cf8-91e1-3a5bb461dc92 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:39.777882 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf676a75-4bc3-418e-a6e7-9e09626e922c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:39.779157 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf676a75-4bc3-418e-a6e7-9e09626e922c admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:39.779157 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf676a75-4bc3-418e-a6e7-9e09626e922c admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:39.779157 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf676a75-4bc3-418e-a6e7-9e09626e922c admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:39.779847 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf676a75-4bc3-418e-a6e7-9e09626e922c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:39.782154 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf676a75-4bc3-418e-a6e7-9e09626e922c admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:39.897503 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c7f1c-7707-43c2-b449-23988d1c2a56 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:39.900746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-118c7f1c-7707-43c2-b449-23988d1c2a56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:40.031404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c7f1c-7707-43c2-b449-23988d1c2a56 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:40.033198 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04d20c-a6fc-4cd9-9972-4d60dd7e9eda service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cac76aa21415d8ab0a2524a7049d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:40.033848 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04d20c-a6fc-4cd9-9972-4d60dd7e9eda service placement] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:40.034130 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04d20c-a6fc-4cd9-9972-4d60dd7e9eda service placement] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:40.034405 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04d20c-a6fc-4cd9-9972-4d60dd7e9eda service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:40.036406 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-4e04d20c-a6fc-4cd9-9972-4d60dd7e9eda service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:40.050869 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e04d20c-a6fc-4cd9-9972-4d60dd7e9eda service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:40.054542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e04d20c-a6fc-4cd9-9972-4d60dd7e9eda service placement] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:40.070943 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1265/2500] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:18:39 2022] POST /identity/v3/projects => generated 363 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:40.073367 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf676a75-4bc3-418e-a6e7-9e09626e922c admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:40.076435 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1236/2501] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:18:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:18:40.114762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04d20c-a6fc-4cd9-9972-4d60dd7e9eda service placement] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:40.114762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-4e04d20c-a6fc-4cd9-9972-4d60dd7e9eda service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:40.147004 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04d20c-a6fc-4cd9-9972-4d60dd7e9eda service placement] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:40.314869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf676a75-4bc3-418e-a6e7-9e09626e922c admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:40.314869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c25be-96a7-4b68-9b3e-c213d932da2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:40.314869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c25be-96a7-4b68-9b3e-c213d932da2b admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:40.314869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c25be-96a7-4b68-9b3e-c213d932da2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:40.316653 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c25be-96a7-4b68-9b3e-c213d932da2b admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:40.316653 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c25be-96a7-4b68-9b3e-c213d932da2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:40.316653 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c25be-96a7-4b68-9b3e-c213d932da2b admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:40.317545 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:40.317545 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff565307-64ec-44dc-a514-b4a52494062c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:40.317545 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff565307-64ec-44dc-a514-b4a52494062c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:40.317545 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff565307-64ec-44dc-a514-b4a52494062c admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:40.318742 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff565307-64ec-44dc-a514-b4a52494062c admin admin] PATH_INFO: `/v3/users/75559881115047eeb72554769404ed0a` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:40.318742 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff565307-64ec-44dc-a514-b4a52494062c admin admin] RBAC: Authorizing `identity:delete_user(user_id=75559881115047eeb72554769404ed0a)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:40.318742 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff565307-64ec-44dc-a514-b4a52494062c admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:40.419993 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:40.427325 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1266/2502] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:18:40 2022] POST /identity/v3/users => generated 282 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:40.429493 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c25be-96a7-4b68-9b3e-c213d932da2b admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:40.431317 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-b23c25be-96a7-4b68-9b3e-c213d932da2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:40.449868 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c25be-96a7-4b68-9b3e-c213d932da2b admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:40.454838 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8f2db-e5d7-49dc-90a7-0f87c781a843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:40.455499 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8f2db-e5d7-49dc-90a7-0f87c781a843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:40.455795 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8f2db-e5d7-49dc-90a7-0f87c781a843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:40.456237 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8f2db-e5d7-49dc-90a7-0f87c781a843 admin admin] PATH_INFO: `/v3/users/3bccd348dd13473e82ca33c42b840383` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:40.458085 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8f2db-e5d7-49dc-90a7-0f87c781a843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bccd348dd13473e82ca33c42b840383)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:40.460087 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8f2db-e5d7-49dc-90a7-0f87c781a843 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:40.524906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-ff565307-64ec-44dc-a514-b4a52494062c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75559881115047eeb72554769404ed0a'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:40.534404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-ff565307-64ec-44dc-a514-b4a52494062c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75559881115047eeb72554769404ed0a'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:40.535313 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-ff565307-64ec-44dc-a514-b4a52494062c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75559881115047eeb72554769404ed0a'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:40.614085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-ff565307-64ec-44dc-a514-b4a52494062c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75559881115047eeb72554769404ed0a'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:40.635871 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-ff565307-64ec-44dc-a514-b4a52494062c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75559881115047eeb72554769404ed0a'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:40.642887 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1237/2503] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:18:40 2022] DELETE /identity/v3/users/75559881115047eeb72554769404ed0a => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:40.644559 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff565307-64ec-44dc-a514-b4a52494062c admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:40.648870 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-ff565307-64ec-44dc-a514-b4a52494062c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:40.713416 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-b5f8f2db-e5d7-49dc-90a7-0f87c781a843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bccd348dd13473e82ca33c42b840383'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:40.798738 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff565307-64ec-44dc-a514-b4a52494062c admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:40.804752 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d601c7b-5fdb-4a76-a4a2-69d0a6c3d684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:40.805423 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d601c7b-5fdb-4a76-a4a2-69d0a6c3d684 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:40.805713 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d601c7b-5fdb-4a76-a4a2-69d0a6c3d684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:40.806214 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d601c7b-5fdb-4a76-a4a2-69d0a6c3d684 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:40.807062 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d601c7b-5fdb-4a76-a4a2-69d0a6c3d684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:40.809041 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d601c7b-5fdb-4a76-a4a2-69d0a6c3d684 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:40.829154 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1238/2504] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:18:40.829437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-b5f8f2db-e5d7-49dc-90a7-0f87c781a843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bccd348dd13473e82ca33c42b840383'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:40.833057 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d601c7b-5fdb-4a76-a4a2-69d0a6c3d684 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:40.846796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-b5f8f2db-e5d7-49dc-90a7-0f87c781a843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bccd348dd13473e82ca33c42b840383'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:40.848557 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-b5f8f2db-e5d7-49dc-90a7-0f87c781a843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bccd348dd13473e82ca33c42b840383'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:40.852285 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-b5f8f2db-e5d7-49dc-90a7-0f87c781a843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bccd348dd13473e82ca33c42b840383'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:40.856616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d601c7b-5fdb-4a76-a4a2-69d0a6c3d684 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:40.873446 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c479e7f-03c1-421a-9f3b-a32578da72e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:40.874013 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c479e7f-03c1-421a-9f3b-a32578da72e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:40.874642 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c479e7f-03c1-421a-9f3b-a32578da72e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:40.875032 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c479e7f-03c1-421a-9f3b-a32578da72e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:40.876506 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c479e7f-03c1-421a-9f3b-a32578da72e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:40.877841 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c479e7f-03c1-421a-9f3b-a32578da72e4 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:40.891528 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1267/2505] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:18:40 2022] DELETE /identity/v3/users/3bccd348dd13473e82ca33c42b840383 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:40.898009 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1239/2506] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:18:40.900505 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8f2db-e5d7-49dc-90a7-0f87c781a843 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:40.903708 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-b5f8f2db-e5d7-49dc-90a7-0f87c781a843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:40.915435 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f626ca-691b-46d4-942d-dd6d4f1c2f8d None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:40.915957 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f626ca-691b-46d4-942d-dd6d4f1c2f8d None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:40.916475 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f626ca-691b-46d4-942d-dd6d4f1c2f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:40.999079 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-75f626ca-691b-46d4-942d-dd6d4f1c2f8d None None] MFA Rules not processed for user `162e65199d1b431ab694dc0213aecd7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:41.001623 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-75f626ca-691b-46d4-942d-dd6d4f1c2f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:41.152140 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8f2db-e5d7-49dc-90a7-0f87c781a843 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:41.173471 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9b09a-792e-4b6a-8eac-6a6758997f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:41.173471 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9b09a-792e-4b6a-8eac-6a6758997f3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:41.173844 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9b09a-792e-4b6a-8eac-6a6758997f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:41.174093 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9b09a-792e-4b6a-8eac-6a6758997f3f admin admin] PATH_INFO: `/v3/projects/bbb1108563534e93a3eab1f27615e2bc/users/7536380242c44ddfb894c24d48555297/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:41.200042 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9b09a-792e-4b6a-8eac-6a6758997f3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb1108563534e93a3eab1f27615e2bc, user_id=7536380242c44ddfb894c24d48555297, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:41.205448 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9b09a-792e-4b6a-8eac-6a6758997f3f admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:41.225249 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:41.249363 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1240/2507] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:40 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:18:41.251248 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f626ca-691b-46d4-942d-dd6d4f1c2f8d None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:41.258561 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-75f626ca-691b-46d4-942d-dd6d4f1c2f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:41.280841 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f626ca-691b-46d4-942d-dd6d4f1c2f8d None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:41.287544 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b473e98-b0dc-416a-a818-ed75a920c4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:41.288849 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b473e98-b0dc-416a-a818-ed75a920c4b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:41.290202 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b473e98-b0dc-416a-a818-ed75a920c4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:41.290750 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b473e98-b0dc-416a-a818-ed75a920c4b2 admin admin] PATH_INFO: `/v3/projects/ebb47864b5694d2e85b1d90eb2c809bc` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:41.293162 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b473e98-b0dc-416a-a818-ed75a920c4b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebb47864b5694d2e85b1d90eb2c809bc)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:41.296918 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b473e98-b0dc-416a-a818-ed75a920c4b2 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:41.347691 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1268/2508] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:18:40 2022] PUT /identity/v3/projects/bbb1108563534e93a3eab1f27615e2bc/users/7536380242c44ddfb894c24d48555297/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:41.349129 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9b09a-792e-4b6a-8eac-6a6758997f3f admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:41.362423 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-24e9b09a-792e-4b6a-8eac-6a6758997f3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:41.464402 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-9b473e98-b0dc-416a-a818-ed75a920c4b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebb47864b5694d2e85b1d90eb2c809bc', 'request_id': 'req-9b473e98-b0dc-416a-a818-ed75a920c4b2'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:41.474406 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-9b473e98-b0dc-416a-a818-ed75a920c4b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebb47864b5694d2e85b1d90eb2c809bc', 'request_id': 'req-9b473e98-b0dc-416a-a818-ed75a920c4b2'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:41.485808 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-9b473e98-b0dc-416a-a818-ed75a920c4b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebb47864b5694d2e85b1d90eb2c809bc', 'request_id': 'req-9b473e98-b0dc-416a-a818-ed75a920c4b2'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:41.489213 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9b09a-792e-4b6a-8eac-6a6758997f3f admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:41.549615 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-9b473e98-b0dc-416a-a818-ed75a920c4b2 admin admin] The token cache is being invalidate because project ebb47864b5694d2e85b1d90eb2c809bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:18:41.550713 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-9b473e98-b0dc-416a-a818-ed75a920c4b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:41.551811 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-9b473e98-b0dc-416a-a818-ed75a920c4b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:41.555184 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1241/2509] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:18:41 2022] DELETE /identity/v3/projects/ebb47864b5694d2e85b1d90eb2c809bc => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:41.560351 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d1705-fb6e-43cd-ace7-f55183a21346 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:41.560638 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d1705-fb6e-43cd-ace7-f55183a21346 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:41.561093 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d1705-fb6e-43cd-ace7-f55183a21346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:41.588304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6f3cc-192c-47a7-8be5-1ee2c34005cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:41.589004 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6f3cc-192c-47a7-8be5-1ee2c34005cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:41.589445 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6f3cc-192c-47a7-8be5-1ee2c34005cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:41.589847 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6f3cc-192c-47a7-8be5-1ee2c34005cb admin admin] PATH_INFO: `/v3/projects/696f75fb6c494cfab9deb3d36c3ad599` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:41.591459 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6f3cc-192c-47a7-8be5-1ee2c34005cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=696f75fb6c494cfab9deb3d36c3ad599)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:41.594028 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6f3cc-192c-47a7-8be5-1ee2c34005cb admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:41.608482 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:41.609782 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-4e2d1705-fb6e-43cd-ace7-f55183a21346 None None] MFA Rules not processed for user `7536380242c44ddfb894c24d48555297`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:41.611974 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-4e2d1705-fb6e-43cd-ace7-f55183a21346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:41.718967 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1242/2510] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:41.723191 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d1705-fb6e-43cd-ace7-f55183a21346 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:41.725188 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-4e2d1705-fb6e-43cd-ace7-f55183a21346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:41.734776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-90e6f3cc-192c-47a7-8be5-1ee2c34005cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '696f75fb6c494cfab9deb3d36c3ad599', 'request_id': 'req-90e6f3cc-192c-47a7-8be5-1ee2c34005cb'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:41.750402 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d1705-fb6e-43cd-ace7-f55183a21346 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:41.840424 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129da0e8-497c-4464-9418-0962ad42cc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:41.841416 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129da0e8-497c-4464-9418-0962ad42cc42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:41.841824 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129da0e8-497c-4464-9418-0962ad42cc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:41.842279 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129da0e8-497c-4464-9418-0962ad42cc42 admin admin] PATH_INFO: `/v3/users/6a168d8fd2ad41c999c604dbca97ce80` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:41.843782 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129da0e8-497c-4464-9418-0962ad42cc42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a168d8fd2ad41c999c604dbca97ce80)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:41.845811 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129da0e8-497c-4464-9418-0962ad42cc42 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:41.848805 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-90e6f3cc-192c-47a7-8be5-1ee2c34005cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '696f75fb6c494cfab9deb3d36c3ad599', 'request_id': 'req-90e6f3cc-192c-47a7-8be5-1ee2c34005cb'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:41.853772 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:41.858133 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-90e6f3cc-192c-47a7-8be5-1ee2c34005cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '696f75fb6c494cfab9deb3d36c3ad599', 'request_id': 'req-90e6f3cc-192c-47a7-8be5-1ee2c34005cb'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:41.877350 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-90e6f3cc-192c-47a7-8be5-1ee2c34005cb admin admin] The token cache is being invalidate because project 696f75fb6c494cfab9deb3d36c3ad599 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:18:41.877744 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-90e6f3cc-192c-47a7-8be5-1ee2c34005cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:41.878488 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-90e6f3cc-192c-47a7-8be5-1ee2c34005cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:41.880585 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1269/2511] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:18:41 2022] DELETE /identity/v3/projects/696f75fb6c494cfab9deb3d36c3ad599 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:41.882243 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6f3cc-192c-47a7-8be5-1ee2c34005cb admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:41.883693 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-90e6f3cc-192c-47a7-8be5-1ee2c34005cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:41.905530 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6f3cc-192c-47a7-8be5-1ee2c34005cb admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:41.916115 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19d04c-e2d8-4225-bc1e-3bc96d3591a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:41.917430 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19d04c-e2d8-4225-bc1e-3bc96d3591a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:41.918078 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19d04c-e2d8-4225-bc1e-3bc96d3591a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:41.918692 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19d04c-e2d8-4225-bc1e-3bc96d3591a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:41.920218 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19d04c-e2d8-4225-bc1e-3bc96d3591a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:41.924696 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19d04c-e2d8-4225-bc1e-3bc96d3591a7 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:42.117662 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1270/2512] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:18:41 2022] POST /identity/v3/projects => generated 367 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:42.119758 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89759f35-540d-417e-a63e-495008539764 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:42.120220 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89759f35-540d-417e-a63e-495008539764 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:42.120748 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89759f35-540d-417e-a63e-495008539764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:42.156796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-89759f35-540d-417e-a63e-495008539764 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:42.157855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-129da0e8-497c-4464-9418-0962ad42cc42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a168d8fd2ad41c999c604dbca97ce80'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:42.159043 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-89759f35-540d-417e-a63e-495008539764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:42.190910 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-129da0e8-497c-4464-9418-0962ad42cc42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a168d8fd2ad41c999c604dbca97ce80'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:42.190910 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-129da0e8-497c-4464-9418-0962ad42cc42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a168d8fd2ad41c999c604dbca97ce80'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:42.272595 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1271/2513] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:42.274389 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89759f35-540d-417e-a63e-495008539764 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:42.281251 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-89759f35-540d-417e-a63e-495008539764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:42.282617 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-129da0e8-497c-4464-9418-0962ad42cc42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a168d8fd2ad41c999c604dbca97ce80'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:42.303775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-129da0e8-497c-4464-9418-0962ad42cc42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a168d8fd2ad41c999c604dbca97ce80'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:42.313511 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89759f35-540d-417e-a63e-495008539764 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:42.314538 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1243/2514] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:18:41 2022] DELETE /identity/v3/users/6a168d8fd2ad41c999c604dbca97ce80 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:42.316389 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fe58e-4cc0-4902-a273-05af8ddb1e1f None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:42.316834 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fe58e-4cc0-4902-a273-05af8ddb1e1f None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:42.317266 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fe58e-4cc0-4902-a273-05af8ddb1e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:42.325748 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:42.370212 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-a66fe58e-4cc0-4902-a273-05af8ddb1e1f None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:42.373985 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-a66fe58e-4cc0-4902-a273-05af8ddb1e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:42.446343 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2214a18-438c-4ec3-95e3-de93ac931654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:42.449185 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2214a18-438c-4ec3-95e3-de93ac931654 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:42.449723 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2214a18-438c-4ec3-95e3-de93ac931654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:42.450264 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2214a18-438c-4ec3-95e3-de93ac931654 admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:42.451506 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2214a18-438c-4ec3-95e3-de93ac931654 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:42.455910 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2214a18-438c-4ec3-95e3-de93ac931654 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:42.501793 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1244/2515] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:42.503496 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fe58e-4cc0-4902-a273-05af8ddb1e1f None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:42.523842 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fe58e-4cc0-4902-a273-05af8ddb1e1f None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:42.532008 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa809048-4135-4be0-9871-505f8318a4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:42.533385 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa809048-4135-4be0-9871-505f8318a4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:42.533892 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa809048-4135-4be0-9871-505f8318a4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:42.534474 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa809048-4135-4be0-9871-505f8318a4b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:42.535702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa809048-4135-4be0-9871-505f8318a4b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:18:42.536231 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa809048-4135-4be0-9871-505f8318a4b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:42.539270 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa809048-4135-4be0-9871-505f8318a4b0 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:42.559564 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1272/2516] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:18:42 2022] POST /identity/v3/users => generated 290 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:42.561289 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2214a18-438c-4ec3-95e3-de93ac931654 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:42.574486 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1245/2517] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:18:42.581791 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2214a18-438c-4ec3-95e3-de93ac931654 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:42.587133 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa809048-4135-4be0-9871-505f8318a4b0 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:42.597412 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51efe8-d3d0-426b-a523-93bc86596001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:42.600711 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51efe8-d3d0-426b-a523-93bc86596001 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:42.604641 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51efe8-d3d0-426b-a523-93bc86596001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:42.605209 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51efe8-d3d0-426b-a523-93bc86596001 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:42.606499 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51efe8-d3d0-426b-a523-93bc86596001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:42.610961 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51efe8-d3d0-426b-a523-93bc86596001 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:42.622724 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa809048-4135-4be0-9871-505f8318a4b0 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:42.633366 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fda194-3263-427f-9cf4-f8c31c7525c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:42.634554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fda194-3263-427f-9cf4-f8c31c7525c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:42.635136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fda194-3263-427f-9cf4-f8c31c7525c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:42.635634 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fda194-3263-427f-9cf4-f8c31c7525c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:42.636574 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1273/2518] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:18:42.641771 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fda194-3263-427f-9cf4-f8c31c7525c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:42.642248 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fda194-3263-427f-9cf4-f8c31c7525c6 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:42.644923 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51efe8-d3d0-426b-a523-93bc86596001 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:42.671454 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51efe8-d3d0-426b-a523-93bc86596001 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:42.679711 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065533e-7ff8-48de-b3e1-a319fbdc0257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:42.680675 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065533e-7ff8-48de-b3e1-a319fbdc0257 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:42.680956 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065533e-7ff8-48de-b3e1-a319fbdc0257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:42.681244 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065533e-7ff8-48de-b3e1-a319fbdc0257 admin admin] PATH_INFO: `/v3/projects/a34b14b636b74eaf8723b82dfeec77c0/users/51758860de3e4e00a1157a54f7595749/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:42.708604 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065533e-7ff8-48de-b3e1-a319fbdc0257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a34b14b636b74eaf8723b82dfeec77c0, user_id=51758860de3e4e00a1157a54f7595749, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:42.712845 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065533e-7ff8-48de-b3e1-a319fbdc0257 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:42.821777 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1246/2519] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:18:42 2022] POST /identity/v3/projects => generated 367 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:42.821777 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fda194-3263-427f-9cf4-f8c31c7525c6 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:42.823505 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-67fda194-3263-427f-9cf4-f8c31c7525c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:42.858013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1274/2520] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:18:42 2022] PUT /identity/v3/projects/a34b14b636b74eaf8723b82dfeec77c0/users/51758860de3e4e00a1157a54f7595749/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:42.860615 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065533e-7ff8-48de-b3e1-a319fbdc0257 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:42.923457 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:42.991995 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fda194-3263-427f-9cf4-f8c31c7525c6 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:43.081577 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065533e-7ff8-48de-b3e1-a319fbdc0257 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:43.090798 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5957b-e5cf-4428-813d-4052eddbf2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:43.092471 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5957b-e5cf-4428-813d-4052eddbf2eb admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:43.092809 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5957b-e5cf-4428-813d-4052eddbf2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:43.093123 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5957b-e5cf-4428-813d-4052eddbf2eb admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:43.093885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b5957b-e5cf-4428-813d-4052eddbf2eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:43.098881 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b5957b-e5cf-4428-813d-4052eddbf2eb admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:43.170021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92ca59-ddf3-44d3-8a35-75edbb6bc58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:43.171154 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92ca59-ddf3-44d3-8a35-75edbb6bc58e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:43.172021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92ca59-ddf3-44d3-8a35-75edbb6bc58e admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:43.172393 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92ca59-ddf3-44d3-8a35-75edbb6bc58e admin admin] PATH_INFO: `/v3/projects/271cb94f2b0941559c3a9011a2b58969` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:43.175397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92ca59-ddf3-44d3-8a35-75edbb6bc58e admin admin] RBAC: Authorizing `identity:delete_project(project_id=271cb94f2b0941559c3a9011a2b58969)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:43.180475 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92ca59-ddf3-44d3-8a35-75edbb6bc58e admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:43.482493 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1275/2521] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:18:42 2022] POST /identity/v3/users => generated 284 bytes in 623 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:43.484086 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5957b-e5cf-4428-813d-4052eddbf2eb admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:43.501187 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5957b-e5cf-4428-813d-4052eddbf2eb admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:43.508915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5a92ca59-ddf3-44d3-8a35-75edbb6bc58e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '271cb94f2b0941559c3a9011a2b58969', 'request_id': 'req-5a92ca59-ddf3-44d3-8a35-75edbb6bc58e'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:43.519886 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5a92ca59-ddf3-44d3-8a35-75edbb6bc58e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '271cb94f2b0941559c3a9011a2b58969', 'request_id': 'req-5a92ca59-ddf3-44d3-8a35-75edbb6bc58e'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:43.534190 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5a92ca59-ddf3-44d3-8a35-75edbb6bc58e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '271cb94f2b0941559c3a9011a2b58969', 'request_id': 'req-5a92ca59-ddf3-44d3-8a35-75edbb6bc58e'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:43.634625 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:43.635002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5a92ca59-ddf3-44d3-8a35-75edbb6bc58e admin admin] The token cache is being invalidate because project 271cb94f2b0941559c3a9011a2b58969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:18:43.635544 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5a92ca59-ddf3-44d3-8a35-75edbb6bc58e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:43.637582 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5a92ca59-ddf3-44d3-8a35-75edbb6bc58e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:43.640114 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1247/2522] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:18:42 2022] DELETE /identity/v3/projects/271cb94f2b0941559c3a9011a2b58969 => generated 0 bytes in 821 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:43.659688 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92ca59-ddf3-44d3-8a35-75edbb6bc58e admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:43.659688 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-5a92ca59-ddf3-44d3-8a35-75edbb6bc58e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:43.672619 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b946a0-7b33-4b4e-850c-9445d94a10fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:43.675756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b946a0-7b33-4b4e-850c-9445d94a10fe admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:43.676402 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b946a0-7b33-4b4e-850c-9445d94a10fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:43.681148 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b946a0-7b33-4b4e-850c-9445d94a10fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:43.681148 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b946a0-7b33-4b4e-850c-9445d94a10fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:43.682958 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b946a0-7b33-4b4e-850c-9445d94a10fe admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:43.716134 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1276/2523] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:18:43.721250 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b946a0-7b33-4b4e-850c-9445d94a10fe admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:43.724121 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-d6b946a0-7b33-4b4e-850c-9445d94a10fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:43.746590 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b946a0-7b33-4b4e-850c-9445d94a10fe admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:43.748929 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92ca59-ddf3-44d3-8a35-75edbb6bc58e admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:43.757979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2fc99-60b9-4e68-b326-3aa5c828ae30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:43.758693 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2fc99-60b9-4e68-b326-3aa5c828ae30 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:43.759062 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2fc99-60b9-4e68-b326-3aa5c828ae30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:43.759344 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2fc99-60b9-4e68-b326-3aa5c828ae30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:43.764210 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2fc99-60b9-4e68-b326-3aa5c828ae30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:43.764547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82e3c4-cb4a-4168-acb1-d03ea35b4d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:43.764547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82e3c4-cb4a-4168-acb1-d03ea35b4d3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:43.764547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82e3c4-cb4a-4168-acb1-d03ea35b4d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:43.764547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82e3c4-cb4a-4168-acb1-d03ea35b4d3b admin admin] PATH_INFO: `/v3/projects/a34b14b636b74eaf8723b82dfeec77c0/users/51758860de3e4e00a1157a54f7595749/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:43.765111 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2fc99-60b9-4e68-b326-3aa5c828ae30 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:43.769821 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a82e3c4-cb4a-4168-acb1-d03ea35b4d3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a34b14b636b74eaf8723b82dfeec77c0, user_id=51758860de3e4e00a1157a54f7595749, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:43.770456 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a82e3c4-cb4a-4168-acb1-d03ea35b4d3b admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:43.777156 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1248/2524] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:18:43.783643 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2fc99-60b9-4e68-b326-3aa5c828ae30 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:43.792228 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1277/2525] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:18:43 2022] PUT /identity/v3/projects/a34b14b636b74eaf8723b82dfeec77c0/users/51758860de3e4e00a1157a54f7595749/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:43.813288 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d454b94-794d-4726-a6c6-a4f69161069e None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:43.813617 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d454b94-794d-4726-a6c6-a4f69161069e None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:43.814049 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d454b94-794d-4726-a6c6-a4f69161069e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:43.826460 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2fc99-60b9-4e68-b326-3aa5c828ae30 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:43.866157 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:43.873074 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-2d454b94-794d-4726-a6c6-a4f69161069e None None] MFA Rules not processed for user `51758860de3e4e00a1157a54f7595749`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:43.875697 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-2d454b94-794d-4726-a6c6-a4f69161069e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:44.005134 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc5cdd-dfc3-48d5-855e-1c1aeb5fcde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:44.008057 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc5cdd-dfc3-48d5-855e-1c1aeb5fcde7 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:44.008962 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc5cdd-dfc3-48d5-855e-1c1aeb5fcde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:44.009702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc5cdd-dfc3-48d5-855e-1c1aeb5fcde7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:44.010772 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc5cdd-dfc3-48d5-855e-1c1aeb5fcde7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:44.012898 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc5cdd-dfc3-48d5-855e-1c1aeb5fcde7 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:44.018890 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1278/2526] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:18:44.034866 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d454b94-794d-4726-a6c6-a4f69161069e None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:44.036775 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-2d454b94-794d-4726-a6c6-a4f69161069e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:44.043219 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1249/2527] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:18:44.048285 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc5cdd-dfc3-48d5-855e-1c1aeb5fcde7 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:44.062963 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc5cdd-dfc3-48d5-855e-1c1aeb5fcde7 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:44.068909 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450642e-7594-440a-b852-8cf28c9b5992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:44.069568 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450642e-7594-440a-b852-8cf28c9b5992 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:44.069861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450642e-7594-440a-b852-8cf28c9b5992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:44.070139 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450642e-7594-440a-b852-8cf28c9b5992 admin admin] PATH_INFO: `/v3/projects/6712bff228a14535ba096e5b002a0762/users/1a700c0656f9474da10138612772e186/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:44.091979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450642e-7594-440a-b852-8cf28c9b5992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6712bff228a14535ba096e5b002a0762, user_id=1a700c0656f9474da10138612772e186, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:44.095176 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450642e-7594-440a-b852-8cf28c9b5992 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:44.127745 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d454b94-794d-4726-a6c6-a4f69161069e None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:44.134088 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262cefb-4a4b-4440-ab80-da835971af3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:44.140674 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262cefb-4a4b-4440-ab80-da835971af3e service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:44.140674 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262cefb-4a4b-4440-ab80-da835971af3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:44.140674 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262cefb-4a4b-4440-ab80-da835971af3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:44.148781 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3262cefb-4a4b-4440-ab80-da835971af3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:44.150429 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3262cefb-4a4b-4440-ab80-da835971af3e service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:44.165933 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1279/2528] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:18:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:18:44.219759 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1250/2529] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:18:44 2022] PUT /identity/v3/projects/6712bff228a14535ba096e5b002a0762/users/1a700c0656f9474da10138612772e186/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:18:44.239692 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c21ee-67b3-4de2-a369-f6a7c9ba5dc6 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:44.239980 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c21ee-67b3-4de2-a369-f6a7c9ba5dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:44.240836 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c21ee-67b3-4de2-a369-f6a7c9ba5dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:44.298923 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-f73c21ee-67b3-4de2-a369-f6a7c9ba5dc6 None None] MFA Rules not processed for user `1a700c0656f9474da10138612772e186`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:44.304277 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-f73c21ee-67b3-4de2-a369-f6a7c9ba5dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:44.308119 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450642e-7594-440a-b852-8cf28c9b5992 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:44.383577 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450642e-7594-440a-b852-8cf28c9b5992 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:44.388915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbda507-127e-42bc-b653-c28fc72fc686 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:44.389550 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbda507-127e-42bc-b653-c28fc72fc686 service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:44.389833 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbda507-127e-42bc-b653-c28fc72fc686 service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:44.390125 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbda507-127e-42bc-b653-c28fc72fc686 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:44.392137 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-1fbda507-127e-42bc-b653-c28fc72fc686 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:44.431244 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1280/2530] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:44.436181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c21ee-67b3-4de2-a369-f6a7c9ba5dc6 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:44.484998 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbda507-127e-42bc-b653-c28fc72fc686 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:44.484998 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbda507-127e-42bc-b653-c28fc72fc686 service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:44.497899 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1251/2531] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:18:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:18:44.512256 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbda507-127e-42bc-b653-c28fc72fc686 service cinder] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:44.514806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-1fbda507-127e-42bc-b653-c28fc72fc686 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:44.527802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:44.562587 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c21ee-67b3-4de2-a369-f6a7c9ba5dc6 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:44.572523 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbe7e2-f051-458d-ad6f-011036d5b731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:44.573290 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbe7e2-f051-458d-ad6f-011036d5b731 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:44.573683 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbe7e2-f051-458d-ad6f-011036d5b731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:44.574105 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbe7e2-f051-458d-ad6f-011036d5b731 admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:44.575039 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efbe7e2-f051-458d-ad6f-011036d5b731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:44.578400 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efbe7e2-f051-458d-ad6f-011036d5b731 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:44.647848 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbda507-127e-42bc-b653-c28fc72fc686 service cinder] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:44.658181 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fd304-8854-4675-9ad4-721eb87db394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:44.661734 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fd304-8854-4675-9ad4-721eb87db394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:44.661734 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fd304-8854-4675-9ad4-721eb87db394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:44.661734 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fd304-8854-4675-9ad4-721eb87db394 admin admin] PATH_INFO: `/v3/users/5749741da5a2420094d03856871c45ef` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:44.663490 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9fd304-8854-4675-9ad4-721eb87db394 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5749741da5a2420094d03856871c45ef)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:44.666690 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9fd304-8854-4675-9ad4-721eb87db394 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:44.731049 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1281/2532] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:18:44 2022] POST /identity/v3/projects => generated 365 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:18:44.739649 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbe7e2-f051-458d-ad6f-011036d5b731 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:44.846936 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbe7e2-f051-458d-ad6f-011036d5b731 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:44.857073 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f16f8-5b31-42d6-bbb7-984fee8a29b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:44.858337 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f16f8-5b31-42d6-bbb7-984fee8a29b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:44.859001 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f16f8-5b31-42d6-bbb7-984fee8a29b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:44.859591 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f16f8-5b31-42d6-bbb7-984fee8a29b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:44.861374 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f16f8-5b31-42d6-bbb7-984fee8a29b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:44.866754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f16f8-5b31-42d6-bbb7-984fee8a29b3 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:44.983431 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1282/2533] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:18:44 2022] POST /identity/v3/users => generated 289 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:44.989788 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f16f8-5b31-42d6-bbb7-984fee8a29b3 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:44.998500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-ba9fd304-8854-4675-9ad4-721eb87db394 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5749741da5a2420094d03856871c45ef'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:45.008884 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-ba9fd304-8854-4675-9ad4-721eb87db394 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5749741da5a2420094d03856871c45ef'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:45.009852 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-ba9fd304-8854-4675-9ad4-721eb87db394 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5749741da5a2420094d03856871c45ef'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:45.010875 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f16f8-5b31-42d6-bbb7-984fee8a29b3 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:45.018336 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a83e5-6538-47de-9815-96ecb926e190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:45.022165 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a83e5-6538-47de-9815-96ecb926e190 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:45.022165 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a83e5-6538-47de-9815-96ecb926e190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:45.022165 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a83e5-6538-47de-9815-96ecb926e190 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:45.022165 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127a83e5-6538-47de-9815-96ecb926e190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:45.022812 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127a83e5-6538-47de-9815-96ecb926e190 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:45.043091 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1283/2534] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:18:45.047074 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:45.048959 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a83e5-6538-47de-9815-96ecb926e190 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:45.051283 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-127a83e5-6538-47de-9815-96ecb926e190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:45.066466 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a83e5-6538-47de-9815-96ecb926e190 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:45.076876 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e2f56-8787-44b0-9a66-ccd21cebfc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:45.080426 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e2f56-8787-44b0-9a66-ccd21cebfc3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:45.080426 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e2f56-8787-44b0-9a66-ccd21cebfc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:45.080426 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e2f56-8787-44b0-9a66-ccd21cebfc3f admin admin] PATH_INFO: `/v3/projects/02ddaec6d0d64e08883b063d307c57b5/users/9d2ecbc759db4ea48e85658d39f2e0b5/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:45.111695 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e2f56-8787-44b0-9a66-ccd21cebfc3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=02ddaec6d0d64e08883b063d307c57b5, user_id=9d2ecbc759db4ea48e85658d39f2e0b5, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:45.114508 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e2f56-8787-44b0-9a66-ccd21cebfc3f admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:45.139171 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-ba9fd304-8854-4675-9ad4-721eb87db394 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5749741da5a2420094d03856871c45ef'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:45.159042 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-ba9fd304-8854-4675-9ad4-721eb87db394 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5749741da5a2420094d03856871c45ef'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:45.165700 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1252/2535] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:18:44 2022] DELETE /identity/v3/users/5749741da5a2420094d03856871c45ef => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:18:45.213506 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1284/2536] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:18:45 2022] PUT /identity/v3/projects/02ddaec6d0d64e08883b063d307c57b5/users/9d2ecbc759db4ea48e85658d39f2e0b5/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:45.221190 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fd304-8854-4675-9ad4-721eb87db394 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:45.347388 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fd304-8854-4675-9ad4-721eb87db394 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:45.479274 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbc795-065a-4139-b411-68e55e2d4a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:45.480449 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbc795-065a-4139-b411-68e55e2d4a19 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:45.481054 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbc795-065a-4139-b411-68e55e2d4a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:45.481580 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbc795-065a-4139-b411-68e55e2d4a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:45.483157 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fbc795-065a-4139-b411-68e55e2d4a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:45.486270 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fbc795-065a-4139-b411-68e55e2d4a19 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:45.513529 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1253/2537] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:18:45.518027 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e2f56-8787-44b0-9a66-ccd21cebfc3f admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:45.532500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbc795-065a-4139-b411-68e55e2d4a19 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:45.539001 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-53fbc795-065a-4139-b411-68e55e2d4a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:45.542851 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e2f56-8787-44b0-9a66-ccd21cebfc3f admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:45.563354 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc9aaa-165a-4bf8-8a4f-89cb32e2fa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:45.567003 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc9aaa-165a-4bf8-8a4f-89cb32e2fa82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:45.567266 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbc795-065a-4139-b411-68e55e2d4a19 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:45.567797 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc9aaa-165a-4bf8-8a4f-89cb32e2fa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:45.569321 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc9aaa-165a-4bf8-8a4f-89cb32e2fa82 admin admin] PATH_INFO: `/v3/projects/02ddaec6d0d64e08883b063d307c57b5/users/9d2ecbc759db4ea48e85658d39f2e0b5/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:45.580027 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cc9aaa-165a-4bf8-8a4f-89cb32e2fa82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02ddaec6d0d64e08883b063d307c57b5, user_id=9d2ecbc759db4ea48e85658d39f2e0b5, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:45.592814 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cc9aaa-165a-4bf8-8a4f-89cb32e2fa82 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:45.617258 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b192f-384b-43b1-8026-c8357d40804c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:45.618355 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b192f-384b-43b1-8026-c8357d40804c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:45.618534 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b192f-384b-43b1-8026-c8357d40804c admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:45.618815 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b192f-384b-43b1-8026-c8357d40804c admin admin] PATH_INFO: `/v3/projects/9ef4ff4d3baf4cf69d37f6b574cb90a3` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:45.621656 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b192f-384b-43b1-8026-c8357d40804c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ef4ff4d3baf4cf69d37f6b574cb90a3)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:45.624961 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b192f-384b-43b1-8026-c8357d40804c admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:45.641437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1285/2538] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:18:45 2022] PUT /identity/v3/projects/02ddaec6d0d64e08883b063d307c57b5/users/9d2ecbc759db4ea48e85658d39f2e0b5/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:45.643286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:45.649674 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3589cf-e9d8-4e5e-bb1f-61d6ded1a7a5 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:45.650009 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3589cf-e9d8-4e5e-bb1f-61d6ded1a7a5 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:45.650266 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3589cf-e9d8-4e5e-bb1f-61d6ded1a7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:45.689669 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-8c3589cf-e9d8-4e5e-bb1f-61d6ded1a7a5 None None] MFA Rules not processed for user `9d2ecbc759db4ea48e85658d39f2e0b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:45.690958 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-8c3589cf-e9d8-4e5e-bb1f-61d6ded1a7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:45.702335 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:45.810527 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1286/2539] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:45 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:18:45.829399 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-948b192f-384b-43b1-8026-c8357d40804c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ef4ff4d3baf4cf69d37f6b574cb90a3', 'request_id': 'req-948b192f-384b-43b1-8026-c8357d40804c'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:45.833311 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3589cf-e9d8-4e5e-bb1f-61d6ded1a7a5 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:45.836629 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-8c3589cf-e9d8-4e5e-bb1f-61d6ded1a7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:45.839846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-948b192f-384b-43b1-8026-c8357d40804c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ef4ff4d3baf4cf69d37f6b574cb90a3', 'request_id': 'req-948b192f-384b-43b1-8026-c8357d40804c'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:45.853280 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-948b192f-384b-43b1-8026-c8357d40804c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ef4ff4d3baf4cf69d37f6b574cb90a3', 'request_id': 'req-948b192f-384b-43b1-8026-c8357d40804c'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:45.945064 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3589cf-e9d8-4e5e-bb1f-61d6ded1a7a5 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:45.954876 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-948b192f-384b-43b1-8026-c8357d40804c admin admin] The token cache is being invalidate because project 9ef4ff4d3baf4cf69d37f6b574cb90a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:18:45.959814 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-948b192f-384b-43b1-8026-c8357d40804c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:45.959814 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-948b192f-384b-43b1-8026-c8357d40804c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:45.959814 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1254/2540] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:18:45 2022] DELETE /identity/v3/projects/9ef4ff4d3baf4cf69d37f6b574cb90a3 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:45.966495 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b192f-384b-43b1-8026-c8357d40804c admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:45.968628 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-948b192f-384b-43b1-8026-c8357d40804c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:46.034329 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f99e77-d976-4d9e-b5fc-964d65bd054f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:46.035355 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f99e77-d976-4d9e-b5fc-964d65bd054f service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:46.035823 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f99e77-d976-4d9e-b5fc-964d65bd054f service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:46.036335 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f99e77-d976-4d9e-b5fc-964d65bd054f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:46.039947 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-81f99e77-d976-4d9e-b5fc-964d65bd054f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:46.089140 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b192f-384b-43b1-8026-c8357d40804c admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:46.095200 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94efcf-0aef-48fb-981f-b23c1473b723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:46.096093 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94efcf-0aef-48fb-981f-b23c1473b723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:46.096485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94efcf-0aef-48fb-981f-b23c1473b723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:46.096811 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94efcf-0aef-48fb-981f-b23c1473b723 admin admin] PATH_INFO: `/v3/users/162e65199d1b431ab694dc0213aecd7c` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:46.098297 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94efcf-0aef-48fb-981f-b23c1473b723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=162e65199d1b431ab694dc0213aecd7c)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:46.101755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94efcf-0aef-48fb-981f-b23c1473b723 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:46.146650 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f99e77-d976-4d9e-b5fc-964d65bd054f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:46.148630 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f99e77-d976-4d9e-b5fc-964d65bd054f service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:46.159878 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1287/2541] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:18:45 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:18:46.301506 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-ba94efcf-0aef-48fb-981f-b23c1473b723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '162e65199d1b431ab694dc0213aecd7c'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:46.316608 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-ba94efcf-0aef-48fb-981f-b23c1473b723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '162e65199d1b431ab694dc0213aecd7c'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:46.317009 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-ba94efcf-0aef-48fb-981f-b23c1473b723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '162e65199d1b431ab694dc0213aecd7c'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:46.419384 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-ba94efcf-0aef-48fb-981f-b23c1473b723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '162e65199d1b431ab694dc0213aecd7c'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:46.438566 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-ba94efcf-0aef-48fb-981f-b23c1473b723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '162e65199d1b431ab694dc0213aecd7c'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:46.446042 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1255/2542] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:18:45 2022] DELETE /identity/v3/users/162e65199d1b431ab694dc0213aecd7c => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:46.831778 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f99e77-d976-4d9e-b5fc-964d65bd054f service cinder] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:46.844499 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f99e77-d976-4d9e-b5fc-964d65bd054f service cinder] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:46.858680 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=100 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:46.953528 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b058789-49ec-499c-890e-b9fa86c1dcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:46.954622 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b058789-49ec-499c-890e-b9fa86c1dcd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:46.955098 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b058789-49ec-499c-890e-b9fa86c1dcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:46.955526 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b058789-49ec-499c-890e-b9fa86c1dcd0 admin admin] PATH_INFO: `/v3/projects/f862e8b2b5dc42bc9ea59f81a845596e` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:46.957604 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b058789-49ec-499c-890e-b9fa86c1dcd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f862e8b2b5dc42bc9ea59f81a845596e)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:46.961407 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b058789-49ec-499c-890e-b9fa86c1dcd0 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:47.121770 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-6b058789-49ec-499c-890e-b9fa86c1dcd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f862e8b2b5dc42bc9ea59f81a845596e', 'request_id': 'req-6b058789-49ec-499c-890e-b9fa86c1dcd0'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:47.250396 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-6b058789-49ec-499c-890e-b9fa86c1dcd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f862e8b2b5dc42bc9ea59f81a845596e', 'request_id': 'req-6b058789-49ec-499c-890e-b9fa86c1dcd0'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:47.260821 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-6b058789-49ec-499c-890e-b9fa86c1dcd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f862e8b2b5dc42bc9ea59f81a845596e', 'request_id': 'req-6b058789-49ec-499c-890e-b9fa86c1dcd0'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:47.284240 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-6b058789-49ec-499c-890e-b9fa86c1dcd0 admin admin] The token cache is being invalidate because project f862e8b2b5dc42bc9ea59f81a845596e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:18:47.284240 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-6b058789-49ec-499c-890e-b9fa86c1dcd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:47.285400 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-6b058789-49ec-499c-890e-b9fa86c1dcd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:47.287755 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1288/2543] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:18:46 2022] DELETE /identity/v3/projects/f862e8b2b5dc42bc9ea59f81a845596e => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:47.295382 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82989a2-19d4-40d5-9130-404218344013 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:47.297007 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82989a2-19d4-40d5-9130-404218344013 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:47.297542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82989a2-19d4-40d5-9130-404218344013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:47.317479 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:47.344380 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-f82989a2-19d4-40d5-9130-404218344013 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:47.346229 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-f82989a2-19d4-40d5-9130-404218344013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:47.460343 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1256/2544] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:47.471802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499ab55-d97e-405c-9dca-b77cd21a4d80 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:47.472502 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499ab55-d97e-405c-9dca-b77cd21a4d80 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:47.473102 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499ab55-d97e-405c-9dca-b77cd21a4d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:47.508195 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-7499ab55-d97e-405c-9dca-b77cd21a4d80 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:47.509536 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-7499ab55-d97e-405c-9dca-b77cd21a4d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:47.520113 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1289/2545] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:47.525640 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82989a2-19d4-40d5-9130-404218344013 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:47.536130 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82989a2-19d4-40d5-9130-404218344013 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:47.547098 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5252c-44fc-4b2f-8358-def53a1b20c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:47.547945 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5252c-44fc-4b2f-8358-def53a1b20c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:47.548883 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5252c-44fc-4b2f-8358-def53a1b20c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:47.553946 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5252c-44fc-4b2f-8358-def53a1b20c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:47.553946 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5252c-44fc-4b2f-8358-def53a1b20c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:18:47.553946 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5252c-44fc-4b2f-8358-def53a1b20c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:47.553946 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5252c-44fc-4b2f-8358-def53a1b20c4 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:47.573451 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1257/2546] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:18:47.578742 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499ab55-d97e-405c-9dca-b77cd21a4d80 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:47.617274 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499ab55-d97e-405c-9dca-b77cd21a4d80 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:47.626019 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8320642-38a4-4e7e-837f-4b4a205c05bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:47.626676 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8320642-38a4-4e7e-837f-4b4a205c05bc admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:47.626964 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8320642-38a4-4e7e-837f-4b4a205c05bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:47.627239 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8320642-38a4-4e7e-837f-4b4a205c05bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:47.628198 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8320642-38a4-4e7e-837f-4b4a205c05bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:47.630156 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8320642-38a4-4e7e-837f-4b4a205c05bc admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:47.804041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1290/2547] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:18:47 2022] POST /identity/v3/projects => generated 373 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:18:47.805555 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5252c-44fc-4b2f-8358-def53a1b20c4 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:47.821577 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5252c-44fc-4b2f-8358-def53a1b20c4 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:47.916872 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6575dd-c9d5-4bd5-a685-1ea966ddb328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:47.917511 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6575dd-c9d5-4bd5-a685-1ea966ddb328 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:47.917792 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6575dd-c9d5-4bd5-a685-1ea966ddb328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:47.918070 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6575dd-c9d5-4bd5-a685-1ea966ddb328 admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:47.918787 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6575dd-c9d5-4bd5-a685-1ea966ddb328 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:47.920979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6575dd-c9d5-4bd5-a685-1ea966ddb328 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:48.050732 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1258/2548] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:18:47 2022] POST /identity/v3/users => generated 287 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:48.056888 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8320642-38a4-4e7e-837f-4b4a205c05bc admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:48.068596 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8320642-38a4-4e7e-837f-4b4a205c05bc admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:48.076630 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752358f5-7d52-43d0-88bb-5a27cf7ece2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:48.077721 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752358f5-7d52-43d0-88bb-5a27cf7ece2f admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:48.078211 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752358f5-7d52-43d0-88bb-5a27cf7ece2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:48.078717 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752358f5-7d52-43d0-88bb-5a27cf7ece2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:48.080198 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752358f5-7d52-43d0-88bb-5a27cf7ece2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:48.084688 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752358f5-7d52-43d0-88bb-5a27cf7ece2f admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:48.110975 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1291/2549] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:18:48.115300 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6575dd-c9d5-4bd5-a685-1ea966ddb328 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:48.132668 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6575dd-c9d5-4bd5-a685-1ea966ddb328 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:48.138085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f331cb4-940a-44ef-8f6b-74177479ecb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:48.138722 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f331cb4-940a-44ef-8f6b-74177479ecb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:48.138999 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f331cb4-940a-44ef-8f6b-74177479ecb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:48.139266 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f331cb4-940a-44ef-8f6b-74177479ecb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:48.140217 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f331cb4-940a-44ef-8f6b-74177479ecb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:48.141917 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f331cb4-940a-44ef-8f6b-74177479ecb4 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:48.181974 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1259/2550] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:18:48.183439 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752358f5-7d52-43d0-88bb-5a27cf7ece2f admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:48.202307 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752358f5-7d52-43d0-88bb-5a27cf7ece2f admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:48.211828 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2b41c-7c8e-48d6-a6d2-6b2f5f2e656b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:48.213184 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2b41c-7c8e-48d6-a6d2-6b2f5f2e656b admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:48.213762 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2b41c-7c8e-48d6-a6d2-6b2f5f2e656b admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:48.214386 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2b41c-7c8e-48d6-a6d2-6b2f5f2e656b admin admin] PATH_INFO: `/v3/projects/e7bb8126f4f74212b5beffe67630ec47/users/dd12cf90b06e4307807909559a9bbb90/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:48.278637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2b41c-7c8e-48d6-a6d2-6b2f5f2e656b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7bb8126f4f74212b5beffe67630ec47, user_id=dd12cf90b06e4307807909559a9bbb90, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:48.278637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2b41c-7c8e-48d6-a6d2-6b2f5f2e656b admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:48.372509 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1292/2551] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:18:48 2022] PUT /identity/v3/projects/e7bb8126f4f74212b5beffe67630ec47/users/dd12cf90b06e4307807909559a9bbb90/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:18:48.385708 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f4c8b-d84b-44c7-94a9-6ffb47221bff None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:48.386461 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f4c8b-d84b-44c7-94a9-6ffb47221bff None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:48.386661 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f4c8b-d84b-44c7-94a9-6ffb47221bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:48.443861 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-9c0f4c8b-d84b-44c7-94a9-6ffb47221bff None None] MFA Rules not processed for user `dd12cf90b06e4307807909559a9bbb90`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:48.446431 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-9c0f4c8b-d84b-44c7-94a9-6ffb47221bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:48.561578 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:48.571664 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1260/2552] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:48.577897 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2b41c-7c8e-48d6-a6d2-6b2f5f2e656b admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:48.638517 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:48.686934 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2b41c-7c8e-48d6-a6d2-6b2f5f2e656b admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:48.691777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7fd0f-4dff-4dd4-a545-7ea7d91c5708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:48.692812 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7fd0f-4dff-4dd4-a545-7ea7d91c5708 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:48.695634 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7fd0f-4dff-4dd4-a545-7ea7d91c5708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:48.695634 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7fd0f-4dff-4dd4-a545-7ea7d91c5708 admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:48.695634 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7fd0f-4dff-4dd4-a545-7ea7d91c5708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:48.697721 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7fd0f-4dff-4dd4-a545-7ea7d91c5708 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:48.839582 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1293/2553] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:18:48 2022] POST /identity/v3/projects => generated 369 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:48.844994 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f4c8b-d84b-44c7-94a9-6ffb47221bff None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:48.867252 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f4c8b-d84b-44c7-94a9-6ffb47221bff None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:48.992528 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77b9d2-f70d-43b0-a56b-3f2c85b1dcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:48.993566 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77b9d2-f70d-43b0-a56b-3f2c85b1dcad admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:48.994216 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77b9d2-f70d-43b0-a56b-3f2c85b1dcad admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:48.994725 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77b9d2-f70d-43b0-a56b-3f2c85b1dcad admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:48.995933 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77b9d2-f70d-43b0-a56b-3f2c85b1dcad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:48.999745 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77b9d2-f70d-43b0-a56b-3f2c85b1dcad admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:49.134200 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1261/2554] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:18:48 2022] POST /identity/v3/users => generated 291 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:18:49.150399 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7fd0f-4dff-4dd4-a545-7ea7d91c5708 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:49.201217 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7fd0f-4dff-4dd4-a545-7ea7d91c5708 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:49.215711 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea70d6-c3e8-4091-888c-4d31d2fd0f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:49.228930 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea70d6-c3e8-4091-888c-4d31d2fd0f82 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:49.228930 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea70d6-c3e8-4091-888c-4d31d2fd0f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:49.228930 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea70d6-c3e8-4091-888c-4d31d2fd0f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:49.228930 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea70d6-c3e8-4091-888c-4d31d2fd0f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:49.228930 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea70d6-c3e8-4091-888c-4d31d2fd0f82 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:49.261894 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1294/2555] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:18:49.266139 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77b9d2-f70d-43b0-a56b-3f2c85b1dcad admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:49.285965 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77b9d2-f70d-43b0-a56b-3f2c85b1dcad admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:49.292079 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd40e5-f629-4e6d-b059-1ec636ef2c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:49.295345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd40e5-f629-4e6d-b059-1ec636ef2c41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:49.295345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd40e5-f629-4e6d-b059-1ec636ef2c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:49.295765 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd40e5-f629-4e6d-b059-1ec636ef2c41 admin admin] PATH_INFO: `/v3/projects/be183464c8b7442b8350562914328d8f/users/ec3835e764574dc4b0d3cf1af2f29b41/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:49.329410 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd40e5-f629-4e6d-b059-1ec636ef2c41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be183464c8b7442b8350562914328d8f, user_id=ec3835e764574dc4b0d3cf1af2f29b41, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:49.333259 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd40e5-f629-4e6d-b059-1ec636ef2c41 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:49.457979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1262/2556] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:18:49 2022] PUT /identity/v3/projects/be183464c8b7442b8350562914328d8f/users/ec3835e764574dc4b0d3cf1af2f29b41/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:49.461655 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea70d6-c3e8-4091-888c-4d31d2fd0f82 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:49.490619 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea70d6-c3e8-4091-888c-4d31d2fd0f82 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:49.584595 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715e4e4-0959-4243-bc08-e2f9deb2de07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:49.585661 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715e4e4-0959-4243-bc08-e2f9deb2de07 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:49.586025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715e4e4-0959-4243-bc08-e2f9deb2de07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:49.586378 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715e4e4-0959-4243-bc08-e2f9deb2de07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:49.587193 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715e4e4-0959-4243-bc08-e2f9deb2de07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:49.589898 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715e4e4-0959-4243-bc08-e2f9deb2de07 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:49.603877 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1295/2557] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:18:49.611904 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd40e5-f629-4e6d-b059-1ec636ef2c41 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:49.628979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd40e5-f629-4e6d-b059-1ec636ef2c41 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:49.637090 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964631c-0916-4ed2-b865-d5b2a75863ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:49.641918 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964631c-0916-4ed2-b865-d5b2a75863ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:49.641918 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964631c-0916-4ed2-b865-d5b2a75863ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:49.641918 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964631c-0916-4ed2-b865-d5b2a75863ee admin admin] PATH_INFO: `/v3/projects/be183464c8b7442b8350562914328d8f/users/ec3835e764574dc4b0d3cf1af2f29b41/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:49.641918 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964631c-0916-4ed2-b865-d5b2a75863ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=be183464c8b7442b8350562914328d8f, user_id=ec3835e764574dc4b0d3cf1af2f29b41, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:49.647370 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964631c-0916-4ed2-b865-d5b2a75863ee admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:49.666247 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1263/2558] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:18:49 2022] PUT /identity/v3/projects/be183464c8b7442b8350562914328d8f/users/ec3835e764574dc4b0d3cf1af2f29b41/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:49.693092 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80614a5-889e-45fc-bbf2-dc2944902534 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:49.694747 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80614a5-889e-45fc-bbf2-dc2944902534 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:49.694747 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80614a5-889e-45fc-bbf2-dc2944902534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:49.750837 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-e80614a5-889e-45fc-bbf2-dc2944902534 None None] MFA Rules not processed for user `ec3835e764574dc4b0d3cf1af2f29b41`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:49.752928 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-e80614a5-889e-45fc-bbf2-dc2944902534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:49.909937 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1296/2559] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:49 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:49.956154 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964631c-0916-4ed2-b865-d5b2a75863ee admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:49.957936 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-f964631c-0916-4ed2-b865-d5b2a75863ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:50.048389 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964631c-0916-4ed2-b865-d5b2a75863ee admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:50.056323 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b0bce-993a-4f3d-b6e3-17e38ade28e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:50.057412 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b0bce-993a-4f3d-b6e3-17e38ade28e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:50.057906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b0bce-993a-4f3d-b6e3-17e38ade28e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:50.058397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b0bce-993a-4f3d-b6e3-17e38ade28e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:50.078369 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b0bce-993a-4f3d-b6e3-17e38ade28e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:50.080434 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b0bce-993a-4f3d-b6e3-17e38ade28e8 service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:50.100142 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1264/2560] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:18:49 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:18:50.608335 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b04410-c19b-43c2-9f49-ff5e634ad6af None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:50.609146 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b04410-c19b-43c2-9f49-ff5e634ad6af None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:50.609597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b04410-c19b-43c2-9f49-ff5e634ad6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:50.634144 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-34b04410-c19b-43c2-9f49-ff5e634ad6af None None] MFA Rules not processed for user `6cd2f7ae47fd42929ccfaed668c5a55f`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:50.635469 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-34b04410-c19b-43c2-9f49-ff5e634ad6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:50.701658 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:50.743033 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1297/2561] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:51.330508 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b0bce-993a-4f3d-b6e3-17e38ade28e8 service cinder] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:51.333138 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-fc8b0bce-993a-4f3d-b6e3-17e38ade28e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:51.413244 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:51.429146 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b0bce-993a-4f3d-b6e3-17e38ade28e8 service cinder] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:51.434593 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208dc175-2d27-455b-b385-4625e58f0a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:51.435294 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208dc175-2d27-455b-b385-4625e58f0a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:51.435583 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208dc175-2d27-455b-b385-4625e58f0a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:51.435865 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208dc175-2d27-455b-b385-4625e58f0a88 admin admin] PATH_INFO: `/v3/users/1a700c0656f9474da10138612772e186` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:51.437420 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208dc175-2d27-455b-b385-4625e58f0a88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a700c0656f9474da10138612772e186)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:51.439483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208dc175-2d27-455b-b385-4625e58f0a88 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:51.482919 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b04410-c19b-43c2-9f49-ff5e634ad6af None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:51.485427 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-34b04410-c19b-43c2-9f49-ff5e634ad6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:51.566942 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b04410-c19b-43c2-9f49-ff5e634ad6af None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:51.566942 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b07be4-7e15-4728-bded-cefbfb1a2071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:51.566942 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b07be4-7e15-4728-bded-cefbfb1a2071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:51.566942 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b07be4-7e15-4728-bded-cefbfb1a2071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:51.567355 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b07be4-7e15-4728-bded-cefbfb1a2071 admin admin] PATH_INFO: `/v3/users/7536380242c44ddfb894c24d48555297` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:51.567355 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b07be4-7e15-4728-bded-cefbfb1a2071 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7536380242c44ddfb894c24d48555297)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:51.567355 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b07be4-7e15-4728-bded-cefbfb1a2071 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:51.937379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-208dc175-2d27-455b-b385-4625e58f0a88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a700c0656f9474da10138612772e186'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:51.953621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-208dc175-2d27-455b-b385-4625e58f0a88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a700c0656f9474da10138612772e186'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:51.959286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-208dc175-2d27-455b-b385-4625e58f0a88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a700c0656f9474da10138612772e186'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:51.976913 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-23b07be4-7e15-4728-bded-cefbfb1a2071 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7536380242c44ddfb894c24d48555297'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:52.104917 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-208dc175-2d27-455b-b385-4625e58f0a88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a700c0656f9474da10138612772e186'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:52.135071 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-208dc175-2d27-455b-b385-4625e58f0a88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a700c0656f9474da10138612772e186'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:52.142807 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1265/2562] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:18:51 2022] DELETE /identity/v3/users/1a700c0656f9474da10138612772e186 => generated 0 bytes in 813 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:52.145647 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208dc175-2d27-455b-b385-4625e58f0a88 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:52.147464 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-208dc175-2d27-455b-b385-4625e58f0a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:52.207121 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-23b07be4-7e15-4728-bded-cefbfb1a2071 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7536380242c44ddfb894c24d48555297'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:52.236974 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208dc175-2d27-455b-b385-4625e58f0a88 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:52.237719 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-23b07be4-7e15-4728-bded-cefbfb1a2071 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7536380242c44ddfb894c24d48555297'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:52.238913 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-23b07be4-7e15-4728-bded-cefbfb1a2071 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7536380242c44ddfb894c24d48555297'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:52.239938 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-23b07be4-7e15-4728-bded-cefbfb1a2071 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7536380242c44ddfb894c24d48555297'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:52.248027 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e92ca-eea3-4fda-b872-d53defe2ee94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:52.248276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e92ca-eea3-4fda-b872-d53defe2ee94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:52.248681 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e92ca-eea3-4fda-b872-d53defe2ee94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:52.249177 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e92ca-eea3-4fda-b872-d53defe2ee94 admin admin] PATH_INFO: `/v3/users/dd12cf90b06e4307807909559a9bbb90` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:52.251287 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e92ca-eea3-4fda-b872-d53defe2ee94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd12cf90b06e4307807909559a9bbb90)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:52.254880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e92ca-eea3-4fda-b872-d53defe2ee94 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:52.269908 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1298/2563] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:18:51 2022] DELETE /identity/v3/users/7536380242c44ddfb894c24d48555297 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:52.271502 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8afbc0-5617-4e68-b748-b3642359618f None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:52.272004 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8afbc0-5617-4e68-b748-b3642359618f None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:52.272426 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8afbc0-5617-4e68-b748-b3642359618f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:52.314790 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-bc8afbc0-5617-4e68-b748-b3642359618f None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:52.323728 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-bc8afbc0-5617-4e68-b748-b3642359618f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:52.409273 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1299/2564] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:52.411474 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bb36e-9cfc-4555-9aa4-12fec3ddf614 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:52.412850 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bb36e-9cfc-4555-9aa4-12fec3ddf614 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:52.413326 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bb36e-9cfc-4555-9aa4-12fec3ddf614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:52.438981 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-6c0bb36e-9cfc-4555-9aa4-12fec3ddf614 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:52.440587 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-6c0bb36e-9cfc-4555-9aa4-12fec3ddf614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:52.450228 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1300/2565] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:52.460437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bb36e-9cfc-4555-9aa4-12fec3ddf614 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:52.460437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-6c0bb36e-9cfc-4555-9aa4-12fec3ddf614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:52.502557 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-d65e92ca-eea3-4fda-b872-d53defe2ee94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd12cf90b06e4307807909559a9bbb90'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:52.511192 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-d65e92ca-eea3-4fda-b872-d53defe2ee94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd12cf90b06e4307807909559a9bbb90'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:52.511977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-d65e92ca-eea3-4fda-b872-d53defe2ee94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd12cf90b06e4307807909559a9bbb90'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:52.524959 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:52.542821 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bb36e-9cfc-4555-9aa4-12fec3ddf614 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:52.549413 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db993cd7-2a9d-40f4-9a16-83002a4166b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:52.550497 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db993cd7-2a9d-40f4-9a16-83002a4166b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:52.550946 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db993cd7-2a9d-40f4-9a16-83002a4166b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:52.551394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db993cd7-2a9d-40f4-9a16-83002a4166b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:52.556107 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-db993cd7-2a9d-40f4-9a16-83002a4166b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:52.579808 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db993cd7-2a9d-40f4-9a16-83002a4166b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:52.582718 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db993cd7-2a9d-40f4-9a16-83002a4166b5 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:52.590332 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-d65e92ca-eea3-4fda-b872-d53defe2ee94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd12cf90b06e4307807909559a9bbb90'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:52.601906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:52.602874 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1301/2566] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:18:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:18:52.604823 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db993cd7-2a9d-40f4-9a16-83002a4166b5 service neutron] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:52.607787 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-d65e92ca-eea3-4fda-b872-d53defe2ee94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd12cf90b06e4307807909559a9bbb90'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:52.608072 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-db993cd7-2a9d-40f4-9a16-83002a4166b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:52.617833 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1266/2567] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:18:52 2022] DELETE /identity/v3/users/dd12cf90b06e4307807909559a9bbb90 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:52.624438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb167b-f9c1-42ad-a34d-1932e1f3dd9c None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:52.625021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb167b-f9c1-42ad-a34d-1932e1f3dd9c None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:52.626006 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb167b-f9c1-42ad-a34d-1932e1f3dd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:52.640538 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db993cd7-2a9d-40f4-9a16-83002a4166b5 service neutron] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:52.654240 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-35eb167b-f9c1-42ad-a34d-1932e1f3dd9c None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:52.655773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-35eb167b-f9c1-42ad-a34d-1932e1f3dd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:52.749151 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2953632-dc44-40b9-997e-254492c3b26c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:52.750372 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2953632-dc44-40b9-997e-254492c3b26c service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:52.751390 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2953632-dc44-40b9-997e-254492c3b26c service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:52.751788 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2953632-dc44-40b9-997e-254492c3b26c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:52.754610 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-c2953632-dc44-40b9-997e-254492c3b26c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:52.775897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1267/2568] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:18:52.790571 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb167b-f9c1-42ad-a34d-1932e1f3dd9c None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:52.806791 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb167b-f9c1-42ad-a34d-1932e1f3dd9c None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:52.818995 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03692a8a-9e8c-49c3-b8fc-758b9b849b7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:52.820186 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03692a8a-9e8c-49c3-b8fc-758b9b849b7e service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:52.821778 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03692a8a-9e8c-49c3-b8fc-758b9b849b7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:52.821778 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03692a8a-9e8c-49c3-b8fc-758b9b849b7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:52.839808 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03692a8a-9e8c-49c3-b8fc-758b9b849b7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:52.841560 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03692a8a-9e8c-49c3-b8fc-758b9b849b7e service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:52.860482 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1268/2569] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:18:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:18:52.884517 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2953632-dc44-40b9-997e-254492c3b26c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:52.888038 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2953632-dc44-40b9-997e-254492c3b26c service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:52.925678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1302/2570] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:18:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:18:53.214674 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03692a8a-9e8c-49c3-b8fc-758b9b849b7e service neutron] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:53.217151 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-03692a8a-9e8c-49c3-b8fc-758b9b849b7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:53.246539 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03692a8a-9e8c-49c3-b8fc-758b9b849b7e service neutron] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:53.273576 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e4bbe-a03f-445b-ab50-8fa5c0529f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:53.275358 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e4bbe-a03f-445b-ab50-8fa5c0529f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:53.275992 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e4bbe-a03f-445b-ab50-8fa5c0529f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:53.276914 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e4bbe-a03f-445b-ab50-8fa5c0529f57 admin admin] PATH_INFO: `/v3/projects/6712bff228a14535ba096e5b002a0762` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:53.279774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e4bbe-a03f-445b-ab50-8fa5c0529f57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6712bff228a14535ba096e5b002a0762)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:53.283048 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e4bbe-a03f-445b-ab50-8fa5c0529f57 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:53.439551 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-983e4bbe-a03f-445b-ab50-8fa5c0529f57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6712bff228a14535ba096e5b002a0762', 'request_id': 'req-983e4bbe-a03f-445b-ab50-8fa5c0529f57'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:53.458621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-983e4bbe-a03f-445b-ab50-8fa5c0529f57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6712bff228a14535ba096e5b002a0762', 'request_id': 'req-983e4bbe-a03f-445b-ab50-8fa5c0529f57'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:53.475964 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-983e4bbe-a03f-445b-ab50-8fa5c0529f57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6712bff228a14535ba096e5b002a0762', 'request_id': 'req-983e4bbe-a03f-445b-ab50-8fa5c0529f57'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:53.583540 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-983e4bbe-a03f-445b-ab50-8fa5c0529f57 admin admin] The token cache is being invalidate because project 6712bff228a14535ba096e5b002a0762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:18:53.587924 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-983e4bbe-a03f-445b-ab50-8fa5c0529f57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:53.590089 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-983e4bbe-a03f-445b-ab50-8fa5c0529f57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:53.598546 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1269/2571] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:18:53 2022] DELETE /identity/v3/projects/6712bff228a14535ba096e5b002a0762 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:18:53.604193 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2953632-dc44-40b9-997e-254492c3b26c service neutron] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:53.629479 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2953632-dc44-40b9-997e-254492c3b26c service neutron] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:53.746712 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94170c8-d074-4f06-b2a8-679a3941a490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:53.747829 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94170c8-d074-4f06-b2a8-679a3941a490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:53.748405 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94170c8-d074-4f06-b2a8-679a3941a490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:53.748799 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94170c8-d074-4f06-b2a8-679a3941a490 admin admin] PATH_INFO: `/v3/users/9d2ecbc759db4ea48e85658d39f2e0b5` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:53.750875 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94170c8-d074-4f06-b2a8-679a3941a490 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d2ecbc759db4ea48e85658d39f2e0b5)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:53.754337 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94170c8-d074-4f06-b2a8-679a3941a490 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:53.831524 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e4bbe-a03f-445b-ab50-8fa5c0529f57 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:53.834189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-983e4bbe-a03f-445b-ab50-8fa5c0529f57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:53.854204 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e4bbe-a03f-445b-ab50-8fa5c0529f57 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:53.861774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7643f8-97aa-426c-addd-38cb60e09404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:53.873148 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7643f8-97aa-426c-addd-38cb60e09404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:53.873148 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7643f8-97aa-426c-addd-38cb60e09404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:53.873148 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7643f8-97aa-426c-addd-38cb60e09404 admin admin] PATH_INFO: `/v3/projects/e7bb8126f4f74212b5beffe67630ec47` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:53.873148 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7643f8-97aa-426c-addd-38cb60e09404 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7bb8126f4f74212b5beffe67630ec47)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:53.873148 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7643f8-97aa-426c-addd-38cb60e09404 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:54.065898 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:54.075975 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-b94170c8-d074-4f06-b2a8-679a3941a490 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d2ecbc759db4ea48e85658d39f2e0b5'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:54.076301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-da7643f8-97aa-426c-addd-38cb60e09404 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7bb8126f4f74212b5beffe67630ec47', 'request_id': 'req-da7643f8-97aa-426c-addd-38cb60e09404'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:54.083755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:54.086084 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-da7643f8-97aa-426c-addd-38cb60e09404 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7bb8126f4f74212b5beffe67630ec47', 'request_id': 'req-da7643f8-97aa-426c-addd-38cb60e09404'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:54.093563 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-da7643f8-97aa-426c-addd-38cb60e09404 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7bb8126f4f74212b5beffe67630ec47', 'request_id': 'req-da7643f8-97aa-426c-addd-38cb60e09404'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:54.138305 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-b94170c8-d074-4f06-b2a8-679a3941a490 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d2ecbc759db4ea48e85658d39f2e0b5'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:54.151867 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-b94170c8-d074-4f06-b2a8-679a3941a490 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d2ecbc759db4ea48e85658d39f2e0b5'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:54.157374 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-b94170c8-d074-4f06-b2a8-679a3941a490 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d2ecbc759db4ea48e85658d39f2e0b5'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:54.159094 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-b94170c8-d074-4f06-b2a8-679a3941a490 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d2ecbc759db4ea48e85658d39f2e0b5'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:54.189892 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1303/2572] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:18:53 2022] DELETE /identity/v3/users/9d2ecbc759db4ea48e85658d39f2e0b5 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:54.190815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94170c8-d074-4f06-b2a8-679a3941a490 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:54.192755 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-b94170c8-d074-4f06-b2a8-679a3941a490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:54.259779 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-da7643f8-97aa-426c-addd-38cb60e09404 admin admin] The token cache is being invalidate because project e7bb8126f4f74212b5beffe67630ec47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:18:54.260449 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-da7643f8-97aa-426c-addd-38cb60e09404 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:54.263603 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-da7643f8-97aa-426c-addd-38cb60e09404 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:54.266675 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1270/2573] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:18:53 2022] DELETE /identity/v3/projects/e7bb8126f4f74212b5beffe67630ec47 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:54.275862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7643f8-97aa-426c-addd-38cb60e09404 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:54.277921 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-da7643f8-97aa-426c-addd-38cb60e09404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:54.336952 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94170c8-d074-4f06-b2a8-679a3941a490 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:54.347336 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263dfdb2-6a81-4162-97f4-fd24a3bc9840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:54.348548 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dfdb2-6a81-4162-97f4-fd24a3bc9840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:54.349980 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dfdb2-6a81-4162-97f4-fd24a3bc9840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:54.350340 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dfdb2-6a81-4162-97f4-fd24a3bc9840 admin admin] PATH_INFO: `/v3/projects/bbb1108563534e93a3eab1f27615e2bc` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:54.352939 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263dfdb2-6a81-4162-97f4-fd24a3bc9840 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbb1108563534e93a3eab1f27615e2bc)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:54.356748 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263dfdb2-6a81-4162-97f4-fd24a3bc9840 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:54.420360 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7643f8-97aa-426c-addd-38cb60e09404 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:54.426377 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b27a2-9f22-45dd-ba46-5b55b146d15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:54.427514 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b27a2-9f22-45dd-ba46-5b55b146d15a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:54.427987 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b27a2-9f22-45dd-ba46-5b55b146d15a admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:54.428500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b27a2-9f22-45dd-ba46-5b55b146d15a admin admin] PATH_INFO: `/v3/users/ec3835e764574dc4b0d3cf1af2f29b41` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:54.430746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b27a2-9f22-45dd-ba46-5b55b146d15a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec3835e764574dc4b0d3cf1af2f29b41)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:54.434345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b27a2-9f22-45dd-ba46-5b55b146d15a admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:54.493793 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-263dfdb2-6a81-4162-97f4-fd24a3bc9840 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbb1108563534e93a3eab1f27615e2bc', 'request_id': 'req-263dfdb2-6a81-4162-97f4-fd24a3bc9840'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:54.585337 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-263dfdb2-6a81-4162-97f4-fd24a3bc9840 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbb1108563534e93a3eab1f27615e2bc', 'request_id': 'req-263dfdb2-6a81-4162-97f4-fd24a3bc9840'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:54.600292 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-263dfdb2-6a81-4162-97f4-fd24a3bc9840 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbb1108563534e93a3eab1f27615e2bc', 'request_id': 'req-263dfdb2-6a81-4162-97f4-fd24a3bc9840'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:54.620384 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-263dfdb2-6a81-4162-97f4-fd24a3bc9840 admin admin] The token cache is being invalidate because project bbb1108563534e93a3eab1f27615e2bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:18:54.621470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-263dfdb2-6a81-4162-97f4-fd24a3bc9840 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:54.621814 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-263dfdb2-6a81-4162-97f4-fd24a3bc9840 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:54.624249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1304/2574] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:18:54 2022] DELETE /identity/v3/projects/bbb1108563534e93a3eab1f27615e2bc => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:54.628971 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263dfdb2-6a81-4162-97f4-fd24a3bc9840 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:54.630791 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-263dfdb2-6a81-4162-97f4-fd24a3bc9840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:54.690659 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:54.712127 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263dfdb2-6a81-4162-97f4-fd24a3bc9840 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:54.717359 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13730b1-0740-4536-bb19-7ab904e146a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:54.718093 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13730b1-0740-4536-bb19-7ab904e146a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:54.718360 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13730b1-0740-4536-bb19-7ab904e146a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:54.718638 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13730b1-0740-4536-bb19-7ab904e146a6 admin admin] PATH_INFO: `/v3/users/51758860de3e4e00a1157a54f7595749` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:54.719924 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13730b1-0740-4536-bb19-7ab904e146a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51758860de3e4e00a1157a54f7595749)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:54.721987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13730b1-0740-4536-bb19-7ab904e146a6 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:54.874534 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-ff6b27a2-9f22-45dd-ba46-5b55b146d15a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec3835e764574dc4b0d3cf1af2f29b41'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:54.882189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-ff6b27a2-9f22-45dd-ba46-5b55b146d15a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec3835e764574dc4b0d3cf1af2f29b41'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:54.883047 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-ff6b27a2-9f22-45dd-ba46-5b55b146d15a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec3835e764574dc4b0d3cf1af2f29b41'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:55.031172 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-ff6b27a2-9f22-45dd-ba46-5b55b146d15a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec3835e764574dc4b0d3cf1af2f29b41'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:55.049561 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-ff6b27a2-9f22-45dd-ba46-5b55b146d15a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec3835e764574dc4b0d3cf1af2f29b41'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:55.056089 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-c13730b1-0740-4536-bb19-7ab904e146a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51758860de3e4e00a1157a54f7595749'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:55.062107 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1271/2575] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:18:54 2022] DELETE /identity/v3/users/ec3835e764574dc4b0d3cf1af2f29b41 => generated 0 bytes in 787 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:55.065892 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b27a2-9f22-45dd-ba46-5b55b146d15a admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:55.068669 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-ff6b27a2-9f22-45dd-ba46-5b55b146d15a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:55.174029 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-c13730b1-0740-4536-bb19-7ab904e146a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51758860de3e4e00a1157a54f7595749'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:55.204851 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-c13730b1-0740-4536-bb19-7ab904e146a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51758860de3e4e00a1157a54f7595749'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:55.209013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-c13730b1-0740-4536-bb19-7ab904e146a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51758860de3e4e00a1157a54f7595749'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:55.210201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-c13730b1-0740-4536-bb19-7ab904e146a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51758860de3e4e00a1157a54f7595749'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:55.252049 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b27a2-9f22-45dd-ba46-5b55b146d15a admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:55.260476 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a03c6c-4f0b-413b-8231-d0f0755093bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:55.261260 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a03c6c-4f0b-413b-8231-d0f0755093bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:55.261596 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a03c6c-4f0b-413b-8231-d0f0755093bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:55.261910 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a03c6c-4f0b-413b-8231-d0f0755093bc admin admin] PATH_INFO: `/v3/projects/02ddaec6d0d64e08883b063d307c57b5` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:55.263373 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a03c6c-4f0b-413b-8231-d0f0755093bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=02ddaec6d0d64e08883b063d307c57b5)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:55.265575 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a03c6c-4f0b-413b-8231-d0f0755093bc admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:55.279661 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:55.308213 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1305/2576] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:18:54 2022] DELETE /identity/v3/users/51758860de3e4e00a1157a54f7595749 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:55.429707 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-e0a03c6c-4f0b-413b-8231-d0f0755093bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02ddaec6d0d64e08883b063d307c57b5', 'request_id': 'req-e0a03c6c-4f0b-413b-8231-d0f0755093bc'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:55.451412 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-e0a03c6c-4f0b-413b-8231-d0f0755093bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02ddaec6d0d64e08883b063d307c57b5', 'request_id': 'req-e0a03c6c-4f0b-413b-8231-d0f0755093bc'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:55.469133 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-e0a03c6c-4f0b-413b-8231-d0f0755093bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02ddaec6d0d64e08883b063d307c57b5', 'request_id': 'req-e0a03c6c-4f0b-413b-8231-d0f0755093bc'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:55.590267 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-e0a03c6c-4f0b-413b-8231-d0f0755093bc admin admin] The token cache is being invalidate because project 02ddaec6d0d64e08883b063d307c57b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:18:55.590868 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-e0a03c6c-4f0b-413b-8231-d0f0755093bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:55.592025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-e0a03c6c-4f0b-413b-8231-d0f0755093bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:55.595009 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1272/2577] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:18:55 2022] DELETE /identity/v3/projects/02ddaec6d0d64e08883b063d307c57b5 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:55.600758 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93628d6-b36e-4682-a562-0bf028aefbd1 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:55.601241 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93628d6-b36e-4682-a562-0bf028aefbd1 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:55.601386 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93628d6-b36e-4682-a562-0bf028aefbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:55.623371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-d93628d6-b36e-4682-a562-0bf028aefbd1 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:55.624569 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-d93628d6-b36e-4682-a562-0bf028aefbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:55.707295 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1306/2578] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:55.712303 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd27d2-da88-43b2-9717-3a33ef3c6abf None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:55.712770 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd27d2-da88-43b2-9717-3a33ef3c6abf None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:55.713458 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd27d2-da88-43b2-9717-3a33ef3c6abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:55.746315 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-d6fd27d2-da88-43b2-9717-3a33ef3c6abf None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:55.748678 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-d6fd27d2-da88-43b2-9717-3a33ef3c6abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:55.770365 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1273/2579] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:55.770776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93628d6-b36e-4682-a562-0bf028aefbd1 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:55.781147 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93628d6-b36e-4682-a562-0bf028aefbd1 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:55.786373 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea7856-f312-4265-93cc-d0881221cb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:55.787842 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea7856-f312-4265-93cc-d0881221cb30 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:55.788121 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea7856-f312-4265-93cc-d0881221cb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:55.788449 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea7856-f312-4265-93cc-d0881221cb30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:55.789772 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea7856-f312-4265-93cc-d0881221cb30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:18:55.790712 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea7856-f312-4265-93cc-d0881221cb30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:55.792714 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea7856-f312-4265-93cc-d0881221cb30 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:55.818871 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1307/2580] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:18:55.819658 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd27d2-da88-43b2-9717-3a33ef3c6abf None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:55.837130 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd27d2-da88-43b2-9717-3a33ef3c6abf None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:55.845961 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf253375-b542-4437-a7c2-882e0c79bc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:55.847038 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf253375-b542-4437-a7c2-882e0c79bc90 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:55.847515 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf253375-b542-4437-a7c2-882e0c79bc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:55.848333 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf253375-b542-4437-a7c2-882e0c79bc90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:55.850397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf253375-b542-4437-a7c2-882e0c79bc90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:55.854605 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf253375-b542-4437-a7c2-882e0c79bc90 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:55.989841 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea7856-f312-4265-93cc-d0881221cb30 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:55.992137 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-3cea7856-f312-4265-93cc-d0881221cb30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:56.006897 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea7856-f312-4265-93cc-d0881221cb30 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:56.012847 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1209f-52cb-4568-ae4a-dc98fe7186dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:56.013732 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1209f-52cb-4568-ae4a-dc98fe7186dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:56.014018 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1209f-52cb-4568-ae4a-dc98fe7186dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:56.014494 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1209f-52cb-4568-ae4a-dc98fe7186dc admin admin] PATH_INFO: `/v3/projects/be183464c8b7442b8350562914328d8f` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:56.015830 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a1209f-52cb-4568-ae4a-dc98fe7186dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=be183464c8b7442b8350562914328d8f)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:56.018577 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a1209f-52cb-4568-ae4a-dc98fe7186dc admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:56.035629 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1274/2581] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:18:55 2022] POST /identity/v3/projects => generated 391 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:56.038821 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf253375-b542-4437-a7c2-882e0c79bc90 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:56.042593 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-cf253375-b542-4437-a7c2-882e0c79bc90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:56.149920 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf253375-b542-4437-a7c2-882e0c79bc90 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:56.159374 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f5d62-c26a-4e81-8709-99a9376dd03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:56.161269 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f5d62-c26a-4e81-8709-99a9376dd03b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:56.161824 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f5d62-c26a-4e81-8709-99a9376dd03b admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:56.162306 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f5d62-c26a-4e81-8709-99a9376dd03b admin admin] PATH_INFO: `/v3/projects/a34b14b636b74eaf8723b82dfeec77c0` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:56.164713 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f5d62-c26a-4e81-8709-99a9376dd03b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a34b14b636b74eaf8723b82dfeec77c0)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:56.170411 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f5d62-c26a-4e81-8709-99a9376dd03b admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:56.198254 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:56.200269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-18a1209f-52cb-4568-ae4a-dc98fe7186dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be183464c8b7442b8350562914328d8f', 'request_id': 'req-18a1209f-52cb-4568-ae4a-dc98fe7186dc'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:56.293281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-18a1209f-52cb-4568-ae4a-dc98fe7186dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be183464c8b7442b8350562914328d8f', 'request_id': 'req-18a1209f-52cb-4568-ae4a-dc98fe7186dc'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:56.300492 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-18a1209f-52cb-4568-ae4a-dc98fe7186dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be183464c8b7442b8350562914328d8f', 'request_id': 'req-18a1209f-52cb-4568-ae4a-dc98fe7186dc'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:56.315725 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-18a1209f-52cb-4568-ae4a-dc98fe7186dc admin admin] The token cache is being invalidate because project be183464c8b7442b8350562914328d8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:18:56.316028 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-18a1209f-52cb-4568-ae4a-dc98fe7186dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:56.317443 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-18a1209f-52cb-4568-ae4a-dc98fe7186dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:56.320863 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1308/2582] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:18:55 2022] DELETE /identity/v3/projects/be183464c8b7442b8350562914328d8f => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:56.322431 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1209f-52cb-4568-ae4a-dc98fe7186dc admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:56.325571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-18a1209f-52cb-4568-ae4a-dc98fe7186dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:56.333582 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-fc0f5d62-c26a-4e81-8709-99a9376dd03b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a34b14b636b74eaf8723b82dfeec77c0', 'request_id': 'req-fc0f5d62-c26a-4e81-8709-99a9376dd03b'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:56.345284 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-fc0f5d62-c26a-4e81-8709-99a9376dd03b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a34b14b636b74eaf8723b82dfeec77c0', 'request_id': 'req-fc0f5d62-c26a-4e81-8709-99a9376dd03b'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:56.356904 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-fc0f5d62-c26a-4e81-8709-99a9376dd03b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a34b14b636b74eaf8723b82dfeec77c0', 'request_id': 'req-fc0f5d62-c26a-4e81-8709-99a9376dd03b'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:56.363307 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:56.418869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1209f-52cb-4568-ae4a-dc98fe7186dc admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:56.473194 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-fc0f5d62-c26a-4e81-8709-99a9376dd03b admin admin] The token cache is being invalidate because project a34b14b636b74eaf8723b82dfeec77c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:18:56.474147 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-fc0f5d62-c26a-4e81-8709-99a9376dd03b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:56.476068 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-fc0f5d62-c26a-4e81-8709-99a9376dd03b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:56.479014 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1275/2583] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:18:56 2022] DELETE /identity/v3/projects/a34b14b636b74eaf8723b82dfeec77c0 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:56.481516 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe615046-584c-4ccb-ac22-22ea2615792e None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:56.482287 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe615046-584c-4ccb-ac22-22ea2615792e None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:56.482907 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe615046-584c-4ccb-ac22-22ea2615792e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:56.516288 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b50ce-5946-4886-8902-918a98710d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:56.517086 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b50ce-5946-4886-8902-918a98710d4c admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:56.517283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-fe615046-584c-4ccb-ac22-22ea2615792e None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:56.517394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b50ce-5946-4886-8902-918a98710d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:56.517628 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b50ce-5946-4886-8902-918a98710d4c admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:56.518480 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b50ce-5946-4886-8902-918a98710d4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:56.518612 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-fe615046-584c-4ccb-ac22-22ea2615792e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:56.520601 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b50ce-5946-4886-8902-918a98710d4c admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:56.533441 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1276/2584] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:56.534998 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07b8b8-f3db-45c2-a35d-43844112ed48 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:56.535466 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07b8b8-f3db-45c2-a35d-43844112ed48 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:56.535927 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07b8b8-f3db-45c2-a35d-43844112ed48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:56.559172 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-7c07b8b8-f3db-45c2-a35d-43844112ed48 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:56.560812 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-7c07b8b8-f3db-45c2-a35d-43844112ed48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:56.570805 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1277/2585] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:56.572266 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e2d29-9300-4b73-81b6-4e6b8140b742 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:56.572647 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e2d29-9300-4b73-81b6-4e6b8140b742 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:56.572831 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e2d29-9300-4b73-81b6-4e6b8140b742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:56.602579 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-393e2d29-9300-4b73-81b6-4e6b8140b742 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:56.603812 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-393e2d29-9300-4b73-81b6-4e6b8140b742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:56.617369 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1278/2586] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:56.618958 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfc893-ec89-41f6-8498-86e0412d8300 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:56.619410 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfc893-ec89-41f6-8498-86e0412d8300 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:56.619688 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfc893-ec89-41f6-8498-86e0412d8300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:56.642444 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-8bbfc893-ec89-41f6-8498-86e0412d8300 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:56.643662 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-8bbfc893-ec89-41f6-8498-86e0412d8300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:56.652980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1279/2587] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:56.654070 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfc893-ec89-41f6-8498-86e0412d8300 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:56.666452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfc893-ec89-41f6-8498-86e0412d8300 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:56.673398 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ed84f-8f8f-4875-8499-04cfb0a1716c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:56.674196 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ed84f-8f8f-4875-8499-04cfb0a1716c admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:56.674487 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ed84f-8f8f-4875-8499-04cfb0a1716c admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:56.674760 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ed84f-8f8f-4875-8499-04cfb0a1716c admin admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:56.675482 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ed84f-8f8f-4875-8499-04cfb0a1716c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:18:56.675872 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ed84f-8f8f-4875-8499-04cfb0a1716c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:56.678726 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1309/2588] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:18:56 2022] POST /identity/v3/users => generated 296 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:56.679609 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ed84f-8f8f-4875-8499-04cfb0a1716c admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:56.679803 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b50ce-5946-4886-8902-918a98710d4c admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:56.696807 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1280/2589] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:18:56.698830 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ed84f-8f8f-4875-8499-04cfb0a1716c admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:56.700480 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b50ce-5946-4886-8902-918a98710d4c admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:56.702161 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-836ed84f-8f8f-4875-8499-04cfb0a1716c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:56.713104 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800188d5-abe6-4f94-ab89-828ad3775003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:56.714901 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800188d5-abe6-4f94-ab89-828ad3775003 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:56.716040 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800188d5-abe6-4f94-ab89-828ad3775003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:56.716993 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800188d5-abe6-4f94-ab89-828ad3775003 admin admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:56.717987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800188d5-abe6-4f94-ab89-828ad3775003 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:18:56.718622 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800188d5-abe6-4f94-ab89-828ad3775003 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:56.721637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800188d5-abe6-4f94-ab89-828ad3775003 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:56.728317 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ed84f-8f8f-4875-8499-04cfb0a1716c admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:56.736437 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1296e53-7d22-41e2-8a31-343757e5685b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:56.737328 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1296e53-7d22-41e2-8a31-343757e5685b admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:56.737789 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1296e53-7d22-41e2-8a31-343757e5685b admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:56.738244 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1296e53-7d22-41e2-8a31-343757e5685b admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:56.739441 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1296e53-7d22-41e2-8a31-343757e5685b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:56.742456 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1296e53-7d22-41e2-8a31-343757e5685b admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:56.752288 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1310/2590] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:18:56.754042 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800188d5-abe6-4f94-ab89-828ad3775003 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:56.764999 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1281/2591] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:18:56.767286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1296e53-7d22-41e2-8a31-343757e5685b admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:56.771901 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800188d5-abe6-4f94-ab89-828ad3775003 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:56.778706 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b00fc8-276c-41f2-a817-79ac3bcef130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:56.779420 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b00fc8-276c-41f2-a817-79ac3bcef130 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:56.779659 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b00fc8-276c-41f2-a817-79ac3bcef130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:56.779915 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b00fc8-276c-41f2-a817-79ac3bcef130 admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:56.780643 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b00fc8-276c-41f2-a817-79ac3bcef130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:56.782681 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b00fc8-276c-41f2-a817-79ac3bcef130 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:56.788748 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1296e53-7d22-41e2-8a31-343757e5685b admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:56.800404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7479db-7251-46d5-95ad-27bfb45e4014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:56.802133 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7479db-7251-46d5-95ad-27bfb45e4014 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:56.804245 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7479db-7251-46d5-95ad-27bfb45e4014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:56.812379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7479db-7251-46d5-95ad-27bfb45e4014 admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:56.812379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7479db-7251-46d5-95ad-27bfb45e4014 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:56.812379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7479db-7251-46d5-95ad-27bfb45e4014 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:56.924116 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1311/2592] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:18:56 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:56.925066 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b00fc8-276c-41f2-a817-79ac3bcef130 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:56.990975 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b00fc8-276c-41f2-a817-79ac3bcef130 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:56.992589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1282/2593] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:18:56 2022] POST /identity/v3/projects => generated 387 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:56.993493 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7479db-7251-46d5-95ad-27bfb45e4014 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:57.054097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4ce9b-c113-4c9d-ba6d-c044101ba45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:57.054635 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4ce9b-c113-4c9d-ba6d-c044101ba45e admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:57.055623 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4ce9b-c113-4c9d-ba6d-c044101ba45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:57.058578 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4ce9b-c113-4c9d-ba6d-c044101ba45e admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:57.061730 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4ce9b-c113-4c9d-ba6d-c044101ba45e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:57.064368 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4ce9b-c113-4c9d-ba6d-c044101ba45e admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:57.065797 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7479db-7251-46d5-95ad-27bfb45e4014 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:57.075893 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68865fbe-d71f-49a1-bcd0-a2ccba78d604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:57.076627 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68865fbe-d71f-49a1-bcd0-a2ccba78d604 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:57.076931 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68865fbe-d71f-49a1-bcd0-a2ccba78d604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:57.077193 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68865fbe-d71f-49a1-bcd0-a2ccba78d604 admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:57.078000 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68865fbe-d71f-49a1-bcd0-a2ccba78d604 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:57.080133 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1312/2594] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:18:57.087735 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68865fbe-d71f-49a1-bcd0-a2ccba78d604 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:57.087895 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4ce9b-c113-4c9d-ba6d-c044101ba45e admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:57.095525 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4ce9b-c113-4c9d-ba6d-c044101ba45e admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:57.101994 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c15d9-d138-4e40-bdcd-d80ed2a9bd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:57.102856 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c15d9-d138-4e40-bdcd-d80ed2a9bd84 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:57.103166 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c15d9-d138-4e40-bdcd-d80ed2a9bd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:57.103400 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c15d9-d138-4e40-bdcd-d80ed2a9bd84 admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:57.104092 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c15d9-d138-4e40-bdcd-d80ed2a9bd84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:57.106077 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c15d9-d138-4e40-bdcd-d80ed2a9bd84 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:57.167836 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:57.261780 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1283/2595] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:18:56 2022] POST /identity/v3/users => generated 293 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:57.263116 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68865fbe-d71f-49a1-bcd0-a2ccba78d604 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:57.278939 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68865fbe-d71f-49a1-bcd0-a2ccba78d604 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:57.284661 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f222b-6835-4dc9-b456-a73ec1e461f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:57.285427 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f222b-6835-4dc9-b456-a73ec1e461f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:57.285736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f222b-6835-4dc9-b456-a73ec1e461f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:57.286064 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f222b-6835-4dc9-b456-a73ec1e461f9 admin admin] PATH_INFO: `/v3/projects/1b36709584314fc0a47ef6f1c8237137/users/62d742554c964058ac17745ba81fdd2b/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:57.307046 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f222b-6835-4dc9-b456-a73ec1e461f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b36709584314fc0a47ef6f1c8237137, user_id=62d742554c964058ac17745ba81fdd2b, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:57.309840 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f222b-6835-4dc9-b456-a73ec1e461f9 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:57.318074 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1313/2596] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:18:57 2022] POST /identity/v3/users => generated 294 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:57.319416 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c15d9-d138-4e40-bdcd-d80ed2a9bd84 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:57.330219 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c15d9-d138-4e40-bdcd-d80ed2a9bd84 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:57.336137 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a20d5-0203-4129-bb94-eaf3157a9601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:57.336820 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a20d5-0203-4129-bb94-eaf3157a9601 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:57.337104 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a20d5-0203-4129-bb94-eaf3157a9601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:57.337385 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a20d5-0203-4129-bb94-eaf3157a9601 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:57.338122 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a20d5-0203-4129-bb94-eaf3157a9601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:57.339788 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a20d5-0203-4129-bb94-eaf3157a9601 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:57.352596 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1314/2597] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:18:57.353442 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a20d5-0203-4129-bb94-eaf3157a9601 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:57.363218 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a20d5-0203-4129-bb94-eaf3157a9601 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:57.369248 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a3266-0eaf-4ca3-9133-d39b93e3bd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:57.369882 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a3266-0eaf-4ca3-9133-d39b93e3bd7b admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:57.370184 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a3266-0eaf-4ca3-9133-d39b93e3bd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:57.370437 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a3266-0eaf-4ca3-9133-d39b93e3bd7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:57.371214 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a3266-0eaf-4ca3-9133-d39b93e3bd7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:57.372847 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a3266-0eaf-4ca3-9133-d39b93e3bd7b admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:57.383696 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1315/2598] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:18:57.384574 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a3266-0eaf-4ca3-9133-d39b93e3bd7b admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:57.395404 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a3266-0eaf-4ca3-9133-d39b93e3bd7b admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:57.401755 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2605400-5cb0-45c9-a34e-5dc5ff4f68ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:57.402367 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2605400-5cb0-45c9-a34e-5dc5ff4f68ff admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:57.402650 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2605400-5cb0-45c9-a34e-5dc5ff4f68ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:57.402927 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2605400-5cb0-45c9-a34e-5dc5ff4f68ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:57.403652 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2605400-5cb0-45c9-a34e-5dc5ff4f68ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:57.405300 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2605400-5cb0-45c9-a34e-5dc5ff4f68ff admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:57.420084 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1316/2599] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:18:57.421047 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2605400-5cb0-45c9-a34e-5dc5ff4f68ff admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:57.434235 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2605400-5cb0-45c9-a34e-5dc5ff4f68ff admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:57.441358 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad98a7-f525-442b-a019-1e09203e8062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:57.451094 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad98a7-f525-442b-a019-1e09203e8062 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:57.451094 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad98a7-f525-442b-a019-1e09203e8062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:57.451094 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad98a7-f525-442b-a019-1e09203e8062 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:57.451094 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad98a7-f525-442b-a019-1e09203e8062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:57.451094 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad98a7-f525-442b-a019-1e09203e8062 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:57.457774 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1317/2600] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:18:57.458790 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad98a7-f525-442b-a019-1e09203e8062 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:57.472064 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad98a7-f525-442b-a019-1e09203e8062 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:57.477987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b0bad-80fe-4335-8641-2d73761e6d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:57.478683 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b0bad-80fe-4335-8641-2d73761e6d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:57.478963 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b0bad-80fe-4335-8641-2d73761e6d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:57.479236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b0bad-80fe-4335-8641-2d73761e6d7b admin admin] PATH_INFO: `/v3/projects/9d424b1ac2da4cff98bb47356be20f73/users/15f6c27d7c614539ae3a3813356db39e/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:57.497496 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b0bad-80fe-4335-8641-2d73761e6d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d424b1ac2da4cff98bb47356be20f73, user_id=15f6c27d7c614539ae3a3813356db39e, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:57.500269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b0bad-80fe-4335-8641-2d73761e6d7b admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:57.526344 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1284/2601] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:18:57 2022] PUT /identity/v3/projects/1b36709584314fc0a47ef6f1c8237137/users/62d742554c964058ac17745ba81fdd2b/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:57.527764 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f222b-6835-4dc9-b456-a73ec1e461f9 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:57.587864 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1318/2602] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:18:57 2022] PUT /identity/v3/projects/9d424b1ac2da4cff98bb47356be20f73/users/15f6c27d7c614539ae3a3813356db39e/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:57.589228 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410fe3f-d4fa-4eeb-8786-2645cb8816c6 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:57.589517 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410fe3f-d4fa-4eeb-8786-2645cb8816c6 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:57.589904 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410fe3f-d4fa-4eeb-8786-2645cb8816c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:57.605052 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:57.626736 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-2410fe3f-d4fa-4eeb-8786-2645cb8816c6 None None] MFA Rules not processed for user `62d742554c964058ac17745ba81fdd2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:57.628012 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-2410fe3f-d4fa-4eeb-8786-2645cb8816c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:57.632421 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f222b-6835-4dc9-b456-a73ec1e461f9 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:57.718963 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1319/2603] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:57.721236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a1b8a-3903-4f1a-9a08-862e2a6f7122 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:57.721530 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a1b8a-3903-4f1a-9a08-862e2a6f7122 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:57.721829 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a1b8a-3903-4f1a-9a08-862e2a6f7122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:57.747112 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a753fc-c61a-426f-847e-cbf66f3d8675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:57.748217 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a753fc-c61a-426f-847e-cbf66f3d8675 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:57.748866 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a753fc-c61a-426f-847e-cbf66f3d8675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:57.749173 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a753fc-c61a-426f-847e-cbf66f3d8675 admin admin] PATH_INFO: `/v3/projects/4fe84e820df94eacb5c1c6dbcf2579f1/users/b7fd3d01b2d644f593950e291e66e889/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:57.762020 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-745a1b8a-3903-4f1a-9a08-862e2a6f7122 None None] MFA Rules not processed for user `15f6c27d7c614539ae3a3813356db39e`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:57.764002 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-745a1b8a-3903-4f1a-9a08-862e2a6f7122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:57.773465 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a753fc-c61a-426f-847e-cbf66f3d8675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fe84e820df94eacb5c1c6dbcf2579f1, user_id=b7fd3d01b2d644f593950e291e66e889, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:57.778286 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a753fc-c61a-426f-847e-cbf66f3d8675 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:57.850391 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1320/2604] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:57.852376 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a1b8a-3903-4f1a-9a08-862e2a6f7122 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:57.868851 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a1b8a-3903-4f1a-9a08-862e2a6f7122 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:57.876714 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246021f-10a4-4255-834b-3704ff308a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:57.878003 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246021f-10a4-4255-834b-3704ff308a73 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:57.878003 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246021f-10a4-4255-834b-3704ff308a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:57.878003 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246021f-10a4-4255-834b-3704ff308a73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:57.878494 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246021f-10a4-4255-834b-3704ff308a73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:57.881516 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246021f-10a4-4255-834b-3704ff308a73 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:57.948309 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1285/2605] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:18:57 2022] PUT /identity/v3/projects/4fe84e820df94eacb5c1c6dbcf2579f1/users/b7fd3d01b2d644f593950e291e66e889/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:57.948309 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a753fc-c61a-426f-847e-cbf66f3d8675 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:57.948309 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-f4a753fc-c61a-426f-847e-cbf66f3d8675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:58.019208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a753fc-c61a-426f-847e-cbf66f3d8675 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:58.024307 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d8670-0008-4cb1-ae57-f0cd60ea7e39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:58.025812 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d8670-0008-4cb1-ae57-f0cd60ea7e39 service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:58.025812 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d8670-0008-4cb1-ae57-f0cd60ea7e39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:58.025812 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d8670-0008-4cb1-ae57-f0cd60ea7e39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:58.045096 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1321/2606] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:18:57 2022] POST /identity/v3/projects => generated 393 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:58.046532 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5db3c2-456b-406d-836b-8e7e93defe99 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:58.046821 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5db3c2-456b-406d-836b-8e7e93defe99 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:58.047101 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5db3c2-456b-406d-836b-8e7e93defe99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:58.092546 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-2f5db3c2-456b-406d-836b-8e7e93defe99 None None] MFA Rules not processed for user `b7fd3d01b2d644f593950e291e66e889`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:58.093829 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-2f5db3c2-456b-406d-836b-8e7e93defe99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:58.123855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d8670-0008-4cb1-ae57-f0cd60ea7e39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:58.128040 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d8670-0008-4cb1-ae57-f0cd60ea7e39 service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:58.146171 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1286/2607] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:18:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:18:58.148075 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d8670-0008-4cb1-ae57-f0cd60ea7e39 service cinder] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:58.192400 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:58.211059 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:58.215030 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1322/2608] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:58.219856 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5db3c2-456b-406d-836b-8e7e93defe99 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:58.272755 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d8670-0008-4cb1-ae57-f0cd60ea7e39 service cinder] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:58.318063 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5db3c2-456b-406d-836b-8e7e93defe99 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:58.324007 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcfbc3-0097-4e3e-a303-1b3e3fc318b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:58.324769 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcfbc3-0097-4e3e-a303-1b3e3fc318b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:58.325123 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcfbc3-0097-4e3e-a303-1b3e3fc318b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:58.325442 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcfbc3-0097-4e3e-a303-1b3e3fc318b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:58.326137 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abcfbc3-0097-4e3e-a303-1b3e3fc318b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:58.328639 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abcfbc3-0097-4e3e-a303-1b3e3fc318b6 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:58.381344 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6373301-cbee-4ee5-bce1-aa85b9a71839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:58.382068 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6373301-cbee-4ee5-bce1-aa85b9a71839 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:58.382551 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6373301-cbee-4ee5-bce1-aa85b9a71839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:58.383055 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6373301-cbee-4ee5-bce1-aa85b9a71839 admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:58.384359 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6373301-cbee-4ee5-bce1-aa85b9a71839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:58.387444 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6373301-cbee-4ee5-bce1-aa85b9a71839 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:58.484771 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1323/2609] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:18:58 2022] POST /identity/v3/projects => generated 385 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:58.487625 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcfbc3-0097-4e3e-a303-1b3e3fc318b6 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:58.508939 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1287/2610] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:18:58 2022] POST /identity/v3/users => generated 303 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:58.513449 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6373301-cbee-4ee5-bce1-aa85b9a71839 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:58.526720 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6373301-cbee-4ee5-bce1-aa85b9a71839 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:58.579275 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcfbc3-0097-4e3e-a303-1b3e3fc318b6 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:58.586181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e3f4a-f7ad-4bb0-bd78-bd75591e8d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:58.586827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e3f4a-f7ad-4bb0-bd78-bd75591e8d4a admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:58.587110 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e3f4a-f7ad-4bb0-bd78-bd75591e8d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:58.587399 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e3f4a-f7ad-4bb0-bd78-bd75591e8d4a admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:58.588092 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e3f4a-f7ad-4bb0-bd78-bd75591e8d4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:58.590360 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e3f4a-f7ad-4bb0-bd78-bd75591e8d4a admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:58.604497 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c84359-56d0-408a-a8cd-1943f7f97e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:58.605022 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c84359-56d0-408a-a8cd-1943f7f97e6d admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:58.605295 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c84359-56d0-408a-a8cd-1943f7f97e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:58.605568 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c84359-56d0-408a-a8cd-1943f7f97e6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:58.606282 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c84359-56d0-408a-a8cd-1943f7f97e6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:58.607911 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c84359-56d0-408a-a8cd-1943f7f97e6d admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:58.622259 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1288/2611] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:18:58.630012 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c84359-56d0-408a-a8cd-1943f7f97e6d admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:58.634199 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c84359-56d0-408a-a8cd-1943f7f97e6d admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:58.638999 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371a4b6-181f-4b3f-a93c-c566713ef1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:58.639662 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371a4b6-181f-4b3f-a93c-c566713ef1b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:58.640022 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371a4b6-181f-4b3f-a93c-c566713ef1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:58.640343 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371a4b6-181f-4b3f-a93c-c566713ef1b8 admin admin] PATH_INFO: `/v3/projects/0d0ae39e3212492fa49bebab6ceab875/users/0a867aaf6a824f1f8677bda6afa04367/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:58.660338 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a371a4b6-181f-4b3f-a93c-c566713ef1b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d0ae39e3212492fa49bebab6ceab875, user_id=0a867aaf6a824f1f8677bda6afa04367, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:58.664387 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a371a4b6-181f-4b3f-a93c-c566713ef1b8 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:58.727100 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1324/2612] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:18:58 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:58.731238 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e3f4a-f7ad-4bb0-bd78-bd75591e8d4a admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:58.742191 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e3f4a-f7ad-4bb0-bd78-bd75591e8d4a admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:58.747248 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527d5af-7439-4e2b-9995-c887d5a26822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:58.747883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527d5af-7439-4e2b-9995-c887d5a26822 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:58.748188 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527d5af-7439-4e2b-9995-c887d5a26822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:58.748574 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527d5af-7439-4e2b-9995-c887d5a26822 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:58.749280 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527d5af-7439-4e2b-9995-c887d5a26822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:58.750883 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527d5af-7439-4e2b-9995-c887d5a26822 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:58.762659 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1325/2613] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:18:58.767079 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527d5af-7439-4e2b-9995-c887d5a26822 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:58.779962 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527d5af-7439-4e2b-9995-c887d5a26822 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:58.786153 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1289/2614] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:18:58 2022] PUT /identity/v3/projects/0d0ae39e3212492fa49bebab6ceab875/users/0a867aaf6a824f1f8677bda6afa04367/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:58.790814 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371a4b6-181f-4b3f-a93c-c566713ef1b8 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:58.854470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c9c84-3d68-4a12-b795-31dcebdc518d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:58.855989 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c9c84-3d68-4a12-b795-31dcebdc518d admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:58.856361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c9c84-3d68-4a12-b795-31dcebdc518d admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:58.856752 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c9c84-3d68-4a12-b795-31dcebdc518d admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:58.857611 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10c9c84-3d68-4a12-b795-31dcebdc518d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:58.859789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10c9c84-3d68-4a12-b795-31dcebdc518d admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:58.873985 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1326/2615] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:18:58.876448 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371a4b6-181f-4b3f-a93c-c566713ef1b8 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:58.880745 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c9c84-3d68-4a12-b795-31dcebdc518d admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:58.883066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f5b4f-c148-4aea-8f14-13585fba842a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:58.884500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f5b4f-c148-4aea-8f14-13585fba842a admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:58.884500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f5b4f-c148-4aea-8f14-13585fba842a admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:58.884500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f5b4f-c148-4aea-8f14-13585fba842a admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:58.885189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f5b4f-c148-4aea-8f14-13585fba842a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:58.886654 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f5b4f-c148-4aea-8f14-13585fba842a admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:58.890692 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:58.898252 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c9c84-3d68-4a12-b795-31dcebdc518d admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:58.902266 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1290/2616] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:18:58.903932 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c88d4-c7e8-4266-8695-8d3ce1f67df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:58.904671 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c88d4-c7e8-4266-8695-8d3ce1f67df9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:58.907122 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c88d4-c7e8-4266-8695-8d3ce1f67df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:58.907122 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c88d4-c7e8-4266-8695-8d3ce1f67df9 admin admin] PATH_INFO: `/v3/projects/f643192831324f568c159155e869b781/users/48b0693fb682454d94fff802a9e6779b/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:58.911874 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f5b4f-c148-4aea-8f14-13585fba842a admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:58.924680 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f5b4f-c148-4aea-8f14-13585fba842a admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:58.925007 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c88d4-c7e8-4266-8695-8d3ce1f67df9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f643192831324f568c159155e869b781, user_id=48b0693fb682454d94fff802a9e6779b, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:58.930364 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec79f0-0f88-4dd4-b324-186f94e0c9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:58.931022 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c88d4-c7e8-4266-8695-8d3ce1f67df9 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:58.931227 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec79f0-0f88-4dd4-b324-186f94e0c9c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:58.931523 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec79f0-0f88-4dd4-b324-186f94e0c9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:58.931936 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec79f0-0f88-4dd4-b324-186f94e0c9c5 admin admin] PATH_INFO: `/v3/projects/0d0ae39e3212492fa49bebab6ceab875/users/0a867aaf6a824f1f8677bda6afa04367/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:58.934087 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec79f0-0f88-4dd4-b324-186f94e0c9c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d0ae39e3212492fa49bebab6ceab875, user_id=0a867aaf6a824f1f8677bda6afa04367, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:58.936821 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec79f0-0f88-4dd4-b324-186f94e0c9c5 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:58.949395 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1291/2617] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:18:58 2022] PUT /identity/v3/projects/0d0ae39e3212492fa49bebab6ceab875/users/0a867aaf6a824f1f8677bda6afa04367/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:18:58.962209 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45801c4-2bef-41be-9636-bd9f55ab98cf None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:58.964682 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:58.965389 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45801c4-2bef-41be-9636-bd9f55ab98cf None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:58.965955 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45801c4-2bef-41be-9636-bd9f55ab98cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:59.018177 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-e45801c4-2bef-41be-9636-bd9f55ab98cf None None] MFA Rules not processed for user `0a867aaf6a824f1f8677bda6afa04367`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:59.019069 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-e45801c4-2bef-41be-9636-bd9f55ab98cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:59.031123 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1327/2618] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:18:58 2022] PUT /identity/v3/projects/f643192831324f568c159155e869b781/users/48b0693fb682454d94fff802a9e6779b/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:18:59.044944 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a1cc9-c74d-48fd-8f72-ff7e16a59484 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:59.044944 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a1cc9-c74d-48fd-8f72-ff7e16a59484 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:59.045257 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a1cc9-c74d-48fd-8f72-ff7e16a59484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:59.086755 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-d13a1cc9-c74d-48fd-8f72-ff7e16a59484 None None] MFA Rules not processed for user `48b0693fb682454d94fff802a9e6779b`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:59.088017 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-d13a1cc9-c74d-48fd-8f72-ff7e16a59484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:59.120826 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1292/2619] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:58 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:18:59.135397 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45801c4-2bef-41be-9636-bd9f55ab98cf None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:59.183155 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1328/2620] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:18:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:59.187718 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a1cc9-c74d-48fd-8f72-ff7e16a59484 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:59.210739 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45801c4-2bef-41be-9636-bd9f55ab98cf None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:59.282499 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c941ffa-6495-4d64-8464-df1250031945 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:59.283219 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c941ffa-6495-4d64-8464-df1250031945 service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:59.283500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c941ffa-6495-4d64-8464-df1250031945 service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:59.283888 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c941ffa-6495-4d64-8464-df1250031945 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:59.305756 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a1cc9-c74d-48fd-8f72-ff7e16a59484 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:59.321298 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30cea9-d35c-445d-87fe-88d7af02da86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:59.321298 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30cea9-d35c-445d-87fe-88d7af02da86 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:59.321298 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30cea9-d35c-445d-87fe-88d7af02da86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:59.321298 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30cea9-d35c-445d-87fe-88d7af02da86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:59.321716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30cea9-d35c-445d-87fe-88d7af02da86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:59.321716 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30cea9-d35c-445d-87fe-88d7af02da86 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:59.362402 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c941ffa-6495-4d64-8464-df1250031945 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:59.363777 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c941ffa-6495-4d64-8464-df1250031945 service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:59.375124 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1293/2621] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:18:59 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:18:59.433107 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1329/2622] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:18:59 2022] POST /identity/v3/projects => generated 385 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:59.433373 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c941ffa-6495-4d64-8464-df1250031945 service cinder] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:59.434566 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-9c941ffa-6495-4d64-8464-df1250031945 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:59.437294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30cea9-d35c-445d-87fe-88d7af02da86 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:59.446599 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:59.449842 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c941ffa-6495-4d64-8464-df1250031945 service cinder] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:59.510973 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:59.518526 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a16a2-e069-4024-a67e-84bd90e86d00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:59.519288 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a16a2-e069-4024-a67e-84bd90e86d00 service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:59.519623 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a16a2-e069-4024-a67e-84bd90e86d00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:59.519952 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a16a2-e069-4024-a67e-84bd90e86d00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:59.600440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a16a2-e069-4024-a67e-84bd90e86d00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:59.602032 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a16a2-e069-4024-a67e-84bd90e86d00 service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:59.617897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1294/2623] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:18:59 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:18:59.673633 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30cea9-d35c-445d-87fe-88d7af02da86 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:59.679181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34c0f8-6150-4b3d-a80f-98e5d3ffd7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:59.679781 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34c0f8-6150-4b3d-a80f-98e5d3ffd7d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:59.680100 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34c0f8-6150-4b3d-a80f-98e5d3ffd7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:59.680414 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34c0f8-6150-4b3d-a80f-98e5d3ffd7d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:59.681099 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34c0f8-6150-4b3d-a80f-98e5d3ffd7d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:59.683548 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34c0f8-6150-4b3d-a80f-98e5d3ffd7d0 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:59.842698 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1330/2624] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:18:59 2022] POST /identity/v3/users => generated 299 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:59.846944 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a16a2-e069-4024-a67e-84bd90e86d00 service cinder] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:59.858965 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a16a2-e069-4024-a67e-84bd90e86d00 service cinder] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:59.864346 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f423ea-5d17-4f7f-b22d-7ec6043a085f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:59.865756 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f423ea-5d17-4f7f-b22d-7ec6043a085f admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:59.866009 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f423ea-5d17-4f7f-b22d-7ec6043a085f admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:59.866285 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f423ea-5d17-4f7f-b22d-7ec6043a085f admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:59.867048 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f423ea-5d17-4f7f-b22d-7ec6043a085f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:59.868836 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f423ea-5d17-4f7f-b22d-7ec6043a085f admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:59.881163 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1295/2625] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:18:59.885596 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34c0f8-6150-4b3d-a80f-98e5d3ffd7d0 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:59.897011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34c0f8-6150-4b3d-a80f-98e5d3ffd7d0 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:59.902631 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf99552-67dc-4dec-bcab-54d33d6578aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:59.903584 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf99552-67dc-4dec-bcab-54d33d6578aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:59.904040 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf99552-67dc-4dec-bcab-54d33d6578aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:59.912593 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf99552-67dc-4dec-bcab-54d33d6578aa admin admin] PATH_INFO: `/v3/projects/215f1d3f252b497380d63e20f42eb7a3/users/bdaafdb053584d6b924915c2d7dcd00f/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:59.923447 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf99552-67dc-4dec-bcab-54d33d6578aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=215f1d3f252b497380d63e20f42eb7a3, user_id=bdaafdb053584d6b924915c2d7dcd00f, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:59.926157 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf99552-67dc-4dec-bcab-54d33d6578aa admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:00.041055 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:00.047304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1331/2626] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:18:59 2022] PUT /identity/v3/projects/215f1d3f252b497380d63e20f42eb7a3/users/bdaafdb053584d6b924915c2d7dcd00f/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:00.051552 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f423ea-5d17-4f7f-b22d-7ec6043a085f admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:00.063069 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f423ea-5d17-4f7f-b22d-7ec6043a085f admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:00.133291 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd295e-3a94-41ab-9fc4-18e4e3ff608b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:00.134078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd295e-3a94-41ab-9fc4-18e4e3ff608b admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:00.136972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd295e-3a94-41ab-9fc4-18e4e3ff608b admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:00.136972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd295e-3a94-41ab-9fc4-18e4e3ff608b admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:00.136972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd295e-3a94-41ab-9fc4-18e4e3ff608b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:00.136972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd295e-3a94-41ab-9fc4-18e4e3ff608b admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:00.138554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:00.150038 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1296/2627] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:19:00.155057 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf99552-67dc-4dec-bcab-54d33d6578aa admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:00.167379 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf99552-67dc-4dec-bcab-54d33d6578aa admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:00.172350 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a2459-096c-4b68-8e46-e77305a02018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:00.173033 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a2459-096c-4b68-8e46-e77305a02018 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:00.173319 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a2459-096c-4b68-8e46-e77305a02018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:00.173583 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a2459-096c-4b68-8e46-e77305a02018 admin admin] PATH_INFO: `/v3/projects/215f1d3f252b497380d63e20f42eb7a3/users/bdaafdb053584d6b924915c2d7dcd00f/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:00.175728 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a2459-096c-4b68-8e46-e77305a02018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=215f1d3f252b497380d63e20f42eb7a3, user_id=bdaafdb053584d6b924915c2d7dcd00f, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:00.183853 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a2459-096c-4b68-8e46-e77305a02018 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:00.195598 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1332/2628] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:19:00 2022] PUT /identity/v3/projects/215f1d3f252b497380d63e20f42eb7a3/users/bdaafdb053584d6b924915c2d7dcd00f/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:00.206591 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd80e4c-30c8-44f6-89c8-1a7f9f4af696 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:00.206869 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd80e4c-30c8-44f6-89c8-1a7f9f4af696 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:00.207251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd80e4c-30c8-44f6-89c8-1a7f9f4af696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:00.248116 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-abd80e4c-30c8-44f6-89c8-1a7f9f4af696 None None] MFA Rules not processed for user `bdaafdb053584d6b924915c2d7dcd00f`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:00.250192 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-abd80e4c-30c8-44f6-89c8-1a7f9f4af696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:00.384028 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1297/2629] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:00.403775 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a2459-096c-4b68-8e46-e77305a02018 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:00.493037 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a2459-096c-4b68-8e46-e77305a02018 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:00.503388 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abafd2f-ec5e-465b-b289-70de8e445dfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:00.503388 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abafd2f-ec5e-465b-b289-70de8e445dfb service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:00.503388 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abafd2f-ec5e-465b-b289-70de8e445dfb service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:00.503388 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abafd2f-ec5e-465b-b289-70de8e445dfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:00.524779 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abafd2f-ec5e-465b-b289-70de8e445dfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:00.527868 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abafd2f-ec5e-465b-b289-70de8e445dfb service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:00.543041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1333/2630] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:19:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:19:01.738305 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd80e4c-30c8-44f6-89c8-1a7f9f4af696 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:01.838508 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd80e4c-30c8-44f6-89c8-1a7f9f4af696 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:01.854705 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36b696-67d4-42bf-abfc-1d8e7155a2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:01.854705 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36b696-67d4-42bf-abfc-1d8e7155a2ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:01.854705 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36b696-67d4-42bf-abfc-1d8e7155a2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:01.854705 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36b696-67d4-42bf-abfc-1d8e7155a2ab admin admin] PATH_INFO: `/v3/users/15f6c27d7c614539ae3a3813356db39e` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:01.858904 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be36b696-67d4-42bf-abfc-1d8e7155a2ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=15f6c27d7c614539ae3a3813356db39e)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:01.862536 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be36b696-67d4-42bf-abfc-1d8e7155a2ab admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:01.951563 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abafd2f-ec5e-465b-b289-70de8e445dfb service cinder] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:01.962643 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abafd2f-ec5e-465b-b289-70de8e445dfb service cinder] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:01.970171 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d120f-9b5c-481a-a2c7-996ab41e5df7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:01.971298 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d120f-9b5c-481a-a2c7-996ab41e5df7 service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:01.971840 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d120f-9b5c-481a-a2c7-996ab41e5df7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:01.972808 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d120f-9b5c-481a-a2c7-996ab41e5df7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:02.059513 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d120f-9b5c-481a-a2c7-996ab41e5df7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:02.061126 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d120f-9b5c-481a-a2c7-996ab41e5df7 service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:02.073997 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1334/2631] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:19:01 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:19:02.131884 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-be36b696-67d4-42bf-abfc-1d8e7155a2ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15f6c27d7c614539ae3a3813356db39e'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:02.146805 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-be36b696-67d4-42bf-abfc-1d8e7155a2ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15f6c27d7c614539ae3a3813356db39e'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:02.148045 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-be36b696-67d4-42bf-abfc-1d8e7155a2ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15f6c27d7c614539ae3a3813356db39e'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:02.226033 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-be36b696-67d4-42bf-abfc-1d8e7155a2ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15f6c27d7c614539ae3a3813356db39e'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:02.244717 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-be36b696-67d4-42bf-abfc-1d8e7155a2ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15f6c27d7c614539ae3a3813356db39e'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:02.247256 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:02.251776 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1298/2632] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:19:01 2022] DELETE /identity/v3/users/15f6c27d7c614539ae3a3813356db39e => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:02.257302 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf863d2-bfbc-4b41-88ea-2039152ec22b None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:02.257500 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf863d2-bfbc-4b41-88ea-2039152ec22b None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:02.257747 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf863d2-bfbc-4b41-88ea-2039152ec22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:02.282101 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-abf863d2-bfbc-4b41-88ea-2039152ec22b None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:02.283584 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-abf863d2-bfbc-4b41-88ea-2039152ec22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:02.378628 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1335/2633] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:02.395007 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36b696-67d4-42bf-abfc-1d8e7155a2ab admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:02.399337 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-be36b696-67d4-42bf-abfc-1d8e7155a2ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:02.517744 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36b696-67d4-42bf-abfc-1d8e7155a2ab admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:02.527209 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac85e47-5f25-4044-b48a-e975d58bb8f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:02.528381 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac85e47-5f25-4044-b48a-e975d58bb8f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:02.528697 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac85e47-5f25-4044-b48a-e975d58bb8f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:02.529046 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac85e47-5f25-4044-b48a-e975d58bb8f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:02.541620 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac85e47-5f25-4044-b48a-e975d58bb8f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:02.543356 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac85e47-5f25-4044-b48a-e975d58bb8f7 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:02.556715 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1299/2634] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:19:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:19:03.329098 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf863d2-bfbc-4b41-88ea-2039152ec22b None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:03.330790 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-abf863d2-bfbc-4b41-88ea-2039152ec22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:03.347724 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf863d2-bfbc-4b41-88ea-2039152ec22b None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:03.353916 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31556f3b-8bb8-46c5-ad1c-2caabd435712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:03.354644 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31556f3b-8bb8-46c5-ad1c-2caabd435712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:03.355438 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31556f3b-8bb8-46c5-ad1c-2caabd435712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:03.355438 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31556f3b-8bb8-46c5-ad1c-2caabd435712 admin admin] PATH_INFO: `/v3/projects/9d424b1ac2da4cff98bb47356be20f73` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:03.356627 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31556f3b-8bb8-46c5-ad1c-2caabd435712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d424b1ac2da4cff98bb47356be20f73)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:03.358611 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31556f3b-8bb8-46c5-ad1c-2caabd435712 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:03.385602 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:03.497629 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-31556f3b-8bb8-46c5-ad1c-2caabd435712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d424b1ac2da4cff98bb47356be20f73', 'request_id': 'req-31556f3b-8bb8-46c5-ad1c-2caabd435712'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:03.583873 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-31556f3b-8bb8-46c5-ad1c-2caabd435712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d424b1ac2da4cff98bb47356be20f73', 'request_id': 'req-31556f3b-8bb8-46c5-ad1c-2caabd435712'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:03.596380 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-31556f3b-8bb8-46c5-ad1c-2caabd435712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d424b1ac2da4cff98bb47356be20f73', 'request_id': 'req-31556f3b-8bb8-46c5-ad1c-2caabd435712'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:03.613378 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-31556f3b-8bb8-46c5-ad1c-2caabd435712 admin admin] The token cache is being invalidate because project 9d424b1ac2da4cff98bb47356be20f73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:19:03.613378 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-31556f3b-8bb8-46c5-ad1c-2caabd435712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:03.614221 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-31556f3b-8bb8-46c5-ad1c-2caabd435712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:03.617130 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1336/2635] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:19:03 2022] DELETE /identity/v3/projects/9d424b1ac2da4cff98bb47356be20f73 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:19:03.623776 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff63f1-df45-409f-9b83-3501cc95a9b6 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:03.624425 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff63f1-df45-409f-9b83-3501cc95a9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:03.624425 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff63f1-df45-409f-9b83-3501cc95a9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:03.646485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-46ff63f1-df45-409f-9b83-3501cc95a9b6 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:03.647821 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-46ff63f1-df45-409f-9b83-3501cc95a9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:03.721494 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1300/2636] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:03.731655 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bca952-49c9-4bd8-8cde-f127f782d227 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:03.731940 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bca952-49c9-4bd8-8cde-f127f782d227 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:03.732245 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bca952-49c9-4bd8-8cde-f127f782d227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:03.758916 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-85bca952-49c9-4bd8-8cde-f127f782d227 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:03.760246 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-85bca952-49c9-4bd8-8cde-f127f782d227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:03.773515 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1337/2637] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:03.774463 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff63f1-df45-409f-9b83-3501cc95a9b6 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:03.788111 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff63f1-df45-409f-9b83-3501cc95a9b6 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:03.793059 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47391c7f-ea3c-41fd-b9d4-d31b2aa6b476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:03.793686 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47391c7f-ea3c-41fd-b9d4-d31b2aa6b476 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:03.793968 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47391c7f-ea3c-41fd-b9d4-d31b2aa6b476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:03.794236 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47391c7f-ea3c-41fd-b9d4-d31b2aa6b476 admin admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:03.794933 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47391c7f-ea3c-41fd-b9d4-d31b2aa6b476 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:19:03.795229 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47391c7f-ea3c-41fd-b9d4-d31b2aa6b476 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:03.796871 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47391c7f-ea3c-41fd-b9d4-d31b2aa6b476 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:03.812258 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1301/2638] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:19:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:19:03.816353 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bca952-49c9-4bd8-8cde-f127f782d227 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:03.827251 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bca952-49c9-4bd8-8cde-f127f782d227 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:03.835987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863211d-7f91-4f10-8eb0-d01106bf0c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:03.835987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863211d-7f91-4f10-8eb0-d01106bf0c4d admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:03.835987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863211d-7f91-4f10-8eb0-d01106bf0c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:03.835987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863211d-7f91-4f10-8eb0-d01106bf0c4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:03.836488 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863211d-7f91-4f10-8eb0-d01106bf0c4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:03.837539 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863211d-7f91-4f10-8eb0-d01106bf0c4d admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:03.999076 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1338/2639] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:19:03 2022] POST /identity/v3/projects => generated 371 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:19:04.000996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47391c7f-ea3c-41fd-b9d4-d31b2aa6b476 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:04.014112 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47391c7f-ea3c-41fd-b9d4-d31b2aa6b476 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:04.096479 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1c10f-f8b1-4601-99c0-d25b681c5d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:04.097227 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1c10f-f8b1-4601-99c0-d25b681c5d0d admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:04.097514 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1c10f-f8b1-4601-99c0-d25b681c5d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:04.097787 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1c10f-f8b1-4601-99c0-d25b681c5d0d admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:04.098481 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1c10f-f8b1-4601-99c0-d25b681c5d0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:04.101034 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1c10f-f8b1-4601-99c0-d25b681c5d0d admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:04.205363 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1302/2640] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:19:03 2022] POST /identity/v3/users => generated 286 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:19:04.211001 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863211d-7f91-4f10-8eb0-d01106bf0c4d admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:04.223809 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863211d-7f91-4f10-8eb0-d01106bf0c4d admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:04.229790 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31919828-47d7-470b-993d-955b957e491d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:04.233900 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31919828-47d7-470b-993d-955b957e491d admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:04.233900 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31919828-47d7-470b-993d-955b957e491d admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:04.233900 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31919828-47d7-470b-993d-955b957e491d admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:04.233900 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31919828-47d7-470b-993d-955b957e491d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:04.234471 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31919828-47d7-470b-993d-955b957e491d admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:04.247310 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1339/2641] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:19:04.253037 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1c10f-f8b1-4601-99c0-d25b681c5d0d admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:04.265904 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1c10f-f8b1-4601-99c0-d25b681c5d0d admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:04.272676 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfc722-f7fe-4bcf-8557-f9f4774a2587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:04.273369 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfc722-f7fe-4bcf-8557-f9f4774a2587 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:04.273854 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfc722-f7fe-4bcf-8557-f9f4774a2587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:04.274028 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfc722-f7fe-4bcf-8557-f9f4774a2587 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:04.274624 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbfc722-f7fe-4bcf-8557-f9f4774a2587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:04.276438 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbfc722-f7fe-4bcf-8557-f9f4774a2587 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:04.299311 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1303/2642] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:19:04.303623 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31919828-47d7-470b-993d-955b957e491d admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:04.325181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31919828-47d7-470b-993d-955b957e491d admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:04.330952 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82387cf3-21bd-4ed5-a794-e4818a901b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:04.331977 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82387cf3-21bd-4ed5-a794-e4818a901b2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:04.333414 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82387cf3-21bd-4ed5-a794-e4818a901b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:04.333542 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82387cf3-21bd-4ed5-a794-e4818a901b2a admin admin] PATH_INFO: `/v3/projects/02b4eb99994c46ff8dcaf4c6478d7b0f/users/6450c906008d492bb547148d274909bd/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:04.372846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82387cf3-21bd-4ed5-a794-e4818a901b2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b4eb99994c46ff8dcaf4c6478d7b0f, user_id=6450c906008d492bb547148d274909bd, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:04.379305 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82387cf3-21bd-4ed5-a794-e4818a901b2a admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:04.511736 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1340/2643] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:19:04 2022] PUT /identity/v3/projects/02b4eb99994c46ff8dcaf4c6478d7b0f/users/6450c906008d492bb547148d274909bd/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:04.523015 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485c681-570d-4adb-a66b-a50235a4dd92 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:04.523351 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485c681-570d-4adb-a66b-a50235a4dd92 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:04.523574 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485c681-570d-4adb-a66b-a50235a4dd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:04.544596 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:04.555118 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-8485c681-570d-4adb-a66b-a50235a4dd92 None None] MFA Rules not processed for user `6450c906008d492bb547148d274909bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:04.556342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-8485c681-570d-4adb-a66b-a50235a4dd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:04.638798 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1304/2644] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:04.658177 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82387cf3-21bd-4ed5-a794-e4818a901b2a admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:04.660102 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-82387cf3-21bd-4ed5-a794-e4818a901b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:04.736398 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82387cf3-21bd-4ed5-a794-e4818a901b2a admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:04.740884 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaeb497-ba7b-46ab-80bd-7baaeecd641b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca8afe2c10f4db58716aacfd373504b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:04.741510 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaeb497-ba7b-46ab-80bd-7baaeecd641b service glance] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:04.741790 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaeb497-ba7b-46ab-80bd-7baaeecd641b service glance] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:04.742067 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaeb497-ba7b-46ab-80bd-7baaeecd641b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:04.750970 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaeb497-ba7b-46ab-80bd-7baaeecd641b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:04.752469 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaeb497-ba7b-46ab-80bd-7baaeecd641b service glance] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:04.763299 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1341/2645] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:19:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:19:05.467335 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485c681-570d-4adb-a66b-a50235a4dd92 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:05.469109 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-8485c681-570d-4adb-a66b-a50235a4dd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:05.569345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485c681-570d-4adb-a66b-a50235a4dd92 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:05.576014 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04a1fd-7217-4c28-973d-226bf03f5a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:05.576707 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04a1fd-7217-4c28-973d-226bf03f5a1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:05.576992 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04a1fd-7217-4c28-973d-226bf03f5a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:05.577270 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04a1fd-7217-4c28-973d-226bf03f5a1c admin admin] PATH_INFO: `/v3/users/62d742554c964058ac17745ba81fdd2b` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:05.578727 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04a1fd-7217-4c28-973d-226bf03f5a1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=62d742554c964058ac17745ba81fdd2b)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:05.580722 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04a1fd-7217-4c28-973d-226bf03f5a1c admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:05.833866 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4b04a1fd-7217-4c28-973d-226bf03f5a1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62d742554c964058ac17745ba81fdd2b'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:05.846283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4b04a1fd-7217-4c28-973d-226bf03f5a1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62d742554c964058ac17745ba81fdd2b'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:05.865557 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4b04a1fd-7217-4c28-973d-226bf03f5a1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62d742554c964058ac17745ba81fdd2b'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:06.064203 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4b04a1fd-7217-4c28-973d-226bf03f5a1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62d742554c964058ac17745ba81fdd2b'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:06.080497 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-4b04a1fd-7217-4c28-973d-226bf03f5a1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62d742554c964058ac17745ba81fdd2b'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:06.087189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1305/2646] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:19:05 2022] DELETE /identity/v3/users/62d742554c964058ac17745ba81fdd2b => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:06.092737 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f3812-c4af-4ad9-8fb6-1b017450175c None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:06.093229 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f3812-c4af-4ad9-8fb6-1b017450175c None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:06.093428 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f3812-c4af-4ad9-8fb6-1b017450175c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:06.114850 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-0f9f3812-c4af-4ad9-8fb6-1b017450175c None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:06.116065 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-0f9f3812-c4af-4ad9-8fb6-1b017450175c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:06.169247 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:06.185582 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1342/2647] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:06.196244 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04a1fd-7217-4c28-973d-226bf03f5a1c admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:06.197770 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-4b04a1fd-7217-4c28-973d-226bf03f5a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:06.220663 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:06.268701 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04a1fd-7217-4c28-973d-226bf03f5a1c admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:06.272683 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eeaa0b-63f0-4dba-a7dd-d6cce7c24ac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:06.273332 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eeaa0b-63f0-4dba-a7dd-d6cce7c24ac0 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:06.273598 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eeaa0b-63f0-4dba-a7dd-d6cce7c24ac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:06.273883 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eeaa0b-63f0-4dba-a7dd-d6cce7c24ac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:06.288002 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eeaa0b-63f0-4dba-a7dd-d6cce7c24ac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:06.292883 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eeaa0b-63f0-4dba-a7dd-d6cce7c24ac0 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:06.311054 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1306/2648] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:19:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:19:06.813852 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f3812-c4af-4ad9-8fb6-1b017450175c None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:06.819804 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-0f9f3812-c4af-4ad9-8fb6-1b017450175c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:06.845740 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f3812-c4af-4ad9-8fb6-1b017450175c None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:06.854562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4a68a-8e0a-479b-a8eb-336e6dbcdad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:06.854562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4a68a-8e0a-479b-a8eb-336e6dbcdad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:06.854562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4a68a-8e0a-479b-a8eb-336e6dbcdad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:06.854562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4a68a-8e0a-479b-a8eb-336e6dbcdad3 admin admin] PATH_INFO: `/v3/projects/1b36709584314fc0a47ef6f1c8237137` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:06.858329 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4a68a-8e0a-479b-a8eb-336e6dbcdad3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b36709584314fc0a47ef6f1c8237137)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:06.858329 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4a68a-8e0a-479b-a8eb-336e6dbcdad3 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:06.979430 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-cfb4a68a-8e0a-479b-a8eb-336e6dbcdad3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b36709584314fc0a47ef6f1c8237137', 'request_id': 'req-cfb4a68a-8e0a-479b-a8eb-336e6dbcdad3'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:07.047023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-cfb4a68a-8e0a-479b-a8eb-336e6dbcdad3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b36709584314fc0a47ef6f1c8237137', 'request_id': 'req-cfb4a68a-8e0a-479b-a8eb-336e6dbcdad3'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:07.053797 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-cfb4a68a-8e0a-479b-a8eb-336e6dbcdad3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b36709584314fc0a47ef6f1c8237137', 'request_id': 'req-cfb4a68a-8e0a-479b-a8eb-336e6dbcdad3'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:07.066285 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-cfb4a68a-8e0a-479b-a8eb-336e6dbcdad3 admin admin] The token cache is being invalidate because project 1b36709584314fc0a47ef6f1c8237137 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:19:07.066662 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-cfb4a68a-8e0a-479b-a8eb-336e6dbcdad3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:07.067906 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-cfb4a68a-8e0a-479b-a8eb-336e6dbcdad3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:07.069634 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1343/2649] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:19:06 2022] DELETE /identity/v3/projects/1b36709584314fc0a47ef6f1c8237137 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:07.076441 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eeaa0b-63f0-4dba-a7dd-d6cce7c24ac0 service neutron] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:07.086062 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eeaa0b-63f0-4dba-a7dd-d6cce7c24ac0 service neutron] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:07.154303 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab901398-e395-4c10-8d73-ecbdffa12914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:07.155125 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab901398-e395-4c10-8d73-ecbdffa12914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:07.156536 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab901398-e395-4c10-8d73-ecbdffa12914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:07.156842 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab901398-e395-4c10-8d73-ecbdffa12914 admin admin] PATH_INFO: `/v3/users/0a867aaf6a824f1f8677bda6afa04367` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:07.158261 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab901398-e395-4c10-8d73-ecbdffa12914 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a867aaf6a824f1f8677bda6afa04367)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:07.160370 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab901398-e395-4c10-8d73-ecbdffa12914 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:07.406529 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-ab901398-e395-4c10-8d73-ecbdffa12914 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a867aaf6a824f1f8677bda6afa04367'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:07.423495 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-ab901398-e395-4c10-8d73-ecbdffa12914 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a867aaf6a824f1f8677bda6afa04367'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:07.424305 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-ab901398-e395-4c10-8d73-ecbdffa12914 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a867aaf6a824f1f8677bda6afa04367'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:07.499865 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-ab901398-e395-4c10-8d73-ecbdffa12914 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a867aaf6a824f1f8677bda6afa04367'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:07.516120 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-ab901398-e395-4c10-8d73-ecbdffa12914 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a867aaf6a824f1f8677bda6afa04367'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:07.524109 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1307/2650] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:19:07 2022] DELETE /identity/v3/users/0a867aaf6a824f1f8677bda6afa04367 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:07.728370 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4a68a-8e0a-479b-a8eb-336e6dbcdad3 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:07.729993 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-cfb4a68a-8e0a-479b-a8eb-336e6dbcdad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:07.809106 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4a68a-8e0a-479b-a8eb-336e6dbcdad3 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:07.874679 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f87888-78a1-4146-bf17-b1bb3fe2621e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:07.875813 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f87888-78a1-4146-bf17-b1bb3fe2621e service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:07.876311 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f87888-78a1-4146-bf17-b1bb3fe2621e service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:07.876835 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f87888-78a1-4146-bf17-b1bb3fe2621e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:07.880273 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-b0f87888-78a1-4146-bf17-b1bb3fe2621e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:07.985849 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:08.003652 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f87888-78a1-4146-bf17-b1bb3fe2621e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:08.005377 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f87888-78a1-4146-bf17-b1bb3fe2621e service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:08.015435 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1344/2651] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:19:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:19:08.095268 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab901398-e395-4c10-8d73-ecbdffa12914 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:08.097440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-ab901398-e395-4c10-8d73-ecbdffa12914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:08.168370 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:08.196857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab901398-e395-4c10-8d73-ecbdffa12914 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:08.201650 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2b7f9-0d00-42f2-b0b7-ef36dbb53fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:08.202311 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2b7f9-0d00-42f2-b0b7-ef36dbb53fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:08.202594 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2b7f9-0d00-42f2-b0b7-ef36dbb53fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:08.202869 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2b7f9-0d00-42f2-b0b7-ef36dbb53fbf admin admin] PATH_INFO: `/v3/projects/0d0ae39e3212492fa49bebab6ceab875` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:08.204028 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2b7f9-0d00-42f2-b0b7-ef36dbb53fbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d0ae39e3212492fa49bebab6ceab875)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:08.206234 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2b7f9-0d00-42f2-b0b7-ef36dbb53fbf admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:08.347869 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5ab2b7f9-0d00-42f2-b0b7-ef36dbb53fbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d0ae39e3212492fa49bebab6ceab875', 'request_id': 'req-5ab2b7f9-0d00-42f2-b0b7-ef36dbb53fbf'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:08.356107 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5ab2b7f9-0d00-42f2-b0b7-ef36dbb53fbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d0ae39e3212492fa49bebab6ceab875', 'request_id': 'req-5ab2b7f9-0d00-42f2-b0b7-ef36dbb53fbf'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:08.363273 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5ab2b7f9-0d00-42f2-b0b7-ef36dbb53fbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d0ae39e3212492fa49bebab6ceab875', 'request_id': 'req-5ab2b7f9-0d00-42f2-b0b7-ef36dbb53fbf'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:08.471362 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5ab2b7f9-0d00-42f2-b0b7-ef36dbb53fbf admin admin] The token cache is being invalidate because project 0d0ae39e3212492fa49bebab6ceab875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:19:08.471664 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5ab2b7f9-0d00-42f2-b0b7-ef36dbb53fbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:08.472389 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-5ab2b7f9-0d00-42f2-b0b7-ef36dbb53fbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:08.477639 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1308/2652] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:19:08 2022] DELETE /identity/v3/projects/0d0ae39e3212492fa49bebab6ceab875 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:08.486108 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174c237-c452-4f2d-9efa-7a089dded539 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:08.486454 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174c237-c452-4f2d-9efa-7a089dded539 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:08.486775 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174c237-c452-4f2d-9efa-7a089dded539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:08.521436 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-f174c237-c452-4f2d-9efa-7a089dded539 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:08.522839 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-f174c237-c452-4f2d-9efa-7a089dded539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:08.605062 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1345/2653] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:08.613869 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448a4f7-012b-4aef-9a20-c3cd2f110083 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:08.614270 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448a4f7-012b-4aef-9a20-c3cd2f110083 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:08.614726 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448a4f7-012b-4aef-9a20-c3cd2f110083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:08.640342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-0448a4f7-012b-4aef-9a20-c3cd2f110083 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:08.642392 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-0448a4f7-012b-4aef-9a20-c3cd2f110083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:08.653974 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1309/2654] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:08.660379 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174c237-c452-4f2d-9efa-7a089dded539 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:08.669551 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174c237-c452-4f2d-9efa-7a089dded539 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:08.674245 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d4f69-e31c-4d1d-beb7-ac8a4b85f07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:08.674875 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d4f69-e31c-4d1d-beb7-ac8a4b85f07d admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:08.675158 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d4f69-e31c-4d1d-beb7-ac8a4b85f07d admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:08.675433 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d4f69-e31c-4d1d-beb7-ac8a4b85f07d admin admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:08.676193 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d4f69-e31c-4d1d-beb7-ac8a4b85f07d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:19:08.676500 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d4f69-e31c-4d1d-beb7-ac8a4b85f07d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:08.678352 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d4f69-e31c-4d1d-beb7-ac8a4b85f07d admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:08.692118 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1346/2655] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:19:08.699445 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448a4f7-012b-4aef-9a20-c3cd2f110083 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:08.711365 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448a4f7-012b-4aef-9a20-c3cd2f110083 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:08.716886 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb010c-fc33-4d17-8c6a-3bc024bf8783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:08.717597 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb010c-fc33-4d17-8c6a-3bc024bf8783 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:08.717897 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb010c-fc33-4d17-8c6a-3bc024bf8783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:08.718184 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb010c-fc33-4d17-8c6a-3bc024bf8783 admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:08.718878 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb010c-fc33-4d17-8c6a-3bc024bf8783 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:08.721211 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb010c-fc33-4d17-8c6a-3bc024bf8783 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:08.889791 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1310/2656] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:19:08 2022] POST /identity/v3/projects => generated 381 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:19:08.894223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d4f69-e31c-4d1d-beb7-ac8a4b85f07d admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:08.906057 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d4f69-e31c-4d1d-beb7-ac8a4b85f07d admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:08.975000 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0c1d9-2adc-4b7c-8139-e9766d8f9c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:08.975700 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0c1d9-2adc-4b7c-8139-e9766d8f9c5a admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:08.976025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0c1d9-2adc-4b7c-8139-e9766d8f9c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:08.976338 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0c1d9-2adc-4b7c-8139-e9766d8f9c5a admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:08.977351 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0c1d9-2adc-4b7c-8139-e9766d8f9c5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:08.979278 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0c1d9-2adc-4b7c-8139-e9766d8f9c5a admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:09.094560 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1347/2657] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:19:08 2022] POST /identity/v3/users => generated 291 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:19:09.099043 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb010c-fc33-4d17-8c6a-3bc024bf8783 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:09.111072 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb010c-fc33-4d17-8c6a-3bc024bf8783 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:09.116743 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bfda6f-f72d-4359-86a1-ecbb43e43fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:09.117563 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfda6f-f72d-4359-86a1-ecbb43e43fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:09.117955 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfda6f-f72d-4359-86a1-ecbb43e43fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:09.118342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfda6f-f72d-4359-86a1-ecbb43e43fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:09.119129 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bfda6f-f72d-4359-86a1-ecbb43e43fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:09.121361 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bfda6f-f72d-4359-86a1-ecbb43e43fa6 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:09.135485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1311/2658] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:19:09.140420 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0c1d9-2adc-4b7c-8139-e9766d8f9c5a admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:09.151312 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0c1d9-2adc-4b7c-8139-e9766d8f9c5a admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:09.156208 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd45e5-e2a3-4607-bb47-40fb50fe53bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:09.156845 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd45e5-e2a3-4607-bb47-40fb50fe53bb admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:09.159171 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd45e5-e2a3-4607-bb47-40fb50fe53bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:09.159171 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd45e5-e2a3-4607-bb47-40fb50fe53bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:09.159171 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd45e5-e2a3-4607-bb47-40fb50fe53bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:09.159732 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd45e5-e2a3-4607-bb47-40fb50fe53bb admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:09.171174 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1348/2659] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:19:09.177810 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bfda6f-f72d-4359-86a1-ecbb43e43fa6 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:09.191866 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bfda6f-f72d-4359-86a1-ecbb43e43fa6 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:09.200391 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e527506-40e7-4505-b0d4-6342b453011b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:09.201088 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e527506-40e7-4505-b0d4-6342b453011b admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:09.201372 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e527506-40e7-4505-b0d4-6342b453011b admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:09.201655 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e527506-40e7-4505-b0d4-6342b453011b admin admin] PATH_INFO: `/v3/projects/1ede731e5e744fd7bb17d528e17180e0/users/fe3d60a70bbc4f19b10156133b402160/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:09.217956 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e527506-40e7-4505-b0d4-6342b453011b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ede731e5e744fd7bb17d528e17180e0, user_id=fe3d60a70bbc4f19b10156133b402160, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:09.220686 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e527506-40e7-4505-b0d4-6342b453011b admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:09.322528 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1312/2660] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:19:09 2022] PUT /identity/v3/projects/1ede731e5e744fd7bb17d528e17180e0/users/fe3d60a70bbc4f19b10156133b402160/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:09.340611 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d35f0-eaff-426c-8595-d00d6892f708 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:09.340932 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d35f0-eaff-426c-8595-d00d6892f708 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:09.341175 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d35f0-eaff-426c-8595-d00d6892f708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:09.376278 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-e69d35f0-eaff-426c-8595-d00d6892f708 None None] MFA Rules not processed for user `fe3d60a70bbc4f19b10156133b402160`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:09.377573 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-e69d35f0-eaff-426c-8595-d00d6892f708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:09.422312 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:09.455462 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1349/2661] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:09.467270 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e527506-40e7-4505-b0d4-6342b453011b admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:09.546416 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e527506-40e7-4505-b0d4-6342b453011b admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:09.552756 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ae4e3-1f53-4f6f-90c7-5e7870b6a4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:09.553747 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ae4e3-1f53-4f6f-90c7-5e7870b6a4e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:09.555835 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ae4e3-1f53-4f6f-90c7-5e7870b6a4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:09.555835 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ae4e3-1f53-4f6f-90c7-5e7870b6a4e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:09.555835 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0ae4e3-1f53-4f6f-90c7-5e7870b6a4e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:09.561553 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0ae4e3-1f53-4f6f-90c7-5e7870b6a4e0 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:09.575250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:09.665024 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1313/2662] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:19:09 2022] POST /identity/v3/projects => generated 383 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:19:09.666443 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d35f0-eaff-426c-8595-d00d6892f708 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:09.678648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d35f0-eaff-426c-8595-d00d6892f708 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:09.766514 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d09f3-5fe6-456d-aed7-82b3be54b0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:09.767541 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d09f3-5fe6-456d-aed7-82b3be54b0f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:09.767910 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d09f3-5fe6-456d-aed7-82b3be54b0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:09.768228 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d09f3-5fe6-456d-aed7-82b3be54b0f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:09.768971 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d09f3-5fe6-456d-aed7-82b3be54b0f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:09.771479 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d09f3-5fe6-456d-aed7-82b3be54b0f9 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:09.930208 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1350/2663] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:19:09 2022] POST /identity/v3/users => generated 298 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:19:09.934275 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ae4e3-1f53-4f6f-90c7-5e7870b6a4e0 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:09.945411 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ae4e3-1f53-4f6f-90c7-5e7870b6a4e0 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:09.950345 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83486ef2-a127-406a-b0ca-568f8fb7831c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:09.951134 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83486ef2-a127-406a-b0ca-568f8fb7831c admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:09.951600 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83486ef2-a127-406a-b0ca-568f8fb7831c admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:09.951877 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83486ef2-a127-406a-b0ca-568f8fb7831c admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:09.952728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83486ef2-a127-406a-b0ca-568f8fb7831c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:09.954569 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83486ef2-a127-406a-b0ca-568f8fb7831c admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:09.967206 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1314/2664] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:19:09.972402 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d09f3-5fe6-456d-aed7-82b3be54b0f9 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:09.987215 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d09f3-5fe6-456d-aed7-82b3be54b0f9 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:09.992954 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048967a-8db4-4bfa-94df-660d3bbd4b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:09.993597 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048967a-8db4-4bfa-94df-660d3bbd4b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:09.993881 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048967a-8db4-4bfa-94df-660d3bbd4b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:09.994156 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048967a-8db4-4bfa-94df-660d3bbd4b94 admin admin] PATH_INFO: `/v3/projects/85cb7af040a6443597dd6168173b798c/users/be5d1f45ccba41f8ab1a531ac405c8c3/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:10.014240 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048967a-8db4-4bfa-94df-660d3bbd4b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85cb7af040a6443597dd6168173b798c, user_id=be5d1f45ccba41f8ab1a531ac405c8c3, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:10.017377 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048967a-8db4-4bfa-94df-660d3bbd4b94 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:10.086590 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1351/2665] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:19:09 2022] PUT /identity/v3/projects/85cb7af040a6443597dd6168173b798c/users/be5d1f45ccba41f8ab1a531ac405c8c3/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:10.092099 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83486ef2-a127-406a-b0ca-568f8fb7831c admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:10.104210 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83486ef2-a127-406a-b0ca-568f8fb7831c admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:10.168412 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee37db-2cd4-40c0-bc1c-72fb6df708e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:10.169420 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee37db-2cd4-40c0-bc1c-72fb6df708e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:10.169843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee37db-2cd4-40c0-bc1c-72fb6df708e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:10.170218 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee37db-2cd4-40c0-bc1c-72fb6df708e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:10.171114 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee37db-2cd4-40c0-bc1c-72fb6df708e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:10.173117 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee37db-2cd4-40c0-bc1c-72fb6df708e5 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:10.186216 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1315/2666] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:19:10.191851 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048967a-8db4-4bfa-94df-660d3bbd4b94 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:10.203429 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048967a-8db4-4bfa-94df-660d3bbd4b94 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:10.209243 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef990767-7b7b-4942-b669-8283f0c29695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:10.209986 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef990767-7b7b-4942-b669-8283f0c29695 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:10.210269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef990767-7b7b-4942-b669-8283f0c29695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:10.210547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef990767-7b7b-4942-b669-8283f0c29695 admin admin] PATH_INFO: `/v3/projects/85cb7af040a6443597dd6168173b798c/users/be5d1f45ccba41f8ab1a531ac405c8c3/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:10.213209 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef990767-7b7b-4942-b669-8283f0c29695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85cb7af040a6443597dd6168173b798c, user_id=be5d1f45ccba41f8ab1a531ac405c8c3, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:10.215930 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef990767-7b7b-4942-b669-8283f0c29695 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:10.228833 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1352/2667] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:19:10 2022] PUT /identity/v3/projects/85cb7af040a6443597dd6168173b798c/users/be5d1f45ccba41f8ab1a531ac405c8c3/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:10.241117 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde561b2-0d7f-45a0-928a-39a4ca93555c None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:10.241418 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde561b2-0d7f-45a0-928a-39a4ca93555c None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:10.241746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde561b2-0d7f-45a0-928a-39a4ca93555c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:10.277782 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-fde561b2-0d7f-45a0-928a-39a4ca93555c None None] MFA Rules not processed for user `be5d1f45ccba41f8ab1a531ac405c8c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:10.279319 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-fde561b2-0d7f-45a0-928a-39a4ca93555c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:10.367444 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1316/2668] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:10.379445 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef990767-7b7b-4942-b669-8283f0c29695 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:10.381832 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-ef990767-7b7b-4942-b669-8283f0c29695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:10.454682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef990767-7b7b-4942-b669-8283f0c29695 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:10.459355 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b2c33-9e99-4cf2-b4eb-884aa99c5df7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:10.462572 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b2c33-9e99-4cf2-b4eb-884aa99c5df7 service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:10.462572 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b2c33-9e99-4cf2-b4eb-884aa99c5df7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:10.462572 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b2c33-9e99-4cf2-b4eb-884aa99c5df7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:10.471410 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b2c33-9e99-4cf2-b4eb-884aa99c5df7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:10.474225 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b2c33-9e99-4cf2-b4eb-884aa99c5df7 service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:10.487960 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1353/2669] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:19:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:19:10.627858 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde561b2-0d7f-45a0-928a-39a4ca93555c None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:10.638936 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde561b2-0d7f-45a0-928a-39a4ca93555c None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:10.643309 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454e525-8788-47ee-9907-836dce54be15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:10.643626 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454e525-8788-47ee-9907-836dce54be15 service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:10.643913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454e525-8788-47ee-9907-836dce54be15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:10.652885 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454e525-8788-47ee-9907-836dce54be15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:10.737041 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5454e525-8788-47ee-9907-836dce54be15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:10.737041 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5454e525-8788-47ee-9907-836dce54be15 service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:10.738626 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:10.744727 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1317/2670] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:19:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:19:11.409316 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b2c33-9e99-4cf2-b4eb-884aa99c5df7 service cinder] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:11.450148 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:11.479764 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b2c33-9e99-4cf2-b4eb-884aa99c5df7 service cinder] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:11.485258 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd6463-0233-4845-b428-33b2ec3d899a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:11.486037 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd6463-0233-4845-b428-33b2ec3d899a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:11.486301 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd6463-0233-4845-b428-33b2ec3d899a admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:11.486574 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd6463-0233-4845-b428-33b2ec3d899a admin admin] PATH_INFO: `/v3/users/fe3d60a70bbc4f19b10156133b402160` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:11.487934 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd6463-0233-4845-b428-33b2ec3d899a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe3d60a70bbc4f19b10156133b402160)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:11.490742 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd6463-0233-4845-b428-33b2ec3d899a admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:11.715059 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-48dd6463-0233-4845-b428-33b2ec3d899a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe3d60a70bbc4f19b10156133b402160'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:11.893869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-48dd6463-0233-4845-b428-33b2ec3d899a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe3d60a70bbc4f19b10156133b402160'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:11.905229 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-48dd6463-0233-4845-b428-33b2ec3d899a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe3d60a70bbc4f19b10156133b402160'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:11.905985 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-48dd6463-0233-4845-b428-33b2ec3d899a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe3d60a70bbc4f19b10156133b402160'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:11.906642 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-48dd6463-0233-4845-b428-33b2ec3d899a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe3d60a70bbc4f19b10156133b402160'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:11.927983 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1354/2671] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:19:11 2022] DELETE /identity/v3/users/fe3d60a70bbc4f19b10156133b402160 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:11.933099 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9dcea6-12f1-4d86-b1ae-364ef2caa76a None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:11.933683 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9dcea6-12f1-4d86-b1ae-364ef2caa76a None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:11.933683 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9dcea6-12f1-4d86-b1ae-364ef2caa76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:11.956779 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-9c9dcea6-12f1-4d86-b1ae-364ef2caa76a None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:11.958540 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-9c9dcea6-12f1-4d86-b1ae-364ef2caa76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:12.034210 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1318/2672] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:12.046173 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd6463-0233-4845-b428-33b2ec3d899a admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:12.047694 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-48dd6463-0233-4845-b428-33b2ec3d899a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:12.118624 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd6463-0233-4845-b428-33b2ec3d899a admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:12.123440 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d3d41-a31c-4ec6-8f3c-ef2ef4f97a06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:12.124087 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d3d41-a31c-4ec6-8f3c-ef2ef4f97a06 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:12.124805 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d3d41-a31c-4ec6-8f3c-ef2ef4f97a06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:12.124805 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d3d41-a31c-4ec6-8f3c-ef2ef4f97a06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:12.135392 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d3d41-a31c-4ec6-8f3c-ef2ef4f97a06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:12.137366 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d3d41-a31c-4ec6-8f3c-ef2ef4f97a06 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:12.148902 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1355/2673] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:19:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:19:12.586005 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9dcea6-12f1-4d86-b1ae-364ef2caa76a None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:12.588001 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-9c9dcea6-12f1-4d86-b1ae-364ef2caa76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:12.600842 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9dcea6-12f1-4d86-b1ae-364ef2caa76a None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:12.605974 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217db164-2a1e-4a6b-8435-53c2a95d088b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:12.606867 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217db164-2a1e-4a6b-8435-53c2a95d088b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:12.607158 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217db164-2a1e-4a6b-8435-53c2a95d088b admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:12.607440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217db164-2a1e-4a6b-8435-53c2a95d088b admin admin] PATH_INFO: `/v3/users/b7fd3d01b2d644f593950e291e66e889` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:12.608739 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217db164-2a1e-4a6b-8435-53c2a95d088b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7fd3d01b2d644f593950e291e66e889)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:12.610691 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217db164-2a1e-4a6b-8435-53c2a95d088b admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:12.682507 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d3d41-a31c-4ec6-8f3c-ef2ef4f97a06 service neutron] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:12.685926 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-604d3d41-a31c-4ec6-8f3c-ef2ef4f97a06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:12.706786 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d3d41-a31c-4ec6-8f3c-ef2ef4f97a06 service neutron] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:12.714316 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bcff8-27c6-4999-a007-3e3728b783c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:12.715110 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bcff8-27c6-4999-a007-3e3728b783c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:12.715443 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bcff8-27c6-4999-a007-3e3728b783c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:12.716667 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bcff8-27c6-4999-a007-3e3728b783c7 admin admin] PATH_INFO: `/v3/projects/1ede731e5e744fd7bb17d528e17180e0` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:12.717900 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198bcff8-27c6-4999-a007-3e3728b783c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ede731e5e744fd7bb17d528e17180e0)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:12.720270 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198bcff8-27c6-4999-a007-3e3728b783c7 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:12.914526 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-217db164-2a1e-4a6b-8435-53c2a95d088b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7fd3d01b2d644f593950e291e66e889'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:12.922964 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-217db164-2a1e-4a6b-8435-53c2a95d088b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7fd3d01b2d644f593950e291e66e889'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:12.926698 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-217db164-2a1e-4a6b-8435-53c2a95d088b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7fd3d01b2d644f593950e291e66e889'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:13.030082 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-198bcff8-27c6-4999-a007-3e3728b783c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ede731e5e744fd7bb17d528e17180e0', 'request_id': 'req-198bcff8-27c6-4999-a007-3e3728b783c7'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:13.030422 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-217db164-2a1e-4a6b-8435-53c2a95d088b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7fd3d01b2d644f593950e291e66e889'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:13.031996 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:13.049421 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-217db164-2a1e-4a6b-8435-53c2a95d088b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7fd3d01b2d644f593950e291e66e889'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:13.056938 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1319/2674] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:19:12 2022] DELETE /identity/v3/users/b7fd3d01b2d644f593950e291e66e889 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:13.065797 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678e222-e0a8-4d86-87e1-cba0dffe1319 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:13.066433 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678e222-e0a8-4d86-87e1-cba0dffe1319 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:13.066433 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678e222-e0a8-4d86-87e1-cba0dffe1319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:13.089501 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-c678e222-e0a8-4d86-87e1-cba0dffe1319 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:13.090844 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-c678e222-e0a8-4d86-87e1-cba0dffe1319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:13.142887 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-198bcff8-27c6-4999-a007-3e3728b783c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ede731e5e744fd7bb17d528e17180e0', 'request_id': 'req-198bcff8-27c6-4999-a007-3e3728b783c7'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:13.150838 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-198bcff8-27c6-4999-a007-3e3728b783c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ede731e5e744fd7bb17d528e17180e0', 'request_id': 'req-198bcff8-27c6-4999-a007-3e3728b783c7'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:13.165028 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-198bcff8-27c6-4999-a007-3e3728b783c7 admin admin] The token cache is being invalidate because project 1ede731e5e744fd7bb17d528e17180e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:19:13.165271 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-198bcff8-27c6-4999-a007-3e3728b783c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:13.165968 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-198bcff8-27c6-4999-a007-3e3728b783c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:13.167521 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1356/2675] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:19:12 2022] DELETE /identity/v3/projects/1ede731e5e744fd7bb17d528e17180e0 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:19:13.168130 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1320/2676] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:19:13.171662 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bcff8-27c6-4999-a007-3e3728b783c7 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:13.173109 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-198bcff8-27c6-4999-a007-3e3728b783c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:13.182774 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c678e222-e0a8-4d86-87e1-cba0dffe1319 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:13.184515 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-c678e222-e0a8-4d86-87e1-cba0dffe1319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:13.201534 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:13.256017 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bcff8-27c6-4999-a007-3e3728b783c7 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:13.258714 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c678e222-e0a8-4d86-87e1-cba0dffe1319 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:13.263632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e6616-490f-46d7-9a3f-2cafbf5b30e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:13.264758 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d216f-e2e8-4017-959e-eb80891237d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:13.265701 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e6616-490f-46d7-9a3f-2cafbf5b30e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:13.266143 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e6616-490f-46d7-9a3f-2cafbf5b30e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:13.266338 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d216f-e2e8-4017-959e-eb80891237d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:13.266814 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e6616-490f-46d7-9a3f-2cafbf5b30e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:13.266923 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d216f-e2e8-4017-959e-eb80891237d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:13.267409 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d216f-e2e8-4017-959e-eb80891237d1 admin admin] PATH_INFO: `/v3/users/be5d1f45ccba41f8ab1a531ac405c8c3` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:13.269283 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-5c9e6616-490f-46d7-9a3f-2cafbf5b30e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:13.269414 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d216f-e2e8-4017-959e-eb80891237d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be5d1f45ccba41f8ab1a531ac405c8c3)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:13.272250 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d216f-e2e8-4017-959e-eb80891237d1 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:13.299626 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e6616-490f-46d7-9a3f-2cafbf5b30e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:13.301219 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e6616-490f-46d7-9a3f-2cafbf5b30e1 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:13.320514 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1321/2677] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:19:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:19:13.509290 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-564d216f-e2e8-4017-959e-eb80891237d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be5d1f45ccba41f8ab1a531ac405c8c3'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:13.589424 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-564d216f-e2e8-4017-959e-eb80891237d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be5d1f45ccba41f8ab1a531ac405c8c3'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:13.597964 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-564d216f-e2e8-4017-959e-eb80891237d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be5d1f45ccba41f8ab1a531ac405c8c3'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:13.598712 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-564d216f-e2e8-4017-959e-eb80891237d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be5d1f45ccba41f8ab1a531ac405c8c3'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:13.599989 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-564d216f-e2e8-4017-959e-eb80891237d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be5d1f45ccba41f8ab1a531ac405c8c3'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:13.626054 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1357/2678] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:19:13 2022] DELETE /identity/v3/users/be5d1f45ccba41f8ab1a531ac405c8c3 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:13.876860 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e6616-490f-46d7-9a3f-2cafbf5b30e1 service neutron] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:13.878658 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-5c9e6616-490f-46d7-9a3f-2cafbf5b30e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:13.913449 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e6616-490f-46d7-9a3f-2cafbf5b30e1 service neutron] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:13.995715 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794c8e1-9bff-44f7-ace1-f5e5397f6bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:13.996409 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794c8e1-9bff-44f7-ace1-f5e5397f6bc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:13.996689 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794c8e1-9bff-44f7-ace1-f5e5397f6bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:13.996965 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794c8e1-9bff-44f7-ace1-f5e5397f6bc3 admin admin] PATH_INFO: `/v3/projects/4fe84e820df94eacb5c1c6dbcf2579f1` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:13.998593 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794c8e1-9bff-44f7-ace1-f5e5397f6bc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fe84e820df94eacb5c1c6dbcf2579f1)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:14.000658 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794c8e1-9bff-44f7-ace1-f5e5397f6bc3 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:14.365854 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d216f-e2e8-4017-959e-eb80891237d1 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:14.370167 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-564d216f-e2e8-4017-959e-eb80891237d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:14.390722 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d216f-e2e8-4017-959e-eb80891237d1 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:14.414966 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-9794c8e1-9bff-44f7-ace1-f5e5397f6bc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fe84e820df94eacb5c1c6dbcf2579f1', 'request_id': 'req-9794c8e1-9bff-44f7-ace1-f5e5397f6bc3'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:14.424663 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-9794c8e1-9bff-44f7-ace1-f5e5397f6bc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fe84e820df94eacb5c1c6dbcf2579f1', 'request_id': 'req-9794c8e1-9bff-44f7-ace1-f5e5397f6bc3'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:14.438760 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-9794c8e1-9bff-44f7-ace1-f5e5397f6bc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fe84e820df94eacb5c1c6dbcf2579f1', 'request_id': 'req-9794c8e1-9bff-44f7-ace1-f5e5397f6bc3'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:14.471991 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:14.479515 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298dbf8-a1ea-4aa9-815b-883f7b98d8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:14.480225 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298dbf8-a1ea-4aa9-815b-883f7b98d8f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:14.480509 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298dbf8-a1ea-4aa9-815b-883f7b98d8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:14.480789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298dbf8-a1ea-4aa9-815b-883f7b98d8f4 admin admin] PATH_INFO: `/v3/projects/85cb7af040a6443597dd6168173b798c` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:14.482097 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298dbf8-a1ea-4aa9-815b-883f7b98d8f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85cb7af040a6443597dd6168173b798c)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:14.484280 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298dbf8-a1ea-4aa9-815b-883f7b98d8f4 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:14.535725 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-9794c8e1-9bff-44f7-ace1-f5e5397f6bc3 admin admin] The token cache is being invalidate because project 4fe84e820df94eacb5c1c6dbcf2579f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:19:14.536022 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-9794c8e1-9bff-44f7-ace1-f5e5397f6bc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:14.536752 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-9794c8e1-9bff-44f7-ace1-f5e5397f6bc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:14.538612 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1322/2679] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:19:13 2022] DELETE /identity/v3/projects/4fe84e820df94eacb5c1c6dbcf2579f1 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:14.543317 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794c8e1-9bff-44f7-ace1-f5e5397f6bc3 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:14.544842 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-9794c8e1-9bff-44f7-ace1-f5e5397f6bc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:14.559191 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794c8e1-9bff-44f7-ace1-f5e5397f6bc3 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:14.569323 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219b4f7-703c-4e3e-aa99-f44431fcc6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:14.570249 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219b4f7-703c-4e3e-aa99-f44431fcc6bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:14.570522 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219b4f7-703c-4e3e-aa99-f44431fcc6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:14.570802 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219b4f7-703c-4e3e-aa99-f44431fcc6bc admin admin] PATH_INFO: `/v3/users/48b0693fb682454d94fff802a9e6779b` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:14.572064 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219b4f7-703c-4e3e-aa99-f44431fcc6bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=48b0693fb682454d94fff802a9e6779b)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:14.574078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219b4f7-703c-4e3e-aa99-f44431fcc6bc admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:14.615706 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-a298dbf8-a1ea-4aa9-815b-883f7b98d8f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85cb7af040a6443597dd6168173b798c', 'request_id': 'req-a298dbf8-a1ea-4aa9-815b-883f7b98d8f4'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:14.700000 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-a298dbf8-a1ea-4aa9-815b-883f7b98d8f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85cb7af040a6443597dd6168173b798c', 'request_id': 'req-a298dbf8-a1ea-4aa9-815b-883f7b98d8f4'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:14.707269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-a298dbf8-a1ea-4aa9-815b-883f7b98d8f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85cb7af040a6443597dd6168173b798c', 'request_id': 'req-a298dbf8-a1ea-4aa9-815b-883f7b98d8f4'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:14.720448 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-a298dbf8-a1ea-4aa9-815b-883f7b98d8f4 admin admin] The token cache is being invalidate because project 85cb7af040a6443597dd6168173b798c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:19:14.720799 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-a298dbf8-a1ea-4aa9-815b-883f7b98d8f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:14.721384 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-a298dbf8-a1ea-4aa9-815b-883f7b98d8f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:14.722891 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1358/2680] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:19:14 2022] DELETE /identity/v3/projects/85cb7af040a6443597dd6168173b798c => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:14.728607 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496cebc-137e-4260-90a0-32ed1fb7c02c None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:14.729553 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496cebc-137e-4260-90a0-32ed1fb7c02c None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:14.729553 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496cebc-137e-4260-90a0-32ed1fb7c02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:14.751551 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-f496cebc-137e-4260-90a0-32ed1fb7c02c None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:14.755937 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-f496cebc-137e-4260-90a0-32ed1fb7c02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:14.766765 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:14.776178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-6219b4f7-703c-4e3e-aa99-f44431fcc6bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48b0693fb682454d94fff802a9e6779b'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:14.785005 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-6219b4f7-703c-4e3e-aa99-f44431fcc6bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48b0693fb682454d94fff802a9e6779b'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:14.785816 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-6219b4f7-703c-4e3e-aa99-f44431fcc6bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48b0693fb682454d94fff802a9e6779b'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:14.829244 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1359/2681] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:19:14.839607 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3ed3e-202d-47e5-b4ce-cb3c8facecc4 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:14.839919 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3ed3e-202d-47e5-b4ce-cb3c8facecc4 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:14.840481 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3ed3e-202d-47e5-b4ce-cb3c8facecc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:14.866119 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-d5d3ed3e-202d-47e5-b4ce-cb3c8facecc4 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:14.867330 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-d5d3ed3e-202d-47e5-b4ce-cb3c8facecc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:14.875693 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1360/2682] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:19:14.881249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3ed3e-202d-47e5-b4ce-cb3c8facecc4 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:14.893549 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3ed3e-202d-47e5-b4ce-cb3c8facecc4 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:14.900084 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04c136-31c7-4244-9d20-e4fe910ad640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:14.900766 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04c136-31c7-4244-9d20-e4fe910ad640 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:14.901048 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04c136-31c7-4244-9d20-e4fe910ad640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:14.901317 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04c136-31c7-4244-9d20-e4fe910ad640 admin admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:14.902022 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04c136-31c7-4244-9d20-e4fe910ad640 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:19:14.902340 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04c136-31c7-4244-9d20-e4fe910ad640 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:14.903950 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04c136-31c7-4244-9d20-e4fe910ad640 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:14.917790 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1361/2683] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:19:14.921680 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-6219b4f7-703c-4e3e-aa99-f44431fcc6bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48b0693fb682454d94fff802a9e6779b'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:14.922294 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04c136-31c7-4244-9d20-e4fe910ad640 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:14.936104 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04c136-31c7-4244-9d20-e4fe910ad640 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:14.941000 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-6219b4f7-703c-4e3e-aa99-f44431fcc6bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48b0693fb682454d94fff802a9e6779b'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:14.941604 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b392be0-0b2f-42d2-95e2-309330f458dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:14.942570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b392be0-0b2f-42d2-95e2-309330f458dc admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:14.943735 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b392be0-0b2f-42d2-95e2-309330f458dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:14.944024 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b392be0-0b2f-42d2-95e2-309330f458dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:14.945036 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b392be0-0b2f-42d2-95e2-309330f458dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:14.947531 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b392be0-0b2f-42d2-95e2-309330f458dc admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:14.951770 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1323/2684] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:19:14 2022] DELETE /identity/v3/users/48b0693fb682454d94fff802a9e6779b => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:19:15.053650 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1362/2685] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:19:14 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:19:15.058356 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219b4f7-703c-4e3e-aa99-f44431fcc6bc admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:15.160195 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219b4f7-703c-4e3e-aa99-f44431fcc6bc admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:15.248431 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e3d8e-e888-4f8d-8551-1769b0320ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:15.249341 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e3d8e-e888-4f8d-8551-1769b0320ecc admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:15.249831 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e3d8e-e888-4f8d-8551-1769b0320ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:15.250180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e3d8e-e888-4f8d-8551-1769b0320ecc admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:15.250944 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e3d8e-e888-4f8d-8551-1769b0320ecc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:15.253191 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e3d8e-e888-4f8d-8551-1769b0320ecc admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:15.343882 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1324/2686] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:19:15 2022] POST /identity/v3/users => generated 293 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:19:15.348827 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b392be0-0b2f-42d2-95e2-309330f458dc admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:15.368850 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b392be0-0b2f-42d2-95e2-309330f458dc admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:15.374264 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b84fb-4808-449a-840f-92a239062a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:15.374988 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b84fb-4808-449a-840f-92a239062a73 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:15.375615 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b84fb-4808-449a-840f-92a239062a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:15.378999 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b84fb-4808-449a-840f-92a239062a73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:15.380093 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b84fb-4808-449a-840f-92a239062a73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:15.381452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e3d8e-e888-4f8d-8551-1769b0320ecc admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:15.382861 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b84fb-4808-449a-840f-92a239062a73 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:15.383843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-871e3d8e-e888-4f8d-8551-1769b0320ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:15.396507 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1363/2687] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:19:15.404458 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b84fb-4808-449a-840f-92a239062a73 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:15.420397 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b84fb-4808-449a-840f-92a239062a73 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:15.426639 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfe9c4-8e05-4063-b40d-b437dea487fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:15.427182 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfe9c4-8e05-4063-b40d-b437dea487fc admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:15.428672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e3d8e-e888-4f8d-8551-1769b0320ecc admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:15.429135 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfe9c4-8e05-4063-b40d-b437dea487fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:15.429135 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfe9c4-8e05-4063-b40d-b437dea487fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:15.429793 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edfe9c4-8e05-4063-b40d-b437dea487fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:15.431904 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edfe9c4-8e05-4063-b40d-b437dea487fc admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:15.434278 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7d70b-eba8-4463-ab46-4f2a993e3829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:15.434872 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7d70b-eba8-4463-ab46-4f2a993e3829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:15.435165 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7d70b-eba8-4463-ab46-4f2a993e3829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:15.435435 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7d70b-eba8-4463-ab46-4f2a993e3829 admin admin] PATH_INFO: `/v3/projects/f643192831324f568c159155e869b781` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:15.436664 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7d70b-eba8-4463-ab46-4f2a993e3829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f643192831324f568c159155e869b781)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:15.438627 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7d70b-eba8-4463-ab46-4f2a993e3829 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:15.443083 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1364/2688] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:19:15.450439 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfe9c4-8e05-4063-b40d-b437dea487fc admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:15.461317 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfe9c4-8e05-4063-b40d-b437dea487fc admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:15.466447 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e5596-fb60-4327-883b-23df170795df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:15.467285 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e5596-fb60-4327-883b-23df170795df admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:15.467570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e5596-fb60-4327-883b-23df170795df admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:15.467953 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e5596-fb60-4327-883b-23df170795df admin admin] PATH_INFO: `/v3/projects/66f7de15dc644947bfe7a5db32ba6233/users/bbc8aa565ee7430fbdf75663f89edaa6/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:15.488142 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e5596-fb60-4327-883b-23df170795df admin admin] RBAC: Authorizing `identity:create_grant(project_id=66f7de15dc644947bfe7a5db32ba6233, user_id=bbc8aa565ee7430fbdf75663f89edaa6, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:15.491872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e5596-fb60-4327-883b-23df170795df admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:15.564154 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:15.570578 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1365/2689] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:19:15 2022] PUT /identity/v3/projects/66f7de15dc644947bfe7a5db32ba6233/users/bbc8aa565ee7430fbdf75663f89edaa6/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:19:15.592208 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-23d7d70b-eba8-4463-ab46-4f2a993e3829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f643192831324f568c159155e869b781', 'request_id': 'req-23d7d70b-eba8-4463-ab46-4f2a993e3829'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:15.601491 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=4 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:15.608211 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-23d7d70b-eba8-4463-ab46-4f2a993e3829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f643192831324f568c159155e869b781', 'request_id': 'req-23d7d70b-eba8-4463-ab46-4f2a993e3829'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:15.618090 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-23d7d70b-eba8-4463-ab46-4f2a993e3829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f643192831324f568c159155e869b781', 'request_id': 'req-23d7d70b-eba8-4463-ab46-4f2a993e3829'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:15.642072 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c83d4-cc61-4c9a-8792-1e3302fee96b None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:15.642353 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c83d4-cc61-4c9a-8792-1e3302fee96b None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:15.642617 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c83d4-cc61-4c9a-8792-1e3302fee96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:15.672002 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-e35c83d4-cc61-4c9a-8792-1e3302fee96b None None] MFA Rules not processed for user `bbc8aa565ee7430fbdf75663f89edaa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:15.673251 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-e35c83d4-cc61-4c9a-8792-1e3302fee96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:15.689033 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-23d7d70b-eba8-4463-ab46-4f2a993e3829 admin admin] The token cache is being invalidate because project f643192831324f568c159155e869b781 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:19:15.692407 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-23d7d70b-eba8-4463-ab46-4f2a993e3829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:15.692407 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-23d7d70b-eba8-4463-ab46-4f2a993e3829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:15.692407 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1325/2690] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:19:15 2022] DELETE /identity/v3/projects/f643192831324f568c159155e869b781 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:15.697724 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7d70b-eba8-4463-ab46-4f2a993e3829 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:15.699273 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-23d7d70b-eba8-4463-ab46-4f2a993e3829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:15.754923 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1366/2691] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:19:15.768304 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c83d4-cc61-4c9a-8792-1e3302fee96b None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:15.770190 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-e35c83d4-cc61-4c9a-8792-1e3302fee96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:15.783239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7d70b-eba8-4463-ab46-4f2a993e3829 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:15.789218 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb92b16-1bf5-4e73-8fc0-f7802f0b0b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:15.789935 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb92b16-1bf5-4e73-8fc0-f7802f0b0b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:15.790209 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb92b16-1bf5-4e73-8fc0-f7802f0b0b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:15.790485 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb92b16-1bf5-4e73-8fc0-f7802f0b0b1e admin admin] PATH_INFO: `/v3/users/bdaafdb053584d6b924915c2d7dcd00f` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:15.792609 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb92b16-1bf5-4e73-8fc0-f7802f0b0b1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdaafdb053584d6b924915c2d7dcd00f)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:15.794990 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb92b16-1bf5-4e73-8fc0-f7802f0b0b1e admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:15.856543 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c83d4-cc61-4c9a-8792-1e3302fee96b None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:15.856787 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafe24e-cfec-428c-a4d3-e480f30f2d18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:15.857338 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafe24e-cfec-428c-a4d3-e480f30f2d18 service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:15.857647 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafe24e-cfec-428c-a4d3-e480f30f2d18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:15.857924 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafe24e-cfec-428c-a4d3-e480f30f2d18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:15.867596 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafe24e-cfec-428c-a4d3-e480f30f2d18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:15.869298 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafe24e-cfec-428c-a4d3-e480f30f2d18 service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:15.883355 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1367/2692] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:19:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:19:15.903762 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafe24e-cfec-428c-a4d3-e480f30f2d18 service cinder] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:15.905323 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-1dafe24e-cfec-428c-a4d3-e480f30f2d18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:15.922607 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafe24e-cfec-428c-a4d3-e480f30f2d18 service cinder] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:15.928135 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e326d5-cda3-4109-ba45-610e81085593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:15.928731 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e326d5-cda3-4109-ba45-610e81085593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:15.929015 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e326d5-cda3-4109-ba45-610e81085593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:15.929292 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e326d5-cda3-4109-ba45-610e81085593 admin admin] PATH_INFO: `/v3/users/bbc8aa565ee7430fbdf75663f89edaa6` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:15.930508 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e326d5-cda3-4109-ba45-610e81085593 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbc8aa565ee7430fbdf75663f89edaa6)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:15.932569 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e326d5-cda3-4109-ba45-610e81085593 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:16.045135 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-3eb92b16-1bf5-4e73-8fc0-f7802f0b0b1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdaafdb053584d6b924915c2d7dcd00f'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:16.053449 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-3eb92b16-1bf5-4e73-8fc0-f7802f0b0b1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdaafdb053584d6b924915c2d7dcd00f'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:16.054173 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-3eb92b16-1bf5-4e73-8fc0-f7802f0b0b1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdaafdb053584d6b924915c2d7dcd00f'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:16.187319 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-81e326d5-cda3-4109-ba45-610e81085593 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbc8aa565ee7430fbdf75663f89edaa6'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:16.195540 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-3eb92b16-1bf5-4e73-8fc0-f7802f0b0b1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdaafdb053584d6b924915c2d7dcd00f'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:16.208546 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-3eb92b16-1bf5-4e73-8fc0-f7802f0b0b1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdaafdb053584d6b924915c2d7dcd00f'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:16.215760 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1326/2693] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:19:15 2022] DELETE /identity/v3/users/bdaafdb053584d6b924915c2d7dcd00f => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:19:16.262934 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-81e326d5-cda3-4109-ba45-610e81085593 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbc8aa565ee7430fbdf75663f89edaa6'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:16.273598 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-81e326d5-cda3-4109-ba45-610e81085593 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbc8aa565ee7430fbdf75663f89edaa6'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:16.275457 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-81e326d5-cda3-4109-ba45-610e81085593 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbc8aa565ee7430fbdf75663f89edaa6'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:16.276696 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-81e326d5-cda3-4109-ba45-610e81085593 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbc8aa565ee7430fbdf75663f89edaa6'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:16.311396 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1368/2694] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:19:15 2022] DELETE /identity/v3/users/bbc8aa565ee7430fbdf75663f89edaa6 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:19:16.315848 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1753b2-a5d4-4be1-b524-5912ab7e79cd None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:16.316146 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1753b2-a5d4-4be1-b524-5912ab7e79cd None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:16.317050 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1753b2-a5d4-4be1-b524-5912ab7e79cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:16.342862 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-3c1753b2-a5d4-4be1-b524-5912ab7e79cd None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:16.344139 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-3c1753b2-a5d4-4be1-b524-5912ab7e79cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:16.407645 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:16.418218 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1327/2695] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:16.428940 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e326d5-cda3-4109-ba45-610e81085593 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:16.430955 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-81e326d5-cda3-4109-ba45-610e81085593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:16.439128 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:16.516424 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e326d5-cda3-4109-ba45-610e81085593 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:16.520691 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f657892-59fe-43a9-bed5-4cf0da7ecd78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:16.521870 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f657892-59fe-43a9-bed5-4cf0da7ecd78 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:16.522247 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f657892-59fe-43a9-bed5-4cf0da7ecd78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:16.522523 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f657892-59fe-43a9-bed5-4cf0da7ecd78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:16.533341 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f657892-59fe-43a9-bed5-4cf0da7ecd78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:16.534794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f657892-59fe-43a9-bed5-4cf0da7ecd78 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:16.550338 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1369/2696] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:19:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:19:16.844665 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1753b2-a5d4-4be1-b524-5912ab7e79cd None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:16.846956 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-3c1753b2-a5d4-4be1-b524-5912ab7e79cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:16.862554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1753b2-a5d4-4be1-b524-5912ab7e79cd None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:16.874646 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d8a3f-c1b6-4ad6-a7c2-144a5c2685c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:16.875416 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d8a3f-c1b6-4ad6-a7c2-144a5c2685c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:16.875750 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d8a3f-c1b6-4ad6-a7c2-144a5c2685c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:16.876047 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d8a3f-c1b6-4ad6-a7c2-144a5c2685c4 admin admin] PATH_INFO: `/v3/projects/215f1d3f252b497380d63e20f42eb7a3` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:16.877628 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d8a3f-c1b6-4ad6-a7c2-144a5c2685c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=215f1d3f252b497380d63e20f42eb7a3)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:16.880193 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d8a3f-c1b6-4ad6-a7c2-144a5c2685c4 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:17.031905 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-bc3d8a3f-c1b6-4ad6-a7c2-144a5c2685c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '215f1d3f252b497380d63e20f42eb7a3', 'request_id': 'req-bc3d8a3f-c1b6-4ad6-a7c2-144a5c2685c4'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:17.038990 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-bc3d8a3f-c1b6-4ad6-a7c2-144a5c2685c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '215f1d3f252b497380d63e20f42eb7a3', 'request_id': 'req-bc3d8a3f-c1b6-4ad6-a7c2-144a5c2685c4'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:17.045830 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-bc3d8a3f-c1b6-4ad6-a7c2-144a5c2685c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '215f1d3f252b497380d63e20f42eb7a3', 'request_id': 'req-bc3d8a3f-c1b6-4ad6-a7c2-144a5c2685c4'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:17.125311 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-bc3d8a3f-c1b6-4ad6-a7c2-144a5c2685c4 admin admin] The token cache is being invalidate because project 215f1d3f252b497380d63e20f42eb7a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:19:17.125612 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-bc3d8a3f-c1b6-4ad6-a7c2-144a5c2685c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:17.127236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f657892-59fe-43a9-bed5-4cf0da7ecd78 service neutron] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:17.127947 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-bc3d8a3f-c1b6-4ad6-a7c2-144a5c2685c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:17.128863 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-4f657892-59fe-43a9-bed5-4cf0da7ecd78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:17.132151 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1328/2697] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:19:16 2022] DELETE /identity/v3/projects/215f1d3f252b497380d63e20f42eb7a3 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:19:17.137953 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae35f9-81fe-45c6-8149-5c698a75a8dd None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:17.138239 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae35f9-81fe-45c6-8149-5c698a75a8dd None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:17.138521 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae35f9-81fe-45c6-8149-5c698a75a8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:17.142305 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f657892-59fe-43a9-bed5-4cf0da7ecd78 service neutron] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:17.163961 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-37ae35f9-81fe-45c6-8149-5c698a75a8dd None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:17.165217 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-37ae35f9-81fe-45c6-8149-5c698a75a8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:17.213118 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683a04c-5914-4824-8852-ae2c2a43c838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:17.213700 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683a04c-5914-4824-8852-ae2c2a43c838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:17.214074 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683a04c-5914-4824-8852-ae2c2a43c838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:17.214333 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683a04c-5914-4824-8852-ae2c2a43c838 admin admin] PATH_INFO: `/v3/projects/66f7de15dc644947bfe7a5db32ba6233` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:17.215576 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683a04c-5914-4824-8852-ae2c2a43c838 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66f7de15dc644947bfe7a5db32ba6233)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:17.217537 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683a04c-5914-4824-8852-ae2c2a43c838 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:17.237815 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1329/2698] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:19:17.247424 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36154d8a-3335-44bd-a59d-000f51600402 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:17.247713 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36154d8a-3335-44bd-a59d-000f51600402 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:17.247995 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36154d8a-3335-44bd-a59d-000f51600402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:17.275020 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-36154d8a-3335-44bd-a59d-000f51600402 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:17.276329 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-36154d8a-3335-44bd-a59d-000f51600402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:17.290022 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1330/2699] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:17.296045 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36154d8a-3335-44bd-a59d-000f51600402 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:17.306406 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36154d8a-3335-44bd-a59d-000f51600402 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:17.311344 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00367852-3fb4-49ec-b56a-4b18c48fd269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:17.312072 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00367852-3fb4-49ec-b56a-4b18c48fd269 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:17.312453 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00367852-3fb4-49ec-b56a-4b18c48fd269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:17.312724 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00367852-3fb4-49ec-b56a-4b18c48fd269 admin admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:17.313422 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00367852-3fb4-49ec-b56a-4b18c48fd269 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:19:17.313725 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00367852-3fb4-49ec-b56a-4b18c48fd269 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:17.315328 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00367852-3fb4-49ec-b56a-4b18c48fd269 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:17.329788 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1331/2700] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:19:17.334975 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00367852-3fb4-49ec-b56a-4b18c48fd269 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:17.345171 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00367852-3fb4-49ec-b56a-4b18c48fd269 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:17.352530 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-3683a04c-5914-4824-8852-ae2c2a43c838 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66f7de15dc644947bfe7a5db32ba6233', 'request_id': 'req-3683a04c-5914-4824-8852-ae2c2a43c838'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:17.405888 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ae89f-ccdd-40d3-9f7d-782468bface7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:17.406515 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ae89f-ccdd-40d3-9f7d-782468bface7 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:17.406796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ae89f-ccdd-40d3-9f7d-782468bface7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:17.407078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ae89f-ccdd-40d3-9f7d-782468bface7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:17.407761 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ae89f-ccdd-40d3-9f7d-782468bface7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:17.409790 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ae89f-ccdd-40d3-9f7d-782468bface7 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:17.416609 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:17.452452 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-3683a04c-5914-4824-8852-ae2c2a43c838 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66f7de15dc644947bfe7a5db32ba6233', 'request_id': 'req-3683a04c-5914-4824-8852-ae2c2a43c838'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:17.458759 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-3683a04c-5914-4824-8852-ae2c2a43c838 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66f7de15dc644947bfe7a5db32ba6233', 'request_id': 'req-3683a04c-5914-4824-8852-ae2c2a43c838'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:17.470471 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-3683a04c-5914-4824-8852-ae2c2a43c838 admin admin] The token cache is being invalidate because project 66f7de15dc644947bfe7a5db32ba6233 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:19:17.470729 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-3683a04c-5914-4824-8852-ae2c2a43c838 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:17.471328 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-3683a04c-5914-4824-8852-ae2c2a43c838 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:17.472869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1370/2701] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:19:17 2022] DELETE /identity/v3/projects/66f7de15dc644947bfe7a5db32ba6233 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:17.478797 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacded92-05ea-4360-8c3f-0e16d4a38aa5 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:17.479093 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacded92-05ea-4360-8c3f-0e16d4a38aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:17.479360 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacded92-05ea-4360-8c3f-0e16d4a38aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:17.500784 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-bacded92-05ea-4360-8c3f-0e16d4a38aa5 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:17.502003 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-bacded92-05ea-4360-8c3f-0e16d4a38aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:17.510998 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1371/2702] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:19:17.518723 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0d8ec-516f-40dd-b2a9-efcdd22eeea1 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:17.518945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0d8ec-516f-40dd-b2a9-efcdd22eeea1 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:17.519226 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0d8ec-516f-40dd-b2a9-efcdd22eeea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:17.534144 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1332/2703] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:19:17 2022] POST /identity/v3/projects => generated 379 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:19:17.535241 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ae89f-ccdd-40d3-9f7d-782468bface7 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:17.536956 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-349ae89f-ccdd-40d3-9f7d-782468bface7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:17.540449 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-56b0d8ec-516f-40dd-b2a9-efcdd22eeea1 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:17.541613 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-56b0d8ec-516f-40dd-b2a9-efcdd22eeea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:17.568524 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:17.602413 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1372/2704] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:19:17.606809 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0d8ec-516f-40dd-b2a9-efcdd22eeea1 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:17.613670 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ae89f-ccdd-40d3-9f7d-782468bface7 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:17.616070 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0d8ec-516f-40dd-b2a9-efcdd22eeea1 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:17.619806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d98e4d-9321-4882-9d71-b10fd7cce3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:17.622483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d98e4d-9321-4882-9d71-b10fd7cce3be admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:17.622483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d98e4d-9321-4882-9d71-b10fd7cce3be admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:17.622483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d98e4d-9321-4882-9d71-b10fd7cce3be admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:17.622798 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c044d-246b-489e-9733-7d64de662876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:17.622913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d98e4d-9321-4882-9d71-b10fd7cce3be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:17.622998 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c044d-246b-489e-9733-7d64de662876 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:17.622998 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c044d-246b-489e-9733-7d64de662876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:17.622998 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c044d-246b-489e-9733-7d64de662876 admin admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:17.623360 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c044d-246b-489e-9733-7d64de662876 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:19:17.623579 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c044d-246b-489e-9733-7d64de662876 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:17.623877 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d98e4d-9321-4882-9d71-b10fd7cce3be admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:17.625237 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c044d-246b-489e-9733-7d64de662876 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:17.641080 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1373/2705] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:19:17.648519 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c044d-246b-489e-9733-7d64de662876 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:17.658851 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c044d-246b-489e-9733-7d64de662876 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:17.663962 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b232fb8-80e7-4e94-9f73-a9cb770e7701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:17.664762 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b232fb8-80e7-4e94-9f73-a9cb770e7701 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:17.665150 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b232fb8-80e7-4e94-9f73-a9cb770e7701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:17.665524 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b232fb8-80e7-4e94-9f73-a9cb770e7701 admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:17.666299 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b232fb8-80e7-4e94-9f73-a9cb770e7701 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:17.669415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b232fb8-80e7-4e94-9f73-a9cb770e7701 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:17.739238 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1333/2706] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:19:17 2022] POST /identity/v3/users => generated 290 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:19:17.746514 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d98e4d-9321-4882-9d71-b10fd7cce3be admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:17.756971 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d98e4d-9321-4882-9d71-b10fd7cce3be admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:17.762089 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53694966-8d79-41d3-a293-887cdfa45324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:17.762714 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53694966-8d79-41d3-a293-887cdfa45324 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:17.763000 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53694966-8d79-41d3-a293-887cdfa45324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:17.763279 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53694966-8d79-41d3-a293-887cdfa45324 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:17.763980 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53694966-8d79-41d3-a293-887cdfa45324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:17.765904 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53694966-8d79-41d3-a293-887cdfa45324 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:17.778582 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1334/2707] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:19:17.784302 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53694966-8d79-41d3-a293-887cdfa45324 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:17.794568 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53694966-8d79-41d3-a293-887cdfa45324 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:17.799308 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8b789-7050-40ae-b944-555868817bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:17.799942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8b789-7050-40ae-b944-555868817bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:17.800255 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8b789-7050-40ae-b944-555868817bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:17.800529 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8b789-7050-40ae-b944-555868817bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:17.801341 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8b789-7050-40ae-b944-555868817bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:17.802989 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8b789-7050-40ae-b944-555868817bc9 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:17.814331 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1335/2708] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:19:17.820565 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8b789-7050-40ae-b944-555868817bc9 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:17.827451 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1374/2709] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:19:17 2022] POST /identity/v3/projects => generated 375 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:19:17.830015 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b232fb8-80e7-4e94-9f73-a9cb770e7701 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:17.831133 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8b789-7050-40ae-b944-555868817bc9 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:17.898484 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5814c78-3335-46d1-81ab-9de836d61ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:17.902375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5814c78-3335-46d1-81ab-9de836d61ed3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:17.902375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5814c78-3335-46d1-81ab-9de836d61ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:17.902375 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5814c78-3335-46d1-81ab-9de836d61ed3 admin admin] PATH_INFO: `/v3/projects/aff68f67a0ca46aeb1bb7392bfa41bc0/users/1809c97e24db42b182cc4d48a77f3ada/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:17.905118 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b232fb8-80e7-4e94-9f73-a9cb770e7701 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:17.910142 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10320b26-6b57-4120-9dce-1cdc011fa86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:17.910903 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10320b26-6b57-4120-9dce-1cdc011fa86a admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:17.911187 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10320b26-6b57-4120-9dce-1cdc011fa86a admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:17.911677 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10320b26-6b57-4120-9dce-1cdc011fa86a admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:17.912869 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10320b26-6b57-4120-9dce-1cdc011fa86a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:17.914838 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10320b26-6b57-4120-9dce-1cdc011fa86a admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:17.918026 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5814c78-3335-46d1-81ab-9de836d61ed3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aff68f67a0ca46aeb1bb7392bfa41bc0, user_id=1809c97e24db42b182cc4d48a77f3ada, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:17.920914 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5814c78-3335-46d1-81ab-9de836d61ed3 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:18.054338 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1375/2710] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:19:17 2022] POST /identity/v3/users => generated 288 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:19:18.055373 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ba21b-73f2-4cf0-b0ba-264fac8a8576 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:18.057113 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1336/2711] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:19:17 2022] PUT /identity/v3/projects/aff68f67a0ca46aeb1bb7392bfa41bc0/users/1809c97e24db42b182cc4d48a77f3ada/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:18.059325 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5814c78-3335-46d1-81ab-9de836d61ed3 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:18.059878 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ba21b-73f2-4cf0-b0ba-264fac8a8576 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:18.060462 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ba21b-73f2-4cf0-b0ba-264fac8a8576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:18.090415 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-463ba21b-73f2-4cf0-b0ba-264fac8a8576 None None] MFA Rules not processed for user `eb640d92cb9b49019f42351a60efe258`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:18.092559 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-463ba21b-73f2-4cf0-b0ba-264fac8a8576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:18.143777 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5814c78-3335-46d1-81ab-9de836d61ed3 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:18.150380 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca221f8-b8b1-4645-960e-16f9e702eedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:18.151044 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca221f8-b8b1-4645-960e-16f9e702eedb admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:18.151353 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca221f8-b8b1-4645-960e-16f9e702eedb admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:18.151592 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca221f8-b8b1-4645-960e-16f9e702eedb admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:18.152315 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca221f8-b8b1-4645-960e-16f9e702eedb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:18.154059 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca221f8-b8b1-4645-960e-16f9e702eedb admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:18.159791 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1376/2712] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Aug 2 09:19:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:18.161141 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25aa94-3afa-4fc8-9017-7c878ed13750 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:18.161430 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25aa94-3afa-4fc8-9017-7c878ed13750 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:18.162797 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25aa94-3afa-4fc8-9017-7c878ed13750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:18.166300 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1337/2713] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:19:18.171476 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca221f8-b8b1-4645-960e-16f9e702eedb admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:18.185595 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca221f8-b8b1-4645-960e-16f9e702eedb admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:18.186783 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:18.193017 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c359a-af64-456e-8dfc-1a4f6472a2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:18.193017 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c359a-af64-456e-8dfc-1a4f6472a2ce admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:18.195523 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c359a-af64-456e-8dfc-1a4f6472a2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:18.195523 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c359a-af64-456e-8dfc-1a4f6472a2ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:18.195523 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c359a-af64-456e-8dfc-1a4f6472a2ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:18.196803 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c359a-af64-456e-8dfc-1a4f6472a2ce admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:18.202678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-1e25aa94-3afa-4fc8-9017-7c878ed13750 None None] MFA Rules not processed for user `1809c97e24db42b182cc4d48a77f3ada`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:18.203943 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-1e25aa94-3afa-4fc8-9017-7c878ed13750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:18.209632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1338/2714] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:19:18.214582 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c359a-af64-456e-8dfc-1a4f6472a2ce admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:18.226198 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c359a-af64-456e-8dfc-1a4f6472a2ce admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:18.229076 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:18.232122 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61243f-4366-4259-8554-d06e98c24f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:18.232889 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61243f-4366-4259-8554-d06e98c24f12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:18.233173 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61243f-4366-4259-8554-d06e98c24f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:18.233448 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61243f-4366-4259-8554-d06e98c24f12 admin admin] PATH_INFO: `/v3/projects/21c60fe4d5bc43af956eb202c430d07b/users/53def8d4f9a34d29b9387499af549f87/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:18.249269 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61243f-4366-4259-8554-d06e98c24f12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21c60fe4d5bc43af956eb202c430d07b, user_id=53def8d4f9a34d29b9387499af549f87, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:18.252030 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61243f-4366-4259-8554-d06e98c24f12 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:18.282279 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1377/2715] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:18.287479 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25aa94-3afa-4fc8-9017-7c878ed13750 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:18.303711 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25aa94-3afa-4fc8-9017-7c878ed13750 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:18.308723 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd3ba9-edb5-4d4b-adc8-7f9b6ecc20c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:18.309363 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd3ba9-edb5-4d4b-adc8-7f9b6ecc20c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:18.309644 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd3ba9-edb5-4d4b-adc8-7f9b6ecc20c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:18.310034 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd3ba9-edb5-4d4b-adc8-7f9b6ecc20c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:18.310592 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd3ba9-edb5-4d4b-adc8-7f9b6ecc20c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:18.312554 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd3ba9-edb5-4d4b-adc8-7f9b6ecc20c9 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:18.369413 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1339/2716] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:19:18 2022] PUT /identity/v3/projects/21c60fe4d5bc43af956eb202c430d07b/users/53def8d4f9a34d29b9387499af549f87/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:19:18.372678 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61243f-4366-4259-8554-d06e98c24f12 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:18.374392 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-9c61243f-4366-4259-8554-d06e98c24f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:18.408888 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1378/2717] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:19:18 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:19:18.410424 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7a5a6-ac05-4aa3-b94d-ac5ce192a727 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:18.410765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7a5a6-ac05-4aa3-b94d-ac5ce192a727 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:18.411108 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7a5a6-ac05-4aa3-b94d-ac5ce192a727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:18.445266 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-55f7a5a6-ac05-4aa3-b94d-ac5ce192a727 None None] MFA Rules not processed for user `53def8d4f9a34d29b9387499af549f87`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:18.446854 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-55f7a5a6-ac05-4aa3-b94d-ac5ce192a727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:18.450795 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61243f-4366-4259-8554-d06e98c24f12 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:18.525084 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718c3a2-6bd1-4152-a4ad-1b303838fe4c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f8e572550b4ab5955d7a94f1563441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:18.525333 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1379/2718] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:18.525801 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718c3a2-6bd1-4152-a4ad-1b303838fe4c service swift] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:18.526062 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718c3a2-6bd1-4152-a4ad-1b303838fe4c service swift] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:18.526432 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7a5a6-ac05-4aa3-b94d-ac5ce192a727 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:18.526566 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718c3a2-6bd1-4152-a4ad-1b303838fe4c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:18.587373 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:18.602803 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718c3a2-6bd1-4152-a4ad-1b303838fe4c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:18.604456 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718c3a2-6bd1-4152-a4ad-1b303838fe4c service swift] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:18.606628 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7a5a6-ac05-4aa3-b94d-ac5ce192a727 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:18.613119 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f827e2-e521-417c-9fd6-5504241edf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:18.616496 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1340/2719] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Aug 2 09:19:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 02 09:19:18.617076 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f827e2-e521-417c-9fd6-5504241edf5c admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:18.617076 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f827e2-e521-417c-9fd6-5504241edf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:18.617076 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f827e2-e521-417c-9fd6-5504241edf5c admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:18.617464 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718c3a2-6bd1-4152-a4ad-1b303838fe4c service swift] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:18.617715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f827e2-e521-417c-9fd6-5504241edf5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:18.617820 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-5718c3a2-6bd1-4152-a4ad-1b303838fe4c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:18.617928 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f827e2-e521-417c-9fd6-5504241edf5c admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:18.703659 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1380/2720] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:19:18 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:19:18.709095 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f827e2-e521-417c-9fd6-5504241edf5c admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:18.717623 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718c3a2-6bd1-4152-a4ad-1b303838fe4c service swift] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:18.722283 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f827e2-e521-417c-9fd6-5504241edf5c admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:18.722977 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6f9a6-433b-4490-9764-f76b0d5b532f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:18.723669 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6f9a6-433b-4490-9764-f76b0d5b532f service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:18.723918 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6f9a6-433b-4490-9764-f76b0d5b532f service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:18.724965 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6f9a6-433b-4490-9764-f76b0d5b532f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:18.728939 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691435e-47df-4eec-9bc6-faf011792b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:18.730438 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691435e-47df-4eec-9bc6-faf011792b86 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:18.731059 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691435e-47df-4eec-9bc6-faf011792b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:18.732576 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691435e-47df-4eec-9bc6-faf011792b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:18.737045 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691435e-47df-4eec-9bc6-faf011792b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:18.737045 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691435e-47df-4eec-9bc6-faf011792b86 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:18.737316 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6f9a6-433b-4490-9764-f76b0d5b532f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:18.738478 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6f9a6-433b-4490-9764-f76b0d5b532f service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:18.752344 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1341/2721] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:19:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:19:18.753021 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1381/2722] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:19:18.754211 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691435e-47df-4eec-9bc6-faf011792b86 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:18.776056 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691435e-47df-4eec-9bc6-faf011792b86 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:18.790633 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88655ee4-fe81-41dd-9565-e4ed2413d6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:18.791876 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88655ee4-fe81-41dd-9565-e4ed2413d6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:18.792403 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88655ee4-fe81-41dd-9565-e4ed2413d6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:18.792904 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88655ee4-fe81-41dd-9565-e4ed2413d6d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:18.794242 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88655ee4-fe81-41dd-9565-e4ed2413d6d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:18.796215 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88655ee4-fe81-41dd-9565-e4ed2413d6d7 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:18.797844 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:18.812516 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1382/2723] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:19:18.817567 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6f9a6-433b-4490-9764-f76b0d5b532f service cinder] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:18.863389 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6f9a6-433b-4490-9764-f76b0d5b532f service cinder] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:18.864904 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332190c1-76d6-48af-af55-de6b1f5a90f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:18.866504 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332190c1-76d6-48af-af55-de6b1f5a90f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:18.867060 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332190c1-76d6-48af-af55-de6b1f5a90f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:18.867526 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332190c1-76d6-48af-af55-de6b1f5a90f4 admin admin] PATH_INFO: `/v3/projects/f9cce8018cab438eb31618448245ad9e/users/cac08832c02d4d96beae42ec4280b861/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:18.899825 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332190c1-76d6-48af-af55-de6b1f5a90f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9cce8018cab438eb31618448245ad9e, user_id=cac08832c02d4d96beae42ec4280b861, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:18.904337 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332190c1-76d6-48af-af55-de6b1f5a90f4 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:19.032201 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1342/2724] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:19:18 2022] PUT /identity/v3/projects/f9cce8018cab438eb31618448245ad9e/users/cac08832c02d4d96beae42ec4280b861/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:19:19.044229 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a543c-5982-429e-bd16-5e66666ed6db None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:19.044443 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a543c-5982-429e-bd16-5e66666ed6db None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:19.044692 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a543c-5982-429e-bd16-5e66666ed6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:19.095851 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-d39a543c-5982-429e-bd16-5e66666ed6db None None] MFA Rules not processed for user `cac08832c02d4d96beae42ec4280b861`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:19.097407 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-d39a543c-5982-429e-bd16-5e66666ed6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:19.229604 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1383/2725] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:19.230900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332190c1-76d6-48af-af55-de6b1f5a90f4 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:19.353900 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332190c1-76d6-48af-af55-de6b1f5a90f4 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:19.371411 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452026e7-7dbc-4e04-b0c2-36a104d83683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:19.372949 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452026e7-7dbc-4e04-b0c2-36a104d83683 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:19.373494 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452026e7-7dbc-4e04-b0c2-36a104d83683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:19.373841 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452026e7-7dbc-4e04-b0c2-36a104d83683 admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:19.374758 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452026e7-7dbc-4e04-b0c2-36a104d83683 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:19.378280 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452026e7-7dbc-4e04-b0c2-36a104d83683 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:19.533942 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1343/2726] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:19:19 2022] POST /identity/v3/projects => generated 379 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:19:19.535453 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a543c-5982-429e-bd16-5e66666ed6db None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:19.550451 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a543c-5982-429e-bd16-5e66666ed6db None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:19.703345 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31998a7-d6f9-46c3-8659-ffc401891a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:19.704007 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31998a7-d6f9-46c3-8659-ffc401891a63 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:19.704326 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31998a7-d6f9-46c3-8659-ffc401891a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:19.704575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31998a7-d6f9-46c3-8659-ffc401891a63 admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:19.705480 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31998a7-d6f9-46c3-8659-ffc401891a63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:19.718878 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31998a7-d6f9-46c3-8659-ffc401891a63 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:19.839588 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1384/2727] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:19:19 2022] POST /identity/v3/users => generated 296 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:19:19.839710 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452026e7-7dbc-4e04-b0c2-36a104d83683 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:19.857074 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452026e7-7dbc-4e04-b0c2-36a104d83683 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:19.871492 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccf893-8f37-4981-bc51-ae7378c7d574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:19.871648 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccf893-8f37-4981-bc51-ae7378c7d574 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:19.871809 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccf893-8f37-4981-bc51-ae7378c7d574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:19.872104 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccf893-8f37-4981-bc51-ae7378c7d574 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:19.874233 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ccf893-8f37-4981-bc51-ae7378c7d574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:19.878508 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ccf893-8f37-4981-bc51-ae7378c7d574 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:19.915840 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1344/2728] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:19:19.920360 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31998a7-d6f9-46c3-8659-ffc401891a63 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:19.940509 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31998a7-d6f9-46c3-8659-ffc401891a63 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:19.956089 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160baa4-c423-43e5-8495-729e8f8b5cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:19.957770 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160baa4-c423-43e5-8495-729e8f8b5cdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:19.959295 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160baa4-c423-43e5-8495-729e8f8b5cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:19.960113 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160baa4-c423-43e5-8495-729e8f8b5cdb admin admin] PATH_INFO: `/v3/projects/a4edade9b1384c80aab88460bfc03077/users/79d6184a96b94af89ae1c1e493fdda7b/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:19.993181 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160baa4-c423-43e5-8495-729e8f8b5cdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4edade9b1384c80aab88460bfc03077, user_id=79d6184a96b94af89ae1c1e493fdda7b, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:19.996084 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160baa4-c423-43e5-8495-729e8f8b5cdb admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:20.116119 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1385/2729] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:19:19 2022] PUT /identity/v3/projects/a4edade9b1384c80aab88460bfc03077/users/79d6184a96b94af89ae1c1e493fdda7b/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:19:20.122888 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccf893-8f37-4981-bc51-ae7378c7d574 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:20.156404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccf893-8f37-4981-bc51-ae7378c7d574 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:20.201728 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:20.237328 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235a8d3-f697-4894-9f98-0a6a40b91e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:20.238289 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235a8d3-f697-4894-9f98-0a6a40b91e3d admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:20.238725 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235a8d3-f697-4894-9f98-0a6a40b91e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:20.239195 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235a8d3-f697-4894-9f98-0a6a40b91e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:20.240773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235a8d3-f697-4894-9f98-0a6a40b91e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:20.242857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235a8d3-f697-4894-9f98-0a6a40b91e3d admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:20.254808 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1345/2730] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:19:20.260210 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160baa4-c423-43e5-8495-729e8f8b5cdb admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:20.271937 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160baa4-c423-43e5-8495-729e8f8b5cdb admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:20.276991 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9ff43-2f6f-4b1e-a37a-19648426b047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:20.279593 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9ff43-2f6f-4b1e-a37a-19648426b047 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:20.279593 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9ff43-2f6f-4b1e-a37a-19648426b047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:20.279593 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9ff43-2f6f-4b1e-a37a-19648426b047 admin admin] PATH_INFO: `/v3/projects/a4edade9b1384c80aab88460bfc03077/users/79d6184a96b94af89ae1c1e493fdda7b/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:20.280659 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9ff43-2f6f-4b1e-a37a-19648426b047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4edade9b1384c80aab88460bfc03077, user_id=79d6184a96b94af89ae1c1e493fdda7b, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:20.282835 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9ff43-2f6f-4b1e-a37a-19648426b047 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:20.294598 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1386/2731] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:19:20 2022] PUT /identity/v3/projects/a4edade9b1384c80aab88460bfc03077/users/79d6184a96b94af89ae1c1e493fdda7b/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:20.306864 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e646b-4efb-46fd-a737-1adceb4bf1e9 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:20.308325 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e646b-4efb-46fd-a737-1adceb4bf1e9 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:20.308325 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e646b-4efb-46fd-a737-1adceb4bf1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:20.339925 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-085e646b-4efb-46fd-a737-1adceb4bf1e9 None None] MFA Rules not processed for user `79d6184a96b94af89ae1c1e493fdda7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:20.341221 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-085e646b-4efb-46fd-a737-1adceb4bf1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:20.414234 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1346/2732] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:20 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:20.426813 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9ff43-2f6f-4b1e-a37a-19648426b047 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:20.429954 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-cda9ff43-2f6f-4b1e-a37a-19648426b047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:20.475036 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:20.492214 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9ff43-2f6f-4b1e-a37a-19648426b047 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:20.496216 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873cd1db-9e00-42b2-8019-5883aa8063f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:20.496863 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cd1db-9e00-42b2-8019-5883aa8063f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:20.497148 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cd1db-9e00-42b2-8019-5883aa8063f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:20.497431 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cd1db-9e00-42b2-8019-5883aa8063f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:20.508469 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873cd1db-9e00-42b2-8019-5883aa8063f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:20.509944 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873cd1db-9e00-42b2-8019-5883aa8063f1 service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:20.521858 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1387/2733] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:19:20 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:19:20.670762 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e646b-4efb-46fd-a737-1adceb4bf1e9 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:20.688640 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e646b-4efb-46fd-a737-1adceb4bf1e9 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:20.693870 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb3784-b23e-41fe-a505-d14a166e1fcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:20.699555 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb3784-b23e-41fe-a505-d14a166e1fcb service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:20.699555 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb3784-b23e-41fe-a505-d14a166e1fcb service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:20.699555 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb3784-b23e-41fe-a505-d14a166e1fcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:20.799049 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb3784-b23e-41fe-a505-d14a166e1fcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:20.801735 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb3784-b23e-41fe-a505-d14a166e1fcb service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:20.818288 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1347/2734] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:19:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:19:25.220994 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873cd1db-9e00-42b2-8019-5883aa8063f1 service cinder] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:25.317410 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873cd1db-9e00-42b2-8019-5883aa8063f1 service cinder] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:25.325421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae9614-dbbb-4ae5-894c-817a095b3f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:25.326528 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae9614-dbbb-4ae5-894c-817a095b3f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:25.327085 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae9614-dbbb-4ae5-894c-817a095b3f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:25.327542 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae9614-dbbb-4ae5-894c-817a095b3f54 admin admin] PATH_INFO: `/v3/users/53def8d4f9a34d29b9387499af549f87` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:25.329493 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae9614-dbbb-4ae5-894c-817a095b3f54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53def8d4f9a34d29b9387499af549f87)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:25.331855 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae9614-dbbb-4ae5-894c-817a095b3f54 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:25.560712 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-9aae9614-dbbb-4ae5-894c-817a095b3f54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53def8d4f9a34d29b9387499af549f87'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:25.719256 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-9aae9614-dbbb-4ae5-894c-817a095b3f54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53def8d4f9a34d29b9387499af549f87'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:25.735365 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-9aae9614-dbbb-4ae5-894c-817a095b3f54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53def8d4f9a34d29b9387499af549f87'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:25.736140 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-9aae9614-dbbb-4ae5-894c-817a095b3f54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53def8d4f9a34d29b9387499af549f87'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:25.736870 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-9aae9614-dbbb-4ae5-894c-817a095b3f54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53def8d4f9a34d29b9387499af549f87'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:25.764987 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1388/2735] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:19:25 2022] DELETE /identity/v3/users/53def8d4f9a34d29b9387499af549f87 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:25.769858 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fb24b-fa7b-4a6e-adec-da564118f88a None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:25.770429 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fb24b-fa7b-4a6e-adec-da564118f88a None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:25.771574 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fb24b-fa7b-4a6e-adec-da564118f88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:25.800109 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-544fb24b-fa7b-4a6e-adec-da564118f88a None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:25.801831 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-544fb24b-fa7b-4a6e-adec-da564118f88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:25.882282 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=100 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:25.905507 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1348/2736] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:25.915898 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae9614-dbbb-4ae5-894c-817a095b3f54 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:25.918093 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-9aae9614-dbbb-4ae5-894c-817a095b3f54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:25.933140 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544fb24b-fa7b-4a6e-adec-da564118f88a None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:25.934612 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-544fb24b-fa7b-4a6e-adec-da564118f88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:25.952282 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544fb24b-fa7b-4a6e-adec-da564118f88a None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:25.956821 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2085d7-5566-42c0-99db-bc1a3e2420e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:25.957788 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2085d7-5566-42c0-99db-bc1a3e2420e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:25.958882 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2085d7-5566-42c0-99db-bc1a3e2420e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:25.959385 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2085d7-5566-42c0-99db-bc1a3e2420e0 admin admin] PATH_INFO: `/v3/users/1809c97e24db42b182cc4d48a77f3ada` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:25.960915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2085d7-5566-42c0-99db-bc1a3e2420e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1809c97e24db42b182cc4d48a77f3ada)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:25.963245 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2085d7-5566-42c0-99db-bc1a3e2420e0 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:25.992089 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae9614-dbbb-4ae5-894c-817a095b3f54 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:25.995964 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11d134-84f0-4449-8992-6070766be5a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:25.996629 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11d134-84f0-4449-8992-6070766be5a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:25.996910 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11d134-84f0-4449-8992-6070766be5a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:25.997215 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11d134-84f0-4449-8992-6070766be5a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:26.019236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11d134-84f0-4449-8992-6070766be5a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:26.192317 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11d134-84f0-4449-8992-6070766be5a1 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:26.192317 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1389/2737] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:19:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:19:26.574550 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-8c2085d7-5566-42c0-99db-bc1a3e2420e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1809c97e24db42b182cc4d48a77f3ada'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:26.592624 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-8c2085d7-5566-42c0-99db-bc1a3e2420e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1809c97e24db42b182cc4d48a77f3ada'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:26.593429 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-8c2085d7-5566-42c0-99db-bc1a3e2420e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1809c97e24db42b182cc4d48a77f3ada'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:26.664792 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-8c2085d7-5566-42c0-99db-bc1a3e2420e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1809c97e24db42b182cc4d48a77f3ada'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:26.687441 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-8c2085d7-5566-42c0-99db-bc1a3e2420e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1809c97e24db42b182cc4d48a77f3ada'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:26.695633 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1349/2738] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:19:25 2022] DELETE /identity/v3/users/1809c97e24db42b182cc4d48a77f3ada => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:19:26.700300 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a794c0-4a3e-4a72-84df-ef7b12659e94 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:26.700850 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a794c0-4a3e-4a72-84df-ef7b12659e94 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:26.700850 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a794c0-4a3e-4a72-84df-ef7b12659e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:26.720056 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:26.750063 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-b1a794c0-4a3e-4a72-84df-ef7b12659e94 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:26.754784 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-b1a794c0-4a3e-4a72-84df-ef7b12659e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:26.799694 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2085d7-5566-42c0-99db-bc1a3e2420e0 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:26.803340 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-8c2085d7-5566-42c0-99db-bc1a3e2420e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:26.926039 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1390/2739] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:26.942288 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a794c0-4a3e-4a72-84df-ef7b12659e94 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:26.945828 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-b1a794c0-4a3e-4a72-84df-ef7b12659e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:26.959859 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2085d7-5566-42c0-99db-bc1a3e2420e0 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:26.968819 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3106aa2-1f6e-443b-9429-84104ad10ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:26.973010 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3106aa2-1f6e-443b-9429-84104ad10ec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:26.986628 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3106aa2-1f6e-443b-9429-84104ad10ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:26.986628 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3106aa2-1f6e-443b-9429-84104ad10ec0 admin admin] PATH_INFO: `/v3/projects/21c60fe4d5bc43af956eb202c430d07b` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:26.986628 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3106aa2-1f6e-443b-9429-84104ad10ec0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21c60fe4d5bc43af956eb202c430d07b)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:26.986628 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3106aa2-1f6e-443b-9429-84104ad10ec0 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:27.068828 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a794c0-4a3e-4a72-84df-ef7b12659e94 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:27.074100 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c563d5-e9bf-4cef-87f1-698b310206c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:27.074743 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c563d5-e9bf-4cef-87f1-698b310206c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:27.075030 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c563d5-e9bf-4cef-87f1-698b310206c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:27.075316 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c563d5-e9bf-4cef-87f1-698b310206c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:27.090699 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c563d5-e9bf-4cef-87f1-698b310206c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:27.092440 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c563d5-e9bf-4cef-87f1-698b310206c8 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:27.105440 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1391/2740] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:19:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:19:27.196119 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-c3106aa2-1f6e-443b-9429-84104ad10ec0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21c60fe4d5bc43af956eb202c430d07b', 'request_id': 'req-c3106aa2-1f6e-443b-9429-84104ad10ec0'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:27.215022 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-c3106aa2-1f6e-443b-9429-84104ad10ec0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21c60fe4d5bc43af956eb202c430d07b', 'request_id': 'req-c3106aa2-1f6e-443b-9429-84104ad10ec0'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:27.230047 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-c3106aa2-1f6e-443b-9429-84104ad10ec0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21c60fe4d5bc43af956eb202c430d07b', 'request_id': 'req-c3106aa2-1f6e-443b-9429-84104ad10ec0'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:27.371723 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:27.378480 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-c3106aa2-1f6e-443b-9429-84104ad10ec0 admin admin] The token cache is being invalidate because project 21c60fe4d5bc43af956eb202c430d07b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:19:27.378480 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-c3106aa2-1f6e-443b-9429-84104ad10ec0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:27.379344 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-c3106aa2-1f6e-443b-9429-84104ad10ec0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:27.385212 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1350/2741] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:19:26 2022] DELETE /identity/v3/projects/21c60fe4d5bc43af956eb202c430d07b => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:19:27.389131 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f393b9-643f-49a7-884c-7e5af8367aca None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:27.389568 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f393b9-643f-49a7-884c-7e5af8367aca None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:27.389971 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f393b9-643f-49a7-884c-7e5af8367aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:27.433973 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-61f393b9-643f-49a7-884c-7e5af8367aca None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:27.437862 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-61f393b9-643f-49a7-884c-7e5af8367aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:27.557633 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1392/2742] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:19:27.567258 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0998677-1d81-4794-a95a-58f0e4989409 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:27.568270 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0998677-1d81-4794-a95a-58f0e4989409 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:27.568882 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0998677-1d81-4794-a95a-58f0e4989409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:27.596712 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-d0998677-1d81-4794-a95a-58f0e4989409 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:27.598134 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-d0998677-1d81-4794-a95a-58f0e4989409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:27.607440 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1351/2743] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:19:27.612002 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f393b9-643f-49a7-884c-7e5af8367aca None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:27.625027 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f393b9-643f-49a7-884c-7e5af8367aca None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:27.631872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99738540-aa88-4525-8090-fe02c3253de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:27.638918 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99738540-aa88-4525-8090-fe02c3253de7 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:27.638918 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99738540-aa88-4525-8090-fe02c3253de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:27.638918 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99738540-aa88-4525-8090-fe02c3253de7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:27.638918 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99738540-aa88-4525-8090-fe02c3253de7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:19:27.638918 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99738540-aa88-4525-8090-fe02c3253de7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:27.638918 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99738540-aa88-4525-8090-fe02c3253de7 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:27.659212 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1393/2744] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:19:27.663071 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0998677-1d81-4794-a95a-58f0e4989409 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:27.669810 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99738540-aa88-4525-8090-fe02c3253de7 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:27.671802 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-99738540-aa88-4525-8090-fe02c3253de7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:27.699465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99738540-aa88-4525-8090-fe02c3253de7 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:27.699726 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0998677-1d81-4794-a95a-58f0e4989409 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:27.704492 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c0f8a-ba4f-4efa-a0d7-f891a4659876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:27.705196 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c0f8a-ba4f-4efa-a0d7-f891a4659876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:27.705591 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c0f8a-ba4f-4efa-a0d7-f891a4659876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:27.705881 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c0f8a-ba4f-4efa-a0d7-f891a4659876 admin admin] PATH_INFO: `/v3/projects/aff68f67a0ca46aeb1bb7392bfa41bc0` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:27.707114 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c0f8a-ba4f-4efa-a0d7-f891a4659876 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aff68f67a0ca46aeb1bb7392bfa41bc0)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:27.709798 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c0f8a-ba4f-4efa-a0d7-f891a4659876 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:27.725364 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ac891-6ea4-4273-bea2-2fb7c42bbd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:27.725767 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ac891-6ea4-4273-bea2-2fb7c42bbd71 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:27.727121 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ac891-6ea4-4273-bea2-2fb7c42bbd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:27.727626 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ac891-6ea4-4273-bea2-2fb7c42bbd71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:27.728951 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ac891-6ea4-4273-bea2-2fb7c42bbd71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:27.733688 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ac891-6ea4-4273-bea2-2fb7c42bbd71 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:27.844504 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:27.888503 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-423c0f8a-ba4f-4efa-a0d7-f891a4659876 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aff68f67a0ca46aeb1bb7392bfa41bc0', 'request_id': 'req-423c0f8a-ba4f-4efa-a0d7-f891a4659876'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:27.923679 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1352/2745] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:19:27 2022] POST /identity/v3/projects => generated 373 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:19:27.927421 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ac891-6ea4-4273-bea2-2fb7c42bbd71 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:28.022673 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ac891-6ea4-4273-bea2-2fb7c42bbd71 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:28.028227 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-423c0f8a-ba4f-4efa-a0d7-f891a4659876 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aff68f67a0ca46aeb1bb7392bfa41bc0', 'request_id': 'req-423c0f8a-ba4f-4efa-a0d7-f891a4659876'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:28.030542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78eabcd-1022-43b1-8985-884b7ac8e30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:28.041759 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78eabcd-1022-43b1-8985-884b7ac8e30d admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:28.041759 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78eabcd-1022-43b1-8985-884b7ac8e30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:28.041759 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78eabcd-1022-43b1-8985-884b7ac8e30d admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:28.041759 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78eabcd-1022-43b1-8985-884b7ac8e30d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:28.041759 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78eabcd-1022-43b1-8985-884b7ac8e30d admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:28.042243 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-423c0f8a-ba4f-4efa-a0d7-f891a4659876 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aff68f67a0ca46aeb1bb7392bfa41bc0', 'request_id': 'req-423c0f8a-ba4f-4efa-a0d7-f891a4659876'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:28.055910 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-423c0f8a-ba4f-4efa-a0d7-f891a4659876 admin admin] The token cache is being invalidate because project aff68f67a0ca46aeb1bb7392bfa41bc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:19:28.057908 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-423c0f8a-ba4f-4efa-a0d7-f891a4659876 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:28.058719 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-423c0f8a-ba4f-4efa-a0d7-f891a4659876 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:28.064593 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1394/2746] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:19:27 2022] DELETE /identity/v3/projects/aff68f67a0ca46aeb1bb7392bfa41bc0 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:19:28.066494 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c0f8a-ba4f-4efa-a0d7-f891a4659876 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:28.070021 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-423c0f8a-ba4f-4efa-a0d7-f891a4659876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:28.134558 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1353/2747] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:19:27 2022] POST /identity/v3/users => generated 287 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:19:28.136022 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78eabcd-1022-43b1-8985-884b7ac8e30d admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:28.138469 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-c78eabcd-1022-43b1-8985-884b7ac8e30d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:28.155680 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78eabcd-1022-43b1-8985-884b7ac8e30d admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:28.155933 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c0f8a-ba4f-4efa-a0d7-f891a4659876 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:28.162463 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20496c30-b180-4175-b14f-97c733a3216d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:28.162736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee111b-0a89-44ee-b0e3-b3118f823812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:28.163160 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20496c30-b180-4175-b14f-97c733a3216d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:28.163380 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee111b-0a89-44ee-b0e3-b3118f823812 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:28.163493 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20496c30-b180-4175-b14f-97c733a3216d admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:28.163664 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee111b-0a89-44ee-b0e3-b3118f823812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:28.163856 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20496c30-b180-4175-b14f-97c733a3216d admin admin] PATH_INFO: `/v3/users/cac08832c02d4d96beae42ec4280b861` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:28.163960 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee111b-0a89-44ee-b0e3-b3118f823812 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:28.164684 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee111b-0a89-44ee-b0e3-b3118f823812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:28.165171 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20496c30-b180-4175-b14f-97c733a3216d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cac08832c02d4d96beae42ec4280b861)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:28.166421 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee111b-0a89-44ee-b0e3-b3118f823812 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:28.167102 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20496c30-b180-4175-b14f-97c733a3216d admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:28.182760 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1354/2748] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:19:28.188339 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee111b-0a89-44ee-b0e3-b3118f823812 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:28.202638 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee111b-0a89-44ee-b0e3-b3118f823812 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:28.211688 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b348e-0d6c-4be7-8b29-99417c47cbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:28.213105 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b348e-0d6c-4be7-8b29-99417c47cbe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:28.214095 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b348e-0d6c-4be7-8b29-99417c47cbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:28.214388 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b348e-0d6c-4be7-8b29-99417c47cbe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:28.215684 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b348e-0d6c-4be7-8b29-99417c47cbe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:28.218211 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b348e-0d6c-4be7-8b29-99417c47cbe6 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:28.232191 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1355/2749] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:19:28.237210 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b348e-0d6c-4be7-8b29-99417c47cbe6 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:28.250281 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b348e-0d6c-4be7-8b29-99417c47cbe6 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:28.257672 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78fc68-d21f-4843-8237-4b906145deb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:28.258710 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78fc68-d21f-4843-8237-4b906145deb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:28.259055 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78fc68-d21f-4843-8237-4b906145deb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:28.259474 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78fc68-d21f-4843-8237-4b906145deb6 admin admin] PATH_INFO: `/v3/projects/d161d2feb00e4986902d6fa841f0ca59/users/8636edba3b8a4d8ca7843b7d882300c0/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:28.304001 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78fc68-d21f-4843-8237-4b906145deb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d161d2feb00e4986902d6fa841f0ca59, user_id=8636edba3b8a4d8ca7843b7d882300c0, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:28.306794 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78fc68-d21f-4843-8237-4b906145deb6 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:28.385753 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1356/2750] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:19:28 2022] PUT /identity/v3/projects/d161d2feb00e4986902d6fa841f0ca59/users/8636edba3b8a4d8ca7843b7d882300c0/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:28.400720 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c798614-7594-435e-9a21-39b07a92de24 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:28.401281 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c798614-7594-435e-9a21-39b07a92de24 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:28.401790 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c798614-7594-435e-9a21-39b07a92de24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:28.468490 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-20496c30-b180-4175-b14f-97c733a3216d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cac08832c02d4d96beae42ec4280b861'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:28.480184 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-2c798614-7594-435e-9a21-39b07a92de24 None None] MFA Rules not processed for user `8636edba3b8a4d8ca7843b7d882300c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:28.481923 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-2c798614-7594-435e-9a21-39b07a92de24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:28.593024 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1357/2751] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:28.593252 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-20496c30-b180-4175-b14f-97c733a3216d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cac08832c02d4d96beae42ec4280b861'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:28.602333 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-20496c30-b180-4175-b14f-97c733a3216d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cac08832c02d4d96beae42ec4280b861'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:28.603085 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-20496c30-b180-4175-b14f-97c733a3216d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cac08832c02d4d96beae42ec4280b861'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:28.603859 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-20496c30-b180-4175-b14f-97c733a3216d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cac08832c02d4d96beae42ec4280b861'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:28.605107 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c798614-7594-435e-9a21-39b07a92de24 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:28.609706 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-2c798614-7594-435e-9a21-39b07a92de24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:28.626584 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:28.655910 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1395/2752] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:19:28 2022] DELETE /identity/v3/users/cac08832c02d4d96beae42ec4280b861 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:19:28.724404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c798614-7594-435e-9a21-39b07a92de24 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:28.824808 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38ffd4-b7c8-4fd7-939b-d0e2cda02cc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:28.826031 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38ffd4-b7c8-4fd7-939b-d0e2cda02cc8 service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:28.829434 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38ffd4-b7c8-4fd7-939b-d0e2cda02cc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:28.829434 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38ffd4-b7c8-4fd7-939b-d0e2cda02cc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:28.829434 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-2b38ffd4-b7c8-4fd7-939b-d0e2cda02cc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:28.917544 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b38ffd4-b7c8-4fd7-939b-d0e2cda02cc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:28.920081 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b38ffd4-b7c8-4fd7-939b-d0e2cda02cc8 service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:28.952221 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1358/2753] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:19:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:19:29.261499 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20496c30-b180-4175-b14f-97c733a3216d admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:29.264674 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-20496c30-b180-4175-b14f-97c733a3216d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:29.322428 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:29.359694 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20496c30-b180-4175-b14f-97c733a3216d admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:29.368624 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999bcc32-ead9-4678-a3c8-6b8a1bcb0405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:29.369534 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bcc32-ead9-4678-a3c8-6b8a1bcb0405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:29.369826 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bcc32-ead9-4678-a3c8-6b8a1bcb0405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:29.370106 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bcc32-ead9-4678-a3c8-6b8a1bcb0405 admin admin] PATH_INFO: `/v3/projects/f9cce8018cab438eb31618448245ad9e` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:29.371588 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999bcc32-ead9-4678-a3c8-6b8a1bcb0405 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9cce8018cab438eb31618448245ad9e)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:29.373617 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999bcc32-ead9-4678-a3c8-6b8a1bcb0405 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:29.538228 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-999bcc32-ead9-4678-a3c8-6b8a1bcb0405 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9cce8018cab438eb31618448245ad9e', 'request_id': 'req-999bcc32-ead9-4678-a3c8-6b8a1bcb0405'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:29.616809 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-999bcc32-ead9-4678-a3c8-6b8a1bcb0405 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9cce8018cab438eb31618448245ad9e', 'request_id': 'req-999bcc32-ead9-4678-a3c8-6b8a1bcb0405'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:29.623929 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-999bcc32-ead9-4678-a3c8-6b8a1bcb0405 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9cce8018cab438eb31618448245ad9e', 'request_id': 'req-999bcc32-ead9-4678-a3c8-6b8a1bcb0405'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:29.637084 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-999bcc32-ead9-4678-a3c8-6b8a1bcb0405 admin admin] The token cache is being invalidate because project f9cce8018cab438eb31618448245ad9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:19:29.637430 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-999bcc32-ead9-4678-a3c8-6b8a1bcb0405 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:29.638130 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-999bcc32-ead9-4678-a3c8-6b8a1bcb0405 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:29.639734 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1396/2754] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:19:29 2022] DELETE /identity/v3/projects/f9cce8018cab438eb31618448245ad9e => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:29.644133 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38ffd4-b7c8-4fd7-939b-d0e2cda02cc8 service cinder] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:29.659269 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38ffd4-b7c8-4fd7-939b-d0e2cda02cc8 service cinder] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:29.773119 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234ea1b-5135-4c44-b155-9fe346c0a51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:29.773717 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234ea1b-5135-4c44-b155-9fe346c0a51f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:29.773993 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234ea1b-5135-4c44-b155-9fe346c0a51f admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:29.774265 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234ea1b-5135-4c44-b155-9fe346c0a51f admin admin] PATH_INFO: `/v3/users/79d6184a96b94af89ae1c1e493fdda7b` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:29.775532 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234ea1b-5135-4c44-b155-9fe346c0a51f admin admin] RBAC: Authorizing `identity:delete_user(user_id=79d6184a96b94af89ae1c1e493fdda7b)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:29.777535 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234ea1b-5135-4c44-b155-9fe346c0a51f admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:29.792523 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:30.156638 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-b234ea1b-5135-4c44-b155-9fe346c0a51f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79d6184a96b94af89ae1c1e493fdda7b'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:30.167251 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-b234ea1b-5135-4c44-b155-9fe346c0a51f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79d6184a96b94af89ae1c1e493fdda7b'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:30.168070 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-b234ea1b-5135-4c44-b155-9fe346c0a51f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79d6184a96b94af89ae1c1e493fdda7b'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:30.250057 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-b234ea1b-5135-4c44-b155-9fe346c0a51f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79d6184a96b94af89ae1c1e493fdda7b'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:30.292618 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-b234ea1b-5135-4c44-b155-9fe346c0a51f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79d6184a96b94af89ae1c1e493fdda7b'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:30.304309 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1359/2755] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:19:29 2022] DELETE /identity/v3/users/79d6184a96b94af89ae1c1e493fdda7b => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:30.841421 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999bcc32-ead9-4678-a3c8-6b8a1bcb0405 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:30.842863 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-999bcc32-ead9-4678-a3c8-6b8a1bcb0405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:30.858379 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999bcc32-ead9-4678-a3c8-6b8a1bcb0405 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:30.932465 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d42109-83bf-4135-8dc3-7826631a84da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:30.933133 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d42109-83bf-4135-8dc3-7826631a84da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:30.933417 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d42109-83bf-4135-8dc3-7826631a84da admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:30.933697 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d42109-83bf-4135-8dc3-7826631a84da admin admin] PATH_INFO: `/v3/projects/a4edade9b1384c80aab88460bfc03077` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:30.934937 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d42109-83bf-4135-8dc3-7826631a84da admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4edade9b1384c80aab88460bfc03077)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:30.936969 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d42109-83bf-4135-8dc3-7826631a84da admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:31.083966 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-75d42109-83bf-4135-8dc3-7826631a84da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4edade9b1384c80aab88460bfc03077', 'request_id': 'req-75d42109-83bf-4135-8dc3-7826631a84da'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:31.189537 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-75d42109-83bf-4135-8dc3-7826631a84da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4edade9b1384c80aab88460bfc03077', 'request_id': 'req-75d42109-83bf-4135-8dc3-7826631a84da'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:31.198337 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-75d42109-83bf-4135-8dc3-7826631a84da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4edade9b1384c80aab88460bfc03077', 'request_id': 'req-75d42109-83bf-4135-8dc3-7826631a84da'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:31.200282 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:31.210690 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-75d42109-83bf-4135-8dc3-7826631a84da admin admin] The token cache is being invalidate because project a4edade9b1384c80aab88460bfc03077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:19:31.210980 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-75d42109-83bf-4135-8dc3-7826631a84da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:31.211658 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-75d42109-83bf-4135-8dc3-7826631a84da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:31.213250 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1397/2756] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:19:30 2022] DELETE /identity/v3/projects/a4edade9b1384c80aab88460bfc03077 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:31.222608 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8e4f3-78e0-49c9-aca3-d05f8152157d None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:31.223125 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8e4f3-78e0-49c9-aca3-d05f8152157d None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:31.223224 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8e4f3-78e0-49c9-aca3-d05f8152157d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:31.243567 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-03a8e4f3-78e0-49c9-aca3-d05f8152157d None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:31.244827 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-03a8e4f3-78e0-49c9-aca3-d05f8152157d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:31.311651 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1360/2757] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:31.320221 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61d587-6fad-4668-aec5-58de8ae82bbf None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:31.320512 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61d587-6fad-4668-aec5-58de8ae82bbf None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:31.320798 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61d587-6fad-4668-aec5-58de8ae82bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:31.342813 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-0b61d587-6fad-4668-aec5-58de8ae82bbf None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:31.344017 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-0b61d587-6fad-4668-aec5-58de8ae82bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:31.353845 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1398/2758] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:31.358687 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8e4f3-78e0-49c9-aca3-d05f8152157d None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:31.371523 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8e4f3-78e0-49c9-aca3-d05f8152157d None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:31.376627 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c5e38-83b4-449d-bc15-7a79f88ba6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:31.377414 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c5e38-83b4-449d-bc15-7a79f88ba6f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:31.377816 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c5e38-83b4-449d-bc15-7a79f88ba6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:31.378298 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c5e38-83b4-449d-bc15-7a79f88ba6f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:31.379604 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c5e38-83b4-449d-bc15-7a79f88ba6f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:19:31.380191 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c5e38-83b4-449d-bc15-7a79f88ba6f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:31.383339 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c5e38-83b4-449d-bc15-7a79f88ba6f6 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:31.404579 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1361/2759] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:19:31.409251 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61d587-6fad-4668-aec5-58de8ae82bbf None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:31.419745 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61d587-6fad-4668-aec5-58de8ae82bbf None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:31.424561 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639471a3-33e4-41fb-8a7d-53815bd3979e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:31.425186 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639471a3-33e4-41fb-8a7d-53815bd3979e admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:31.425468 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639471a3-33e4-41fb-8a7d-53815bd3979e admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:31.425743 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639471a3-33e4-41fb-8a7d-53815bd3979e admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:31.426426 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639471a3-33e4-41fb-8a7d-53815bd3979e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:31.428463 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639471a3-33e4-41fb-8a7d-53815bd3979e admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:31.549243 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1399/2760] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:19:31 2022] POST /identity/v3/projects => generated 379 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:19:31.554280 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c5e38-83b4-449d-bc15-7a79f88ba6f6 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:31.565736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c5e38-83b4-449d-bc15-7a79f88ba6f6 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:31.633301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2271a74-2a54-4fbc-af72-f0440873e622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:31.633929 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2271a74-2a54-4fbc-af72-f0440873e622 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:31.634279 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2271a74-2a54-4fbc-af72-f0440873e622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:31.634550 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2271a74-2a54-4fbc-af72-f0440873e622 admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:31.635233 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2271a74-2a54-4fbc-af72-f0440873e622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:31.637193 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2271a74-2a54-4fbc-af72-f0440873e622 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:31.710382 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1362/2761] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:19:31 2022] POST /identity/v3/users => generated 290 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:19:31.714711 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639471a3-33e4-41fb-8a7d-53815bd3979e admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:31.726223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639471a3-33e4-41fb-8a7d-53815bd3979e admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:31.731057 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6f3f6-b05d-4de1-ae88-bf58d1778c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:31.731722 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6f3f6-b05d-4de1-ae88-bf58d1778c35 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:31.731991 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6f3f6-b05d-4de1-ae88-bf58d1778c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:31.732299 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6f3f6-b05d-4de1-ae88-bf58d1778c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:31.732997 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6f3f6-b05d-4de1-ae88-bf58d1778c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:31.734657 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6f3f6-b05d-4de1-ae88-bf58d1778c35 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:31.745500 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1400/2762] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:19:31.750045 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2271a74-2a54-4fbc-af72-f0440873e622 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:31.763854 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2271a74-2a54-4fbc-af72-f0440873e622 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:31.768858 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24379846-9cc8-456f-ae93-777425c3dbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:31.769605 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24379846-9cc8-456f-ae93-777425c3dbe0 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:31.769908 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24379846-9cc8-456f-ae93-777425c3dbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:31.770210 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24379846-9cc8-456f-ae93-777425c3dbe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:31.771959 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24379846-9cc8-456f-ae93-777425c3dbe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:31.773734 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24379846-9cc8-456f-ae93-777425c3dbe0 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:31.777193 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:31.788989 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1363/2763] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:19:31.796402 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6f3f6-b05d-4de1-ae88-bf58d1778c35 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:31.809011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6f3f6-b05d-4de1-ae88-bf58d1778c35 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:31.814701 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ec8d0-d0d0-4bee-b905-bf38c8dc5947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:31.815413 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ec8d0-d0d0-4bee-b905-bf38c8dc5947 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:31.815696 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ec8d0-d0d0-4bee-b905-bf38c8dc5947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:31.815976 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ec8d0-d0d0-4bee-b905-bf38c8dc5947 admin admin] PATH_INFO: `/v3/projects/9f1ddb75360142ca9917b400d64ea31a/users/297363623a414c9385218af1f4ea2424/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:31.847700 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33ec8d0-d0d0-4bee-b905-bf38c8dc5947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f1ddb75360142ca9917b400d64ea31a, user_id=297363623a414c9385218af1f4ea2424, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:31.851491 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33ec8d0-d0d0-4bee-b905-bf38c8dc5947 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:31.967985 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1401/2764] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:19:31 2022] PUT /identity/v3/projects/9f1ddb75360142ca9917b400d64ea31a/users/297363623a414c9385218af1f4ea2424/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:31.980390 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2caac3-067b-4de7-bb5e-a2686e457966 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:31.981071 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2caac3-067b-4de7-bb5e-a2686e457966 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:31.982261 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2caac3-067b-4de7-bb5e-a2686e457966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:32.032080 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-7a2caac3-067b-4de7-bb5e-a2686e457966 None None] MFA Rules not processed for user `297363623a414c9385218af1f4ea2424`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:32.033579 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-7a2caac3-067b-4de7-bb5e-a2686e457966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:32.127890 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1364/2765] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:32.133084 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ec8d0-d0d0-4bee-b905-bf38c8dc5947 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:32.241689 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ec8d0-d0d0-4bee-b905-bf38c8dc5947 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:32.247652 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8fef6f-41c4-474f-b51b-14125324c4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:32.248343 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fef6f-41c4-474f-b51b-14125324c4fd admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:32.252425 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fef6f-41c4-474f-b51b-14125324c4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:32.252425 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fef6f-41c4-474f-b51b-14125324c4fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:32.252425 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8fef6f-41c4-474f-b51b-14125324c4fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:32.252425 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8fef6f-41c4-474f-b51b-14125324c4fd admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:32.410239 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1402/2766] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:19:32 2022] POST /identity/v3/projects => generated 381 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:19:32.418568 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2caac3-067b-4de7-bb5e-a2686e457966 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:32.443880 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2caac3-067b-4de7-bb5e-a2686e457966 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:32.571331 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81fae4f-0c86-4dde-adbe-61971e07b4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:32.572005 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fae4f-0c86-4dde-adbe-61971e07b4eb admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:32.572577 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fae4f-0c86-4dde-adbe-61971e07b4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:32.573078 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fae4f-0c86-4dde-adbe-61971e07b4eb admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:32.573921 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81fae4f-0c86-4dde-adbe-61971e07b4eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:32.576092 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81fae4f-0c86-4dde-adbe-61971e07b4eb admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:32.668285 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1365/2767] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:19:32 2022] POST /identity/v3/users => generated 297 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:19:32.672925 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8fef6f-41c4-474f-b51b-14125324c4fd admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:32.699710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8fef6f-41c4-474f-b51b-14125324c4fd admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:32.725458 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4824e-4e48-42fd-8de9-9f71e03d92a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:32.726709 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4824e-4e48-42fd-8de9-9f71e03d92a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:32.727226 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4824e-4e48-42fd-8de9-9f71e03d92a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:32.727738 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4824e-4e48-42fd-8de9-9f71e03d92a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:32.729201 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c4824e-4e48-42fd-8de9-9f71e03d92a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:32.732366 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c4824e-4e48-42fd-8de9-9f71e03d92a8 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:32.755931 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1403/2768] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:19:32.767510 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81fae4f-0c86-4dde-adbe-61971e07b4eb admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:32.803177 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81fae4f-0c86-4dde-adbe-61971e07b4eb admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:32.813606 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c4a42-8e28-476e-970b-3b60948a3765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:32.818566 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c4a42-8e28-476e-970b-3b60948a3765 admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:32.821106 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c4a42-8e28-476e-970b-3b60948a3765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:32.821779 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c4a42-8e28-476e-970b-3b60948a3765 admin admin] PATH_INFO: `/v3/projects/8ba831a0acba47b3b2c4abaa2d292a61/users/87aa30379d984e1392f31ba838cdf0dd/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:32.857560 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c4a42-8e28-476e-970b-3b60948a3765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ba831a0acba47b3b2c4abaa2d292a61, user_id=87aa30379d984e1392f31ba838cdf0dd, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:32.866519 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c4a42-8e28-476e-970b-3b60948a3765 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:32.948509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1366/2769] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:19:32 2022] PUT /identity/v3/projects/8ba831a0acba47b3b2c4abaa2d292a61/users/87aa30379d984e1392f31ba838cdf0dd/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:32.955209 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4824e-4e48-42fd-8de9-9f71e03d92a8 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:32.993164 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4824e-4e48-42fd-8de9-9f71e03d92a8 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:32.998668 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b0763-068a-42e0-a6f2-a4e0bbfc6669 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:32.999153 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b0763-068a-42e0-a6f2-a4e0bbfc6669 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:32.999574 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b0763-068a-42e0-a6f2-a4e0bbfc6669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:33.040456 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-819b0763-068a-42e0-a6f2-a4e0bbfc6669 None None] MFA Rules not processed for user `8636edba3b8a4d8ca7843b7d882300c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:33.045096 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-819b0763-068a-42e0-a6f2-a4e0bbfc6669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:33.123515 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3eb42d-8a92-42e3-8776-c0adbf1cdf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:33.123515 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3eb42d-8a92-42e3-8776-c0adbf1cdf70 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:33.123515 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3eb42d-8a92-42e3-8776-c0adbf1cdf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:33.124194 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3eb42d-8a92-42e3-8776-c0adbf1cdf70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:33.124829 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3eb42d-8a92-42e3-8776-c0adbf1cdf70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:33.126631 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3eb42d-8a92-42e3-8776-c0adbf1cdf70 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:33.150993 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1404/2770] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:19:33.152120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3eb42d-8a92-42e3-8776-c0adbf1cdf70 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:33.159014 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:33.160210 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:33.165765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3eb42d-8a92-42e3-8776-c0adbf1cdf70 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:33.172608 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861aa20-4423-483a-96f9-8add3b1abb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:33.173515 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1367/2771] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:33.175099 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861aa20-4423-483a-96f9-8add3b1abb38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:33.175508 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861aa20-4423-483a-96f9-8add3b1abb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:33.175872 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861aa20-4423-483a-96f9-8add3b1abb38 admin admin] PATH_INFO: `/v3/projects/8ba831a0acba47b3b2c4abaa2d292a61/users/87aa30379d984e1392f31ba838cdf0dd/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:33.199072 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6861aa20-4423-483a-96f9-8add3b1abb38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ba831a0acba47b3b2c4abaa2d292a61, user_id=87aa30379d984e1392f31ba838cdf0dd, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:33.202759 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6861aa20-4423-483a-96f9-8add3b1abb38 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:33.224536 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1405/2772] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:19:33 2022] PUT /identity/v3/projects/8ba831a0acba47b3b2c4abaa2d292a61/users/87aa30379d984e1392f31ba838cdf0dd/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:33.236725 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090370d-64de-42c3-beeb-93cb0a23d296 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:33.237048 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090370d-64de-42c3-beeb-93cb0a23d296 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:33.237446 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090370d-64de-42c3-beeb-93cb0a23d296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:33.287095 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-8090370d-64de-42c3-beeb-93cb0a23d296 None None] MFA Rules not processed for user `87aa30379d984e1392f31ba838cdf0dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:33.288675 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-8090370d-64de-42c3-beeb-93cb0a23d296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:33.460069 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1368/2773] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:33 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:33.471724 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861aa20-4423-483a-96f9-8add3b1abb38 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:33.478966 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-6861aa20-4423-483a-96f9-8add3b1abb38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:33.639858 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861aa20-4423-483a-96f9-8add3b1abb38 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:33.649841 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372473b-ea41-4410-9082-439d47532751 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:33.651176 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372473b-ea41-4410-9082-439d47532751 service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:33.651898 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372473b-ea41-4410-9082-439d47532751 service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:33.652450 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372473b-ea41-4410-9082-439d47532751 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:33.678223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372473b-ea41-4410-9082-439d47532751 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:33.681498 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372473b-ea41-4410-9082-439d47532751 service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:33.696916 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1406/2774] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:19:33 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:19:34.607523 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090370d-64de-42c3-beeb-93cb0a23d296 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:34.709142 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090370d-64de-42c3-beeb-93cb0a23d296 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:34.714392 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea079f-aecc-4869-9077-0250481c248f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:34.715111 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea079f-aecc-4869-9077-0250481c248f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:34.715551 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea079f-aecc-4869-9077-0250481c248f admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:34.715766 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea079f-aecc-4869-9077-0250481c248f admin admin] PATH_INFO: `/v3/users/297363623a414c9385218af1f4ea2424` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:34.721722 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea079f-aecc-4869-9077-0250481c248f admin admin] RBAC: Authorizing `identity:delete_user(user_id=297363623a414c9385218af1f4ea2424)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:34.725197 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea079f-aecc-4869-9077-0250481c248f admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:35.302886 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-e8ea079f-aecc-4869-9077-0250481c248f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '297363623a414c9385218af1f4ea2424'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:35.314416 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-e8ea079f-aecc-4869-9077-0250481c248f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '297363623a414c9385218af1f4ea2424'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:35.315292 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-e8ea079f-aecc-4869-9077-0250481c248f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '297363623a414c9385218af1f4ea2424'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:35.411657 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-e8ea079f-aecc-4869-9077-0250481c248f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '297363623a414c9385218af1f4ea2424'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:35.428342 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-e8ea079f-aecc-4869-9077-0250481c248f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '297363623a414c9385218af1f4ea2424'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:35.441179 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b1ff2-8af4-4fdc-ae60-d98a648c75e5 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:35.442013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b1ff2-8af4-4fdc-ae60-d98a648c75e5 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:35.442013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b1ff2-8af4-4fdc-ae60-d98a648c75e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:35.445868 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1369/2775] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:19:34 2022] DELETE /identity/v3/users/297363623a414c9385218af1f4ea2424 => generated 0 bytes in 832 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:35.469787 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-ff1b1ff2-8af4-4fdc-ae60-d98a648c75e5 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:35.471249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-ff1b1ff2-8af4-4fdc-ae60-d98a648c75e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:35.577965 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1407/2776] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:35.588912 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea079f-aecc-4869-9077-0250481c248f admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:35.590947 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-e8ea079f-aecc-4869-9077-0250481c248f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:35.596954 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:35.714563 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea079f-aecc-4869-9077-0250481c248f admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:35.720506 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91facf-a80e-4802-b776-db6272b39339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:35.721178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91facf-a80e-4802-b776-db6272b39339 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:35.721464 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91facf-a80e-4802-b776-db6272b39339 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:35.721732 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91facf-a80e-4802-b776-db6272b39339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:35.736316 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91facf-a80e-4802-b776-db6272b39339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:35.738241 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91facf-a80e-4802-b776-db6272b39339 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:35.774257 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1370/2777] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:19:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:19:36.431838 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b1ff2-8af4-4fdc-ae60-d98a648c75e5 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:36.434007 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-ff1b1ff2-8af4-4fdc-ae60-d98a648c75e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:36.479882 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b1ff2-8af4-4fdc-ae60-d98a648c75e5 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:36.491595 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee249b-b348-4613-a8b7-9d665874532f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:36.492428 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee249b-b348-4613-a8b7-9d665874532f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:36.492734 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee249b-b348-4613-a8b7-9d665874532f admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:36.493066 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee249b-b348-4613-a8b7-9d665874532f admin admin] PATH_INFO: `/v3/projects/9f1ddb75360142ca9917b400d64ea31a` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:36.495014 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee249b-b348-4613-a8b7-9d665874532f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f1ddb75360142ca9917b400d64ea31a)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:36.498837 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee249b-b348-4613-a8b7-9d665874532f admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:36.697035 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-54ee249b-b348-4613-a8b7-9d665874532f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f1ddb75360142ca9917b400d64ea31a', 'request_id': 'req-54ee249b-b348-4613-a8b7-9d665874532f'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:36.806941 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-54ee249b-b348-4613-a8b7-9d665874532f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f1ddb75360142ca9917b400d64ea31a', 'request_id': 'req-54ee249b-b348-4613-a8b7-9d665874532f'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:36.831165 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-54ee249b-b348-4613-a8b7-9d665874532f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f1ddb75360142ca9917b400d64ea31a', 'request_id': 'req-54ee249b-b348-4613-a8b7-9d665874532f'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:36.851195 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-54ee249b-b348-4613-a8b7-9d665874532f admin admin] The token cache is being invalidate because project 9f1ddb75360142ca9917b400d64ea31a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:19:36.851475 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-54ee249b-b348-4613-a8b7-9d665874532f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:36.852215 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-54ee249b-b348-4613-a8b7-9d665874532f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:36.858013 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91facf-a80e-4802-b776-db6272b39339 service neutron] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:36.860027 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1408/2778] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:19:36 2022] DELETE /identity/v3/projects/9f1ddb75360142ca9917b400d64ea31a => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:36.873155 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91facf-a80e-4802-b776-db6272b39339 service neutron] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:36.975467 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f55c90-deec-4618-98ab-aeda44e94806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:36.976181 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f55c90-deec-4618-98ab-aeda44e94806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:36.976509 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f55c90-deec-4618-98ab-aeda44e94806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:36.976886 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f55c90-deec-4618-98ab-aeda44e94806 admin admin] PATH_INFO: `/v3/users/87aa30379d984e1392f31ba838cdf0dd` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:36.978097 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f55c90-deec-4618-98ab-aeda44e94806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87aa30379d984e1392f31ba838cdf0dd)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:36.980049 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f55c90-deec-4618-98ab-aeda44e94806 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:37.302363 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-c9f55c90-deec-4618-98ab-aeda44e94806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87aa30379d984e1392f31ba838cdf0dd'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:37.312906 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-c9f55c90-deec-4618-98ab-aeda44e94806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87aa30379d984e1392f31ba838cdf0dd'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:37.313676 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-c9f55c90-deec-4618-98ab-aeda44e94806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87aa30379d984e1392f31ba838cdf0dd'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:37.390790 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-c9f55c90-deec-4618-98ab-aeda44e94806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87aa30379d984e1392f31ba838cdf0dd'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:37.429899 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-c9f55c90-deec-4618-98ab-aeda44e94806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87aa30379d984e1392f31ba838cdf0dd'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:37.448442 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1371/2779] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:19:36 2022] DELETE /identity/v3/users/87aa30379d984e1392f31ba838cdf0dd => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:19:38.159563 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee249b-b348-4613-a8b7-9d665874532f admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:38.162043 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-54ee249b-b348-4613-a8b7-9d665874532f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:38.191349 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee249b-b348-4613-a8b7-9d665874532f admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:38.223935 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:38.308904 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca03287-2cdd-42ac-80fc-fb0ef18821bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:38.309399 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca03287-2cdd-42ac-80fc-fb0ef18821bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:38.309686 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca03287-2cdd-42ac-80fc-fb0ef18821bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:38.310011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca03287-2cdd-42ac-80fc-fb0ef18821bf admin admin] PATH_INFO: `/v3/projects/8ba831a0acba47b3b2c4abaa2d292a61` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:38.311766 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca03287-2cdd-42ac-80fc-fb0ef18821bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ba831a0acba47b3b2c4abaa2d292a61)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:38.313971 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca03287-2cdd-42ac-80fc-fb0ef18821bf admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:38.436958 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-dca03287-2cdd-42ac-80fc-fb0ef18821bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ba831a0acba47b3b2c4abaa2d292a61', 'request_id': 'req-dca03287-2cdd-42ac-80fc-fb0ef18821bf'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:38.447409 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f55c90-deec-4618-98ab-aeda44e94806 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:38.449311 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-c9f55c90-deec-4618-98ab-aeda44e94806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:38.464969 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f55c90-deec-4618-98ab-aeda44e94806 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:38.501289 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:38.578938 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-dca03287-2cdd-42ac-80fc-fb0ef18821bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ba831a0acba47b3b2c4abaa2d292a61', 'request_id': 'req-dca03287-2cdd-42ac-80fc-fb0ef18821bf'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:38.589409 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-dca03287-2cdd-42ac-80fc-fb0ef18821bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ba831a0acba47b3b2c4abaa2d292a61', 'request_id': 'req-dca03287-2cdd-42ac-80fc-fb0ef18821bf'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:38.603424 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4270f-fa82-4138-9e04-12023cbacf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:38.603978 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-dca03287-2cdd-42ac-80fc-fb0ef18821bf admin admin] The token cache is being invalidate because project 8ba831a0acba47b3b2c4abaa2d292a61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:19:38.604466 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-dca03287-2cdd-42ac-80fc-fb0ef18821bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:38.605088 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4270f-fa82-4138-9e04-12023cbacf73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:38.605290 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-dca03287-2cdd-42ac-80fc-fb0ef18821bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:38.605751 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4270f-fa82-4138-9e04-12023cbacf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:38.606335 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4270f-fa82-4138-9e04-12023cbacf73 admin admin] PATH_INFO: `/v3/users/6450c906008d492bb547148d274909bd` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:38.607089 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1409/2780] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:19:38 2022] DELETE /identity/v3/projects/8ba831a0acba47b3b2c4abaa2d292a61 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:38.608771 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4270f-fa82-4138-9e04-12023cbacf73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6450c906008d492bb547148d274909bd)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:38.612863 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4270f-fa82-4138-9e04-12023cbacf73 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:38.614230 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd707bf-2603-440d-92e0-a0a26dc816e2 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:38.614622 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd707bf-2603-440d-92e0-a0a26dc816e2 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:38.614967 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd707bf-2603-440d-92e0-a0a26dc816e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:38.644246 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-7cd707bf-2603-440d-92e0-a0a26dc816e2 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:38.646576 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-7cd707bf-2603-440d-92e0-a0a26dc816e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:38.656470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1410/2781] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:38.666198 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b75c7a-fab3-498a-a342-80356b07d752 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:38.666778 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b75c7a-fab3-498a-a342-80356b07d752 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:38.667271 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b75c7a-fab3-498a-a342-80356b07d752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:38.707495 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-d4b75c7a-fab3-498a-a342-80356b07d752 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:38.711946 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-d4b75c7a-fab3-498a-a342-80356b07d752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:38.727086 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1411/2782] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:38.733833 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b75c7a-fab3-498a-a342-80356b07d752 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:38.749720 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b75c7a-fab3-498a-a342-80356b07d752 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:38.757244 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee142c2e-c4cf-4baa-81b3-b8866f941a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:38.757893 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee142c2e-c4cf-4baa-81b3-b8866f941a6d admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:38.758179 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee142c2e-c4cf-4baa-81b3-b8866f941a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:38.758455 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee142c2e-c4cf-4baa-81b3-b8866f941a6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:38.759172 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee142c2e-c4cf-4baa-81b3-b8866f941a6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:19:38.759560 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee142c2e-c4cf-4baa-81b3-b8866f941a6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:38.761192 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee142c2e-c4cf-4baa-81b3-b8866f941a6d admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:38.777680 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1412/2783] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:19:38.782308 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee142c2e-c4cf-4baa-81b3-b8866f941a6d admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:38.807113 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee142c2e-c4cf-4baa-81b3-b8866f941a6d admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:38.828273 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bbf9c-bb50-493c-99dc-b3816a580e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:38.830405 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bbf9c-bb50-493c-99dc-b3816a580e16 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:38.830545 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bbf9c-bb50-493c-99dc-b3816a580e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:38.831106 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bbf9c-bb50-493c-99dc-b3816a580e16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:38.832490 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158bbf9c-bb50-493c-99dc-b3816a580e16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:38.841764 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158bbf9c-bb50-493c-99dc-b3816a580e16 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:38.877816 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-20c4270f-fa82-4138-9e04-12023cbacf73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6450c906008d492bb547148d274909bd'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:38.891931 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-20c4270f-fa82-4138-9e04-12023cbacf73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6450c906008d492bb547148d274909bd'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:38.893139 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-20c4270f-fa82-4138-9e04-12023cbacf73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6450c906008d492bb547148d274909bd'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:39.008559 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1413/2784] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:19:38 2022] POST /identity/v3/projects => generated 375 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:19:39.012490 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bbf9c-bb50-493c-99dc-b3816a580e16 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:39.015026 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-158bbf9c-bb50-493c-99dc-b3816a580e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:39.027488 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-20c4270f-fa82-4138-9e04-12023cbacf73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6450c906008d492bb547148d274909bd'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:39.046119 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-20c4270f-fa82-4138-9e04-12023cbacf73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6450c906008d492bb547148d274909bd'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:39.061021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1372/2785] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:19:38 2022] DELETE /identity/v3/users/6450c906008d492bb547148d274909bd => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:39.071514 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64f63b-a3b9-4ee2-b8b8-b5c3344e0105 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:39.072914 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64f63b-a3b9-4ee2-b8b8-b5c3344e0105 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:39.073453 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64f63b-a3b9-4ee2-b8b8-b5c3344e0105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:39.104713 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-df64f63b-a3b9-4ee2-b8b8-b5c3344e0105 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:39.107773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-df64f63b-a3b9-4ee2-b8b8-b5c3344e0105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:39.108659 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:39.114774 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bbf9c-bb50-493c-99dc-b3816a580e16 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:39.203090 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c907a-9112-4f1b-a650-ac2b42bf3644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:39.205638 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c907a-9112-4f1b-a650-ac2b42bf3644 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:39.206168 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c907a-9112-4f1b-a650-ac2b42bf3644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:39.206819 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c907a-9112-4f1b-a650-ac2b42bf3644 admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:39.208859 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c907a-9112-4f1b-a650-ac2b42bf3644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:39.212357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1373/2786] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:39.216044 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c907a-9112-4f1b-a650-ac2b42bf3644 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:39.221898 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64f63b-a3b9-4ee2-b8b8-b5c3344e0105 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:39.224125 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-df64f63b-a3b9-4ee2-b8b8-b5c3344e0105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:39.331430 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64f63b-a3b9-4ee2-b8b8-b5c3344e0105 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:39.354908 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7be53-30f4-47ea-b3a0-ca037d812b99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:39.355582 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7be53-30f4-47ea-b3a0-ca037d812b99 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:39.355915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7be53-30f4-47ea-b3a0-ca037d812b99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:39.356215 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7be53-30f4-47ea-b3a0-ca037d812b99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:39.374948 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1414/2787] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:19:39 2022] POST /identity/v3/users => generated 288 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:19:39.381045 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c907a-9112-4f1b-a650-ac2b42bf3644 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:39.388655 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7be53-30f4-47ea-b3a0-ca037d812b99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:39.397582 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7be53-30f4-47ea-b3a0-ca037d812b99 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:39.410353 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c907a-9112-4f1b-a650-ac2b42bf3644 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:39.421506 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90974bb0-0829-40ab-9ed4-10af1e59f785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:39.422339 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90974bb0-0829-40ab-9ed4-10af1e59f785 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:39.422765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90974bb0-0829-40ab-9ed4-10af1e59f785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:39.423280 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90974bb0-0829-40ab-9ed4-10af1e59f785 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:39.424134 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1374/2788] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:19:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:19:39.427640 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90974bb0-0829-40ab-9ed4-10af1e59f785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:39.431059 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90974bb0-0829-40ab-9ed4-10af1e59f785 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:39.469932 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1415/2789] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:19:39.472055 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7be53-30f4-47ea-b3a0-ca037d812b99 service neutron] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:39.492843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:39.529726 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7be53-30f4-47ea-b3a0-ca037d812b99 service neutron] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:39.561721 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f48e22-aaf8-4330-b9e5-3f02e4ba5634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:39.563192 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f48e22-aaf8-4330-b9e5-3f02e4ba5634 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:39.565595 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f48e22-aaf8-4330-b9e5-3f02e4ba5634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:39.566236 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f48e22-aaf8-4330-b9e5-3f02e4ba5634 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:39.570353 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f48e22-aaf8-4330-b9e5-3f02e4ba5634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:39.574608 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f48e22-aaf8-4330-b9e5-3f02e4ba5634 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:39.612084 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1375/2790] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:19:39.615557 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90974bb0-0829-40ab-9ed4-10af1e59f785 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:39.650862 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90974bb0-0829-40ab-9ed4-10af1e59f785 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:39.664903 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0dc4b-31cd-4b2b-8b28-2612406863c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:39.665621 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0dc4b-31cd-4b2b-8b28-2612406863c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:39.665906 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0dc4b-31cd-4b2b-8b28-2612406863c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:39.666772 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0dc4b-31cd-4b2b-8b28-2612406863c4 admin admin] PATH_INFO: `/v3/projects/a1c20f08a6164105b8a3222df1eb858b/users/de9ff40d2b314445b49ace18d97df7fb/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:39.709055 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0dc4b-31cd-4b2b-8b28-2612406863c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1c20f08a6164105b8a3222df1eb858b, user_id=de9ff40d2b314445b49ace18d97df7fb, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:39.717959 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0dc4b-31cd-4b2b-8b28-2612406863c4 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:39.853972 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1416/2791] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:19:39 2022] PUT /identity/v3/projects/a1c20f08a6164105b8a3222df1eb858b/users/de9ff40d2b314445b49ace18d97df7fb/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:19:39.874232 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068e662-0f2e-44ce-a083-4dc4c7d1c920 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:39.892004 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068e662-0f2e-44ce-a083-4dc4c7d1c920 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:39.892004 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068e662-0f2e-44ce-a083-4dc4c7d1c920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:39.923109 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-f068e662-0f2e-44ce-a083-4dc4c7d1c920 None None] MFA Rules not processed for user `de9ff40d2b314445b49ace18d97df7fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:39.924436 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-f068e662-0f2e-44ce-a083-4dc4c7d1c920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:40.049160 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1376/2792] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:40.080866 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0dc4b-31cd-4b2b-8b28-2612406863c4 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:40.083056 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-33f0dc4b-31cd-4b2b-8b28-2612406863c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:40.163231 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0dc4b-31cd-4b2b-8b28-2612406863c4 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:40.167257 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db622f8-fe84-4985-a498-aa909ccfc2a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:40.167919 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db622f8-fe84-4985-a498-aa909ccfc2a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:40.168228 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db622f8-fe84-4985-a498-aa909ccfc2a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:40.168796 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db622f8-fe84-4985-a498-aa909ccfc2a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:40.181792 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db622f8-fe84-4985-a498-aa909ccfc2a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:40.183336 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db622f8-fe84-4985-a498-aa909ccfc2a4 service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:40.195647 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1417/2793] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:19:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:19:40.321105 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068e662-0f2e-44ce-a083-4dc4c7d1c920 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:40.322979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-f068e662-0f2e-44ce-a083-4dc4c7d1c920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:40.445133 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068e662-0f2e-44ce-a083-4dc4c7d1c920 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:40.451245 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f6976-8582-4614-860b-01cad6332056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:40.452204 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f6976-8582-4614-860b-01cad6332056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:40.452635 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f6976-8582-4614-860b-01cad6332056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:40.453059 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f6976-8582-4614-860b-01cad6332056 admin admin] PATH_INFO: `/v3/projects/02b4eb99994c46ff8dcaf4c6478d7b0f` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:40.459700 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69f6976-8582-4614-860b-01cad6332056 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02b4eb99994c46ff8dcaf4c6478d7b0f)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:40.462684 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69f6976-8582-4614-860b-01cad6332056 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:40.664778 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-d69f6976-8582-4614-860b-01cad6332056 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02b4eb99994c46ff8dcaf4c6478d7b0f', 'request_id': 'req-d69f6976-8582-4614-860b-01cad6332056'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:40.671768 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-d69f6976-8582-4614-860b-01cad6332056 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02b4eb99994c46ff8dcaf4c6478d7b0f', 'request_id': 'req-d69f6976-8582-4614-860b-01cad6332056'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:40.679688 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-d69f6976-8582-4614-860b-01cad6332056 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02b4eb99994c46ff8dcaf4c6478d7b0f', 'request_id': 'req-d69f6976-8582-4614-860b-01cad6332056'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:40.683843 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:40.834922 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-d69f6976-8582-4614-860b-01cad6332056 admin admin] The token cache is being invalidate because project 02b4eb99994c46ff8dcaf4c6478d7b0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:19:40.835433 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-d69f6976-8582-4614-860b-01cad6332056 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:40.836588 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-d69f6976-8582-4614-860b-01cad6332056 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:40.842069 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1377/2794] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:19:40 2022] DELETE /identity/v3/projects/02b4eb99994c46ff8dcaf4c6478d7b0f => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:40.847678 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e093f-5133-4f61-9b32-070634e11ccb None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:40.849132 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e093f-5133-4f61-9b32-070634e11ccb None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:40.849132 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e093f-5133-4f61-9b32-070634e11ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:40.876092 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-8f3e093f-5133-4f61-9b32-070634e11ccb None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:40.877395 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-8f3e093f-5133-4f61-9b32-070634e11ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:40.979152 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1418/2795] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:40.989704 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f8abd-5fbc-48f9-ba01-d765e72f0642 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:40.989996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f8abd-5fbc-48f9-ba01-d765e72f0642 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:40.990435 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f8abd-5fbc-48f9-ba01-d765e72f0642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:41.018094 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-951f8abd-5fbc-48f9-ba01-d765e72f0642 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:41.020098 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-951f8abd-5fbc-48f9-ba01-d765e72f0642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:41.030443 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1378/2796] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:19:41.035208 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e093f-5133-4f61-9b32-070634e11ccb None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:41.041132 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:41.047111 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e093f-5133-4f61-9b32-070634e11ccb None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:41.053291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86547f-1d0a-4e93-bb05-383ba3913122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:41.054166 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86547f-1d0a-4e93-bb05-383ba3913122 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:41.054890 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86547f-1d0a-4e93-bb05-383ba3913122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:41.055120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86547f-1d0a-4e93-bb05-383ba3913122 admin admin] PATH_INFO: `/v3/domains` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:41.056445 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86547f-1d0a-4e93-bb05-383ba3913122 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:19:41.056897 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86547f-1d0a-4e93-bb05-383ba3913122 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:41.058765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86547f-1d0a-4e93-bb05-383ba3913122 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:41.075248 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1419/2797] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:19:41.079993 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f8abd-5fbc-48f9-ba01-d765e72f0642 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:41.093205 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f8abd-5fbc-48f9-ba01-d765e72f0642 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:41.100483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73948da9-3b42-4929-9c32-411124130999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:41.105226 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73948da9-3b42-4929-9c32-411124130999 admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:41.105226 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73948da9-3b42-4929-9c32-411124130999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:41.105226 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73948da9-3b42-4929-9c32-411124130999 admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:41.105226 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73948da9-3b42-4929-9c32-411124130999 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:41.105226 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73948da9-3b42-4929-9c32-411124130999 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:41.231966 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1379/2798] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:19:41 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:19:41.236667 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86547f-1d0a-4e93-bb05-383ba3913122 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:41.249541 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86547f-1d0a-4e93-bb05-383ba3913122 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:41.341646 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b37dd1-cd38-4bb6-a6be-d508a77d996b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:41.341928 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b37dd1-cd38-4bb6-a6be-d508a77d996b admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:41.342223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b37dd1-cd38-4bb6-a6be-d508a77d996b admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:41.342501 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b37dd1-cd38-4bb6-a6be-d508a77d996b admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:41.343221 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b37dd1-cd38-4bb6-a6be-d508a77d996b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:41.345192 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b37dd1-cd38-4bb6-a6be-d508a77d996b admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:41.441609 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1420/2799] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:19:41 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:19:41.447004 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73948da9-3b42-4929-9c32-411124130999 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:41.458266 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73948da9-3b42-4929-9c32-411124130999 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:41.464188 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a1d6d-a122-4c31-9949-c7a0068b08cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:41.465033 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a1d6d-a122-4c31-9949-c7a0068b08cd admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:41.465159 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a1d6d-a122-4c31-9949-c7a0068b08cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:41.465393 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a1d6d-a122-4c31-9949-c7a0068b08cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:41.466073 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a1d6d-a122-4c31-9949-c7a0068b08cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:41.467783 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a1d6d-a122-4c31-9949-c7a0068b08cd admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:41.480420 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1380/2800] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:19:41.484939 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b37dd1-cd38-4bb6-a6be-d508a77d996b admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:41.497625 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b37dd1-cd38-4bb6-a6be-d508a77d996b admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:41.502607 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853e1fd-7554-4143-a8d2-3b40078dcf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:41.503291 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853e1fd-7554-4143-a8d2-3b40078dcf5e admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:41.503572 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853e1fd-7554-4143-a8d2-3b40078dcf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:41.503851 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853e1fd-7554-4143-a8d2-3b40078dcf5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:41.505189 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853e1fd-7554-4143-a8d2-3b40078dcf5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:41.507050 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853e1fd-7554-4143-a8d2-3b40078dcf5e admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:41.519645 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1421/2801] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:19:41.527219 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a1d6d-a122-4c31-9949-c7a0068b08cd admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:41.539313 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a1d6d-a122-4c31-9949-c7a0068b08cd admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:41.544770 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d865eeb-ffe0-4c78-8d23-349b13e95b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:41.545530 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d865eeb-ffe0-4c78-8d23-349b13e95b1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:41.545819 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d865eeb-ffe0-4c78-8d23-349b13e95b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:41.546093 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d865eeb-ffe0-4c78-8d23-349b13e95b1e admin admin] PATH_INFO: `/v3/projects/533a6226184d43a5b13c9da2c4a5d971/users/a6a74b4d273744a1bad7637f6c7c6e23/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:41.564473 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d865eeb-ffe0-4c78-8d23-349b13e95b1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=533a6226184d43a5b13c9da2c4a5d971, user_id=a6a74b4d273744a1bad7637f6c7c6e23, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:41.569845 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d865eeb-ffe0-4c78-8d23-349b13e95b1e admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:41.773320 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1381/2802] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:19:41 2022] PUT /identity/v3/projects/533a6226184d43a5b13c9da2c4a5d971/users/a6a74b4d273744a1bad7637f6c7c6e23/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:41.778473 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25da1f-b602-42de-aca8-f90e50149bee None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:41.778757 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25da1f-b602-42de-aca8-f90e50149bee None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:41.779037 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25da1f-b602-42de-aca8-f90e50149bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:41.799679 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-dc25da1f-b602-42de-aca8-f90e50149bee None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:41.800691 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-dc25da1f-b602-42de-aca8-f90e50149bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:41.876521 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1422/2803] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:41.889372 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d865eeb-ffe0-4c78-8d23-349b13e95b1e admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:41.891385 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-9d865eeb-ffe0-4c78-8d23-349b13e95b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:41.912419 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17501db-2ba6-4fd6-baaa-3268c6c2b324 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:41.912419 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17501db-2ba6-4fd6-baaa-3268c6c2b324 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:41.912419 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17501db-2ba6-4fd6-baaa-3268c6c2b324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:41.930950 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-a17501db-2ba6-4fd6-baaa-3268c6c2b324 None None] MFA Rules not processed for user `eb640d92cb9b49019f42351a60efe258`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:41.932195 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-a17501db-2ba6-4fd6-baaa-3268c6c2b324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:41.960491 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d865eeb-ffe0-4c78-8d23-349b13e95b1e admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:41.964282 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0ae9d-9619-40ab-a40d-e0a2da881815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:41.965021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0ae9d-9619-40ab-a40d-e0a2da881815 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:41.965372 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0ae9d-9619-40ab-a40d-e0a2da881815 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:41.965657 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0ae9d-9619-40ab-a40d-e0a2da881815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:41.976640 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0ae9d-9619-40ab-a40d-e0a2da881815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:41.978855 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0ae9d-9619-40ab-a40d-e0a2da881815 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:41.990458 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1382/2804] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:19:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:19:41.994881 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1423/2805] 10.222.0.20 () {58 vars in 967 bytes} [Tue Aug 2 09:19:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:19:42.008692 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0ae9d-9619-40ab-a40d-e0a2da881815 service neutron] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:42.010422 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-84d0ae9d-9619-40ab-a40d-e0a2da881815 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:42.090272 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0ae9d-9619-40ab-a40d-e0a2da881815 service neutron] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:42.095561 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f4c00-2ee5-4436-b431-f2e7e4b62de9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f8e572550b4ab5955d7a94f1563441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:42.096222 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f4c00-2ee5-4436-b431-f2e7e4b62de9 service swift] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:42.096504 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f4c00-2ee5-4436-b431-f2e7e4b62de9 service swift] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:42.096781 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f4c00-2ee5-4436-b431-f2e7e4b62de9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:42.107953 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f4c00-2ee5-4436-b431-f2e7e4b62de9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:42.108930 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f4c00-2ee5-4436-b431-f2e7e4b62de9 service swift] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:42.118796 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1383/2806] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Aug 2 09:19:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:19:43.687763 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09325e4a-c44f-4804-baba-5f9f162e8291 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:43.688712 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09325e4a-c44f-4804-baba-5f9f162e8291 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:43.688997 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09325e4a-c44f-4804-baba-5f9f162e8291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:43.721659 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:43.725389 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-09325e4a-c44f-4804-baba-5f9f162e8291 None None] MFA Rules not processed for user `a6a74b4d273744a1bad7637f6c7c6e23`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:43.726753 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-09325e4a-c44f-4804-baba-5f9f162e8291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:43.839403 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1424/2807] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:43.862528 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f4c00-2ee5-4436-b431-f2e7e4b62de9 service swift] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:43.862528 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-848f4c00-2ee5-4436-b431-f2e7e4b62de9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:43.890928 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:43.922705 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f4c00-2ee5-4436-b431-f2e7e4b62de9 service swift] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:43.928418 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95b392-1174-4d17-a701-e529577215df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:43.929105 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95b392-1174-4d17-a701-e529577215df service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:43.929392 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95b392-1174-4d17-a701-e529577215df service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:43.929676 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95b392-1174-4d17-a701-e529577215df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:43.938593 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95b392-1174-4d17-a701-e529577215df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:43.940033 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95b392-1174-4d17-a701-e529577215df service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:43.950201 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1384/2808] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:19:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:19:46.789345 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f6289-6b95-4b95-b7b4-358c782f4359 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:46.790025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f6289-6b95-4b95-b7b4-358c782f4359 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:46.790025 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f6289-6b95-4b95-b7b4-358c782f4359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:46.812622 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-8f8f6289-6b95-4b95-b7b4-358c782f4359 None None] MFA Rules not processed for user `a6a74b4d273744a1bad7637f6c7c6e23`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:46.818454 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-8f8f6289-6b95-4b95-b7b4-358c782f4359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:46.822453 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1425/2809] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:19:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:47.955263 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95b392-1174-4d17-a701-e529577215df service cinder] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:47.958586 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-4b95b392-1174-4d17-a701-e529577215df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:47.974182 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95b392-1174-4d17-a701-e529577215df service cinder] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:47.979544 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc475da8-78c3-4327-9238-6c5462a257e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:47.980262 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc475da8-78c3-4327-9238-6c5462a257e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:47.980547 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc475da8-78c3-4327-9238-6c5462a257e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:47.980823 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc475da8-78c3-4327-9238-6c5462a257e8 admin admin] PATH_INFO: `/v3/users/6cd2f7ae47fd42929ccfaed668c5a55f` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:47.982253 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc475da8-78c3-4327-9238-6c5462a257e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cd2f7ae47fd42929ccfaed668c5a55f)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:47.984225 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc475da8-78c3-4327-9238-6c5462a257e8 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:48.194982 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-cc475da8-78c3-4327-9238-6c5462a257e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cd2f7ae47fd42929ccfaed668c5a55f'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:48.202850 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-cc475da8-78c3-4327-9238-6c5462a257e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cd2f7ae47fd42929ccfaed668c5a55f'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:48.203624 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-cc475da8-78c3-4327-9238-6c5462a257e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cd2f7ae47fd42929ccfaed668c5a55f'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:48.291879 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-cc475da8-78c3-4327-9238-6c5462a257e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cd2f7ae47fd42929ccfaed668c5a55f'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:48.307610 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-cc475da8-78c3-4327-9238-6c5462a257e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cd2f7ae47fd42929ccfaed668c5a55f'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:48.313999 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1385/2810] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:19:47 2022] DELETE /identity/v3/users/6cd2f7ae47fd42929ccfaed668c5a55f => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:49.047435 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f6289-6b95-4b95-b7b4-358c782f4359 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:49.069742 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f6289-6b95-4b95-b7b4-358c782f4359 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:49.173963 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f769d7-3ba8-48bb-a72c-94348eeaf3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:49.175520 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f769d7-3ba8-48bb-a72c-94348eeaf3ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:49.175806 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f769d7-3ba8-48bb-a72c-94348eeaf3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:49.176703 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f769d7-3ba8-48bb-a72c-94348eeaf3ba admin admin] PATH_INFO: `/v3/projects/f15f389a69d249adaa55b25d60e54ab0` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:49.178056 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f769d7-3ba8-48bb-a72c-94348eeaf3ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=f15f389a69d249adaa55b25d60e54ab0)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:49.180049 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f769d7-3ba8-48bb-a72c-94348eeaf3ba admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:49.294589 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-86f769d7-3ba8-48bb-a72c-94348eeaf3ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f15f389a69d249adaa55b25d60e54ab0', 'request_id': 'req-86f769d7-3ba8-48bb-a72c-94348eeaf3ba'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:49.375633 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-86f769d7-3ba8-48bb-a72c-94348eeaf3ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f15f389a69d249adaa55b25d60e54ab0', 'request_id': 'req-86f769d7-3ba8-48bb-a72c-94348eeaf3ba'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:49.386054 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-86f769d7-3ba8-48bb-a72c-94348eeaf3ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f15f389a69d249adaa55b25d60e54ab0', 'request_id': 'req-86f769d7-3ba8-48bb-a72c-94348eeaf3ba'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:49.404932 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-86f769d7-3ba8-48bb-a72c-94348eeaf3ba admin admin] The token cache is being invalidate because project f15f389a69d249adaa55b25d60e54ab0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:19:49.405300 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-86f769d7-3ba8-48bb-a72c-94348eeaf3ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:49.405997 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-86f769d7-3ba8-48bb-a72c-94348eeaf3ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:19:49.408914 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1426/2811] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:19:49 2022] DELETE /identity/v3/projects/f15f389a69d249adaa55b25d60e54ab0 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:57.189708 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160db52-bc34-400e-8e89-30536e22a820 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:57.190320 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160db52-bc34-400e-8e89-30536e22a820 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:57.190320 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160db52-bc34-400e-8e89-30536e22a820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:57.216335 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-3160db52-bc34-400e-8e89-30536e22a820 None None] MFA Rules not processed for user `eb640d92cb9b49019f42351a60efe258`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:57.217565 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-3160db52-bc34-400e-8e89-30536e22a820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:57.278891 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1386/2812] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Aug 2 09:19:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:57.292336 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f769d7-3ba8-48bb-a72c-94348eeaf3ba admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:57.293821 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-86f769d7-3ba8-48bb-a72c-94348eeaf3ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:57.330718 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:57.378945 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f769d7-3ba8-48bb-a72c-94348eeaf3ba admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:57.384447 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a9a7a-b97b-44ac-a1f0-a59aff79fe40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f8e572550b4ab5955d7a94f1563441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:57.385107 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a9a7a-b97b-44ac-a1f0-a59aff79fe40 service swift] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:57.385405 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a9a7a-b97b-44ac-a1f0-a59aff79fe40 service swift] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:57.385656 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a9a7a-b97b-44ac-a1f0-a59aff79fe40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:57.395975 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a9a7a-b97b-44ac-a1f0-a59aff79fe40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:57.397674 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a9a7a-b97b-44ac-a1f0-a59aff79fe40 service swift] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:57.406611 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1427/2813] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Aug 2 09:19:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:19:58.671865 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160db52-bc34-400e-8e89-30536e22a820 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:58.673378 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-3160db52-bc34-400e-8e89-30536e22a820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:58.691443 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06130883-80cb-4855-bf3a-ea49939349d3 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:58.692704 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06130883-80cb-4855-bf3a-ea49939349d3 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:58.692704 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06130883-80cb-4855-bf3a-ea49939349d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:58.713392 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-06130883-80cb-4855-bf3a-ea49939349d3 None None] MFA Rules not processed for user `eb640d92cb9b49019f42351a60efe258`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:58.714631 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-06130883-80cb-4855-bf3a-ea49939349d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:58.722211 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1428/2814] 10.222.0.20 () {58 vars in 967 bytes} [Tue Aug 2 09:19:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:19:58.736395 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:58.737145 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06130883-80cb-4855-bf3a-ea49939349d3 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:58.752095 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160db52-bc34-400e-8e89-30536e22a820 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:58.752378 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06130883-80cb-4855-bf3a-ea49939349d3 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:58.758043 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d502e-14f4-41a1-aa17-7191e655ac5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:58.758846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d502e-14f4-41a1-aa17-7191e655ac5c service cinder] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:58.759223 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d502e-14f4-41a1-aa17-7191e655ac5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:58.759620 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d502e-14f4-41a1-aa17-7191e655ac5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:58.760583 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d563f93-5fd6-43de-92b1-c29e78cd3d66 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f8e572550b4ab5955d7a94f1563441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:58.761479 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d563f93-5fd6-43de-92b1-c29e78cd3d66 service swift] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:58.761479 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d563f93-5fd6-43de-92b1-c29e78cd3d66 service swift] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:58.761749 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d563f93-5fd6-43de-92b1-c29e78cd3d66 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:58.762187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-493d502e-14f4-41a1-aa17-7191e655ac5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:58.773041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d563f93-5fd6-43de-92b1-c29e78cd3d66 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:58.774655 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d563f93-5fd6-43de-92b1-c29e78cd3d66 service swift] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:58.787107 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1429/2815] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Aug 2 09:19:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 02 09:19:58.855669 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d502e-14f4-41a1-aa17-7191e655ac5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:58.857268 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d502e-14f4-41a1-aa17-7191e655ac5c service cinder] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:58.868021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1387/2816] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:19:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:19:59.552680 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c51c8-a56f-4204-bd30-3bae0483bd2b None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:59.552967 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c51c8-a56f-4204-bd30-3bae0483bd2b None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:59.563264 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c51c8-a56f-4204-bd30-3bae0483bd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:59.576141 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-bf8c51c8-a56f-4204-bd30-3bae0483bd2b None None] MFA Rules not processed for user `eb640d92cb9b49019f42351a60efe258`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:19:59.577570 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-bf8c51c8-a56f-4204-bd30-3bae0483bd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:19:59.587046 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1430/2817] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Aug 2 09:19:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:19:59.602601 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d502e-14f4-41a1-aa17-7191e655ac5c service cinder] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:19:59.619612 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d502e-14f4-41a1-aa17-7191e655ac5c service cinder] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:19:59.626095 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c02b1d-1c14-4bf7-a3ef-bbcede374f3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f8e572550b4ab5955d7a94f1563441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:19:59.626733 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c02b1d-1c14-4bf7-a3ef-bbcede374f3c service swift] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:19:59.627016 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c02b1d-1c14-4bf7-a3ef-bbcede374f3c service swift] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:19:59.627299 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c02b1d-1c14-4bf7-a3ef-bbcede374f3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:19:59.637085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c02b1d-1c14-4bf7-a3ef-bbcede374f3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:19:59.638972 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c02b1d-1c14-4bf7-a3ef-bbcede374f3c service swift] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:19:59.650353 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1388/2818] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Aug 2 09:19:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 02 09:20:00.388955 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf7806-3edf-4d25-a357-0ec258609c7d None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:00.389459 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf7806-3edf-4d25-a357-0ec258609c7d None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:00.389594 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf7806-3edf-4d25-a357-0ec258609c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:00.411460 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-07cf7806-3edf-4d25-a357-0ec258609c7d None None] MFA Rules not processed for user `eb640d92cb9b49019f42351a60efe258`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:20:00.412816 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-07cf7806-3edf-4d25-a357-0ec258609c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:20:00.421134 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1431/2819] 10.222.0.20 () {58 vars in 967 bytes} [Tue Aug 2 09:20:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:20:00.435535 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c02b1d-1c14-4bf7-a3ef-bbcede374f3c service swift] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:20:00.448525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c02b1d-1c14-4bf7-a3ef-bbcede374f3c service swift] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:20:00.454628 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f61433-3e7e-43ce-8a9a-7c5a4935f95c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f8e572550b4ab5955d7a94f1563441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:20:00.455260 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f61433-3e7e-43ce-8a9a-7c5a4935f95c service swift] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:00.455542 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f61433-3e7e-43ce-8a9a-7c5a4935f95c service swift] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:00.455818 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f61433-3e7e-43ce-8a9a-7c5a4935f95c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:00.465937 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f61433-3e7e-43ce-8a9a-7c5a4935f95c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:20:00.467525 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f61433-3e7e-43ce-8a9a-7c5a4935f95c service swift] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:20:00.476137 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1389/2820] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Aug 2 09:20:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 02 09:20:03.438486 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf7806-3edf-4d25-a357-0ec258609c7d None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:20:03.439971 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-07cf7806-3edf-4d25-a357-0ec258609c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:20:03.521232 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf7806-3edf-4d25-a357-0ec258609c7d None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:20:03.526892 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815f7ce-4546-44ea-9b07-79267e8667fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:20:03.527561 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815f7ce-4546-44ea-9b07-79267e8667fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:03.527845 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815f7ce-4546-44ea-9b07-79267e8667fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:03.528124 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815f7ce-4546-44ea-9b07-79267e8667fd admin admin] PATH_INFO: `/v3/users/8636edba3b8a4d8ca7843b7d882300c0` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:03.529372 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815f7ce-4546-44ea-9b07-79267e8667fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8636edba3b8a4d8ca7843b7d882300c0)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:20:03.531357 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815f7ce-4546-44ea-9b07-79267e8667fd admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:20:03.783489 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-8815f7ce-4546-44ea-9b07-79267e8667fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8636edba3b8a4d8ca7843b7d882300c0'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:20:03.889345 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-8815f7ce-4546-44ea-9b07-79267e8667fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8636edba3b8a4d8ca7843b7d882300c0'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:20:03.898499 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-8815f7ce-4546-44ea-9b07-79267e8667fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8636edba3b8a4d8ca7843b7d882300c0'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:20:03.899267 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-8815f7ce-4546-44ea-9b07-79267e8667fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8636edba3b8a4d8ca7843b7d882300c0'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:20:03.899890 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-8815f7ce-4546-44ea-9b07-79267e8667fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8636edba3b8a4d8ca7843b7d882300c0'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:20:03.918949 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1432/2821] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:20:03 2022] DELETE /identity/v3/users/8636edba3b8a4d8ca7843b7d882300c0 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:20:03.931022 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41393d23-0439-436c-a835-2d604dcc34d3 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:03.931022 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41393d23-0439-436c-a835-2d604dcc34d3 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:03.931022 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41393d23-0439-436c-a835-2d604dcc34d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:03.952035 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-41393d23-0439-436c-a835-2d604dcc34d3 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:20:03.953280 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-41393d23-0439-436c-a835-2d604dcc34d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:20:04.027189 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1390/2822] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:20:04.037141 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815f7ce-4546-44ea-9b07-79267e8667fd admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:20:04.039136 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-8815f7ce-4546-44ea-9b07-79267e8667fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:20:04.044701 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:04.105638 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815f7ce-4546-44ea-9b07-79267e8667fd admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:20:04.110269 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66405fe2-026f-4350-8a20-9b413b0620c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:20:04.111041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66405fe2-026f-4350-8a20-9b413b0620c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:04.111391 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66405fe2-026f-4350-8a20-9b413b0620c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:04.111738 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66405fe2-026f-4350-8a20-9b413b0620c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:04.122651 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66405fe2-026f-4350-8a20-9b413b0620c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:20:04.124085 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66405fe2-026f-4350-8a20-9b413b0620c6 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:20:04.135290 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1433/2823] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:20:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:20:04.558417 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41393d23-0439-436c-a835-2d604dcc34d3 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:20:04.560626 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-41393d23-0439-436c-a835-2d604dcc34d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:20:04.577953 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41393d23-0439-436c-a835-2d604dcc34d3 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:20:04.583418 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145e4f4-d6c0-40a2-8e6f-03c72c7361cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:20:04.584097 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145e4f4-d6c0-40a2-8e6f-03c72c7361cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:04.584465 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145e4f4-d6c0-40a2-8e6f-03c72c7361cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:04.584878 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145e4f4-d6c0-40a2-8e6f-03c72c7361cc admin admin] PATH_INFO: `/v3/projects/d161d2feb00e4986902d6fa841f0ca59` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:04.586355 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145e4f4-d6c0-40a2-8e6f-03c72c7361cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d161d2feb00e4986902d6fa841f0ca59)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:20:04.588315 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145e4f4-d6c0-40a2-8e6f-03c72c7361cc admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:20:04.767400 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-0145e4f4-d6c0-40a2-8e6f-03c72c7361cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd161d2feb00e4986902d6fa841f0ca59', 'request_id': 'req-0145e4f4-d6c0-40a2-8e6f-03c72c7361cc'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:20:04.782296 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-0145e4f4-d6c0-40a2-8e6f-03c72c7361cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd161d2feb00e4986902d6fa841f0ca59', 'request_id': 'req-0145e4f4-d6c0-40a2-8e6f-03c72c7361cc'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:20:04.789786 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-0145e4f4-d6c0-40a2-8e6f-03c72c7361cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd161d2feb00e4986902d6fa841f0ca59', 'request_id': 'req-0145e4f4-d6c0-40a2-8e6f-03c72c7361cc'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:20:04.794549 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:04.919450 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-0145e4f4-d6c0-40a2-8e6f-03c72c7361cc admin admin] The token cache is being invalidate because project d161d2feb00e4986902d6fa841f0ca59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:20:04.920094 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-0145e4f4-d6c0-40a2-8e6f-03c72c7361cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:20:04.920814 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-0145e4f4-d6c0-40a2-8e6f-03c72c7361cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:20:04.922817 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1391/2824] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:20:04 2022] DELETE /identity/v3/projects/d161d2feb00e4986902d6fa841f0ca59 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:20:08.616851 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b268cf-c333-410c-8fcd-9fef5367bfcb None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:08.617470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b268cf-c333-410c-8fcd-9fef5367bfcb None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:08.617470 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b268cf-c333-410c-8fcd-9fef5367bfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:08.637584 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-95b268cf-c333-410c-8fcd-9fef5367bfcb None None] MFA Rules not processed for user `c0a2b49114e0458f9625de698cc89861`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:20:08.638765 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-95b268cf-c333-410c-8fcd-9fef5367bfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:20:08.703781 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1434/2825] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:20:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:20:08.882496 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145e4f4-d6c0-40a2-8e6f-03c72c7361cc admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:20:08.884013 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-0145e4f4-d6c0-40a2-8e6f-03c72c7361cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:20:08.974265 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145e4f4-d6c0-40a2-8e6f-03c72c7361cc admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:20:08.980893 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad3d758-9e56-4ef9-adca-76dca184a7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:20:08.981805 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3d758-9e56-4ef9-adca-76dca184a7e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:08.982284 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3d758-9e56-4ef9-adca-76dca184a7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:08.982669 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3d758-9e56-4ef9-adca-76dca184a7e5 admin admin] PATH_INFO: `/v3/users/de9ff40d2b314445b49ace18d97df7fb` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:08.984086 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad3d758-9e56-4ef9-adca-76dca184a7e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de9ff40d2b314445b49ace18d97df7fb)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:20:08.987048 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad3d758-9e56-4ef9-adca-76dca184a7e5 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:20:09.311516 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-9ad3d758-9e56-4ef9-adca-76dca184a7e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de9ff40d2b314445b49ace18d97df7fb'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:20:09.322856 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-9ad3d758-9e56-4ef9-adca-76dca184a7e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de9ff40d2b314445b49ace18d97df7fb'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:20:09.325368 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-9ad3d758-9e56-4ef9-adca-76dca184a7e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de9ff40d2b314445b49ace18d97df7fb'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:20:09.406360 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-9ad3d758-9e56-4ef9-adca-76dca184a7e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de9ff40d2b314445b49ace18d97df7fb'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:20:09.427773 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-9ad3d758-9e56-4ef9-adca-76dca184a7e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de9ff40d2b314445b49ace18d97df7fb'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:20:09.439060 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1392/2826] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:20:08 2022] DELETE /identity/v3/users/de9ff40d2b314445b49ace18d97df7fb => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:20:09.444740 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fe4b7-d029-43df-aa14-3f93dd2bc61a None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:09.445041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fe4b7-d029-43df-aa14-3f93dd2bc61a None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:09.445320 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fe4b7-d029-43df-aa14-3f93dd2bc61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:09.465428 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-265fe4b7-d029-43df-aa14-3f93dd2bc61a None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:20:09.466711 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-265fe4b7-d029-43df-aa14-3f93dd2bc61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:20:09.539090 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1435/2827] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:20:09.549590 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad3d758-9e56-4ef9-adca-76dca184a7e5 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:20:09.551069 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-9ad3d758-9e56-4ef9-adca-76dca184a7e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:20:09.619723 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad3d758-9e56-4ef9-adca-76dca184a7e5 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:20:09.623378 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ec660-5674-47dc-a255-c2b6dca350a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:20:09.624013 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ec660-5674-47dc-a255-c2b6dca350a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:09.624334 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ec660-5674-47dc-a255-c2b6dca350a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:09.624618 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ec660-5674-47dc-a255-c2b6dca350a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:09.634791 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ec660-5674-47dc-a255-c2b6dca350a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:20:09.636268 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ec660-5674-47dc-a255-c2b6dca350a9 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:20:09.646118 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1393/2828] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:20:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:20:10.222183 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265fe4b7-d029-43df-aa14-3f93dd2bc61a None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:20:10.223615 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-265fe4b7-d029-43df-aa14-3f93dd2bc61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:20:10.236606 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265fe4b7-d029-43df-aa14-3f93dd2bc61a None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:20:10.241548 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299006c-a21c-4b58-870f-be4b037fd1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:20:10.242403 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299006c-a21c-4b58-870f-be4b037fd1d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:10.242858 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299006c-a21c-4b58-870f-be4b037fd1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:10.243143 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299006c-a21c-4b58-870f-be4b037fd1d6 admin admin] PATH_INFO: `/v3/projects/a1c20f08a6164105b8a3222df1eb858b` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:10.244373 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299006c-a21c-4b58-870f-be4b037fd1d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1c20f08a6164105b8a3222df1eb858b)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:20:10.246927 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299006c-a21c-4b58-870f-be4b037fd1d6 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:20:10.386283 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:10.389760 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-a299006c-a21c-4b58-870f-be4b037fd1d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1c20f08a6164105b8a3222df1eb858b', 'request_id': 'req-a299006c-a21c-4b58-870f-be4b037fd1d6'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:20:10.489284 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-a299006c-a21c-4b58-870f-be4b037fd1d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1c20f08a6164105b8a3222df1eb858b', 'request_id': 'req-a299006c-a21c-4b58-870f-be4b037fd1d6'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:20:10.495871 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-a299006c-a21c-4b58-870f-be4b037fd1d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1c20f08a6164105b8a3222df1eb858b', 'request_id': 'req-a299006c-a21c-4b58-870f-be4b037fd1d6'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:20:10.508586 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-a299006c-a21c-4b58-870f-be4b037fd1d6 admin admin] The token cache is being invalidate because project a1c20f08a6164105b8a3222df1eb858b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:20:10.508890 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-a299006c-a21c-4b58-870f-be4b037fd1d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:20:10.509547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-a299006c-a21c-4b58-870f-be4b037fd1d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:20:10.511514 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1436/2829] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:20:10 2022] DELETE /identity/v3/projects/a1c20f08a6164105b8a3222df1eb858b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:20:10.516863 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0c417-946e-42cc-9e3a-4c8e486d808b None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:10.517452 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0c417-946e-42cc-9e3a-4c8e486d808b None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:10.517560 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0c417-946e-42cc-9e3a-4c8e486d808b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:10.539742 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-fbe0c417-946e-42cc-9e3a-4c8e486d808b None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:20:10.541077 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-fbe0c417-946e-42cc-9e3a-4c8e486d808b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:20:10.555873 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:10.612582 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1394/2830] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:20:10.621533 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddc89f-2f8a-4b9a-a9d4-64902718d431 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:10.621823 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddc89f-2f8a-4b9a-a9d4-64902718d431 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:10.622262 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddc89f-2f8a-4b9a-a9d4-64902718d431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:10.645030 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-e9ddc89f-2f8a-4b9a-a9d4-64902718d431 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:20:10.646247 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-e9ddc89f-2f8a-4b9a-a9d4-64902718d431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:20:10.654567 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1437/2831] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:20:10.659230 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0c417-946e-42cc-9e3a-4c8e486d808b None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:20:10.670554 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0c417-946e-42cc-9e3a-4c8e486d808b None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:20:10.675326 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdaebfc-cbf6-4623-a666-26ba379cef15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:20:10.675982 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdaebfc-cbf6-4623-a666-26ba379cef15 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:10.676304 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdaebfc-cbf6-4623-a666-26ba379cef15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:10.676583 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdaebfc-cbf6-4623-a666-26ba379cef15 admin admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:10.677324 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdaebfc-cbf6-4623-a666-26ba379cef15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:20:10.677657 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdaebfc-cbf6-4623-a666-26ba379cef15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:20:10.679964 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdaebfc-cbf6-4623-a666-26ba379cef15 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:20:10.698429 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1395/2832] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:20:10.702884 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddc89f-2f8a-4b9a-a9d4-64902718d431 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:20:10.712994 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddc89f-2f8a-4b9a-a9d4-64902718d431 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:20:10.717794 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a55188-3298-4a12-b08a-db8abafa94be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:20:10.718409 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a55188-3298-4a12-b08a-db8abafa94be admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:10.718685 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a55188-3298-4a12-b08a-db8abafa94be admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:10.718956 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a55188-3298-4a12-b08a-db8abafa94be admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:10.719632 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a55188-3298-4a12-b08a-db8abafa94be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:20:10.721826 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a55188-3298-4a12-b08a-db8abafa94be admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:20:10.907067 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1438/2833] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:20:10 2022] POST /identity/v3/projects => generated 371 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:20:10.914477 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdaebfc-cbf6-4623-a666-26ba379cef15 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:20:10.925057 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdaebfc-cbf6-4623-a666-26ba379cef15 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:20:10.992363 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb62e6-b856-463a-9ce5-e390439652fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:20:10.992995 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb62e6-b856-463a-9ce5-e390439652fc admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:10.993275 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb62e6-b856-463a-9ce5-e390439652fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:10.993549 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb62e6-b856-463a-9ce5-e390439652fc admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:10.994217 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb62e6-b856-463a-9ce5-e390439652fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:20:10.996276 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb62e6-b856-463a-9ce5-e390439652fc admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:20:11.161729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1396/2834] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:20:10 2022] POST /identity/v3/users => generated 286 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:20:11.166199 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a55188-3298-4a12-b08a-db8abafa94be admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:20:11.177501 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a55188-3298-4a12-b08a-db8abafa94be admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:20:11.182538 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e986eb-7437-45ed-a04a-5cb31cf5bb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:20:11.183264 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e986eb-7437-45ed-a04a-5cb31cf5bb80 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:11.183549 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e986eb-7437-45ed-a04a-5cb31cf5bb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:11.183829 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e986eb-7437-45ed-a04a-5cb31cf5bb80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:11.184696 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e986eb-7437-45ed-a04a-5cb31cf5bb80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:20:11.186819 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e986eb-7437-45ed-a04a-5cb31cf5bb80 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:20:11.199359 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1439/2835] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:20:11.211285 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb62e6-b856-463a-9ce5-e390439652fc admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:20:11.222024 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb62e6-b856-463a-9ce5-e390439652fc admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:20:11.227164 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610f085-ac9d-4d0b-940e-3e19473e1519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:20:11.227794 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610f085-ac9d-4d0b-940e-3e19473e1519 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:11.228076 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610f085-ac9d-4d0b-940e-3e19473e1519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:11.228430 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610f085-ac9d-4d0b-940e-3e19473e1519 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:11.229073 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610f085-ac9d-4d0b-940e-3e19473e1519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:20:11.230697 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610f085-ac9d-4d0b-940e-3e19473e1519 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:20:11.242692 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1397/2836] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:20:11.247467 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e986eb-7437-45ed-a04a-5cb31cf5bb80 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:20:11.265492 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e986eb-7437-45ed-a04a-5cb31cf5bb80 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:20:11.270751 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb452c-204d-4e67-ad63-b3ac6c59692a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:20:11.271556 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb452c-204d-4e67-ad63-b3ac6c59692a admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:11.272624 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb452c-204d-4e67-ad63-b3ac6c59692a admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:11.272918 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb452c-204d-4e67-ad63-b3ac6c59692a admin admin] PATH_INFO: `/v3/projects/e372b26dd6ca434d90dd9cc83bdb9988/users/0ff8318e1c00492ba36e1ad22780cffb/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:11.295053 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb452c-204d-4e67-ad63-b3ac6c59692a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e372b26dd6ca434d90dd9cc83bdb9988, user_id=0ff8318e1c00492ba36e1ad22780cffb, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:20:11.297847 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb452c-204d-4e67-ad63-b3ac6c59692a admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:20:11.479464 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1440/2837] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:20:11 2022] PUT /identity/v3/projects/e372b26dd6ca434d90dd9cc83bdb9988/users/0ff8318e1c00492ba36e1ad22780cffb/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:20:11.490088 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a2215-cb6a-425c-b722-0239586f80b3 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:11.490357 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a2215-cb6a-425c-b722-0239586f80b3 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:11.490635 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a2215-cb6a-425c-b722-0239586f80b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:11.520482 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-454a2215-cb6a-425c-b722-0239586f80b3 None None] MFA Rules not processed for user `0ff8318e1c00492ba36e1ad22780cffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:20:11.522311 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-454a2215-cb6a-425c-b722-0239586f80b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:20:11.592497 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1398/2838] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:20:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:20:11.608568 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb452c-204d-4e67-ad63-b3ac6c59692a admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:20:11.610420 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-bdcb452c-204d-4e67-ad63-b3ac6c59692a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:20:11.685549 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb452c-204d-4e67-ad63-b3ac6c59692a admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:20:11.689595 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd3fb9-dce8-47a2-b435-466c0da76ef6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:20:11.690228 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd3fb9-dce8-47a2-b435-466c0da76ef6 service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:11.690752 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd3fb9-dce8-47a2-b435-466c0da76ef6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:11.690940 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd3fb9-dce8-47a2-b435-466c0da76ef6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:11.700590 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd3fb9-dce8-47a2-b435-466c0da76ef6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:20:11.702035 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd3fb9-dce8-47a2-b435-466c0da76ef6 service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:20:11.714950 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1441/2839] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:20:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:20:11.758103 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a2215-cb6a-425c-b722-0239586f80b3 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:20:11.773844 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:11.830691 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a2215-cb6a-425c-b722-0239586f80b3 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:20:11.838888 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0991cb3-d50c-4eeb-8ed0-d9b26995f58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:20:11.839589 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0991cb3-d50c-4eeb-8ed0-d9b26995f58a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:11.842695 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0991cb3-d50c-4eeb-8ed0-d9b26995f58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:11.842695 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0991cb3-d50c-4eeb-8ed0-d9b26995f58a admin admin] PATH_INFO: `/v3/users/0ff8318e1c00492ba36e1ad22780cffb` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:11.842695 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0991cb3-d50c-4eeb-8ed0-d9b26995f58a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ff8318e1c00492ba36e1ad22780cffb)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:20:11.843293 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0991cb3-d50c-4eeb-8ed0-d9b26995f58a admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:20:12.094711 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-f0991cb3-d50c-4eeb-8ed0-d9b26995f58a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ff8318e1c00492ba36e1ad22780cffb'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:20:12.102834 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-f0991cb3-d50c-4eeb-8ed0-d9b26995f58a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ff8318e1c00492ba36e1ad22780cffb'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:20:12.104561 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-f0991cb3-d50c-4eeb-8ed0-d9b26995f58a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ff8318e1c00492ba36e1ad22780cffb'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:20:12.178911 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-f0991cb3-d50c-4eeb-8ed0-d9b26995f58a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ff8318e1c00492ba36e1ad22780cffb'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:20:12.200553 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-f0991cb3-d50c-4eeb-8ed0-d9b26995f58a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ff8318e1c00492ba36e1ad22780cffb'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:20:12.207325 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1399/2840] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:20:11 2022] DELETE /identity/v3/users/0ff8318e1c00492ba36e1ad22780cffb => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:20:12.213781 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441528e7-3818-4e35-8c2a-95ac78a634fe None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:12.214726 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441528e7-3818-4e35-8c2a-95ac78a634fe None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:12.215026 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441528e7-3818-4e35-8c2a-95ac78a634fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:12.244741 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-441528e7-3818-4e35-8c2a-95ac78a634fe None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:20:12.246319 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-441528e7-3818-4e35-8c2a-95ac78a634fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:20:12.326778 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1442/2841] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:20:12.337979 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0991cb3-d50c-4eeb-8ed0-d9b26995f58a admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:20:12.339702 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-f0991cb3-d50c-4eeb-8ed0-d9b26995f58a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:20:12.403913 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0991cb3-d50c-4eeb-8ed0-d9b26995f58a admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:20:12.407753 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d8b2f-a588-4b14-9e19-4052a7f0b9a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:20:12.408427 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d8b2f-a588-4b14-9e19-4052a7f0b9a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:12.408729 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d8b2f-a588-4b14-9e19-4052a7f0b9a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:12.409021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d8b2f-a588-4b14-9e19-4052a7f0b9a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:12.420958 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d8b2f-a588-4b14-9e19-4052a7f0b9a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:20:12.422449 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d8b2f-a588-4b14-9e19-4052a7f0b9a9 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:20:12.433681 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1400/2842] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:20:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:20:12.925326 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441528e7-3818-4e35-8c2a-95ac78a634fe None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:20:12.927258 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-441528e7-3818-4e35-8c2a-95ac78a634fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:20:12.944837 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441528e7-3818-4e35-8c2a-95ac78a634fe None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:20:12.949984 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61b8f6-f811-4557-b781-5fd8ef331ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:20:12.951266 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61b8f6-f811-4557-b781-5fd8ef331ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:12.951417 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61b8f6-f811-4557-b781-5fd8ef331ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:12.951959 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61b8f6-f811-4557-b781-5fd8ef331ef1 admin admin] PATH_INFO: `/v3/projects/e372b26dd6ca434d90dd9cc83bdb9988` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:12.956280 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61b8f6-f811-4557-b781-5fd8ef331ef1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e372b26dd6ca434d90dd9cc83bdb9988)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:20:12.958913 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61b8f6-f811-4557-b781-5fd8ef331ef1 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:20:12.971387 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:13.092866 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-1f61b8f6-f811-4557-b781-5fd8ef331ef1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e372b26dd6ca434d90dd9cc83bdb9988', 'request_id': 'req-1f61b8f6-f811-4557-b781-5fd8ef331ef1'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:20:13.226331 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-1f61b8f6-f811-4557-b781-5fd8ef331ef1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e372b26dd6ca434d90dd9cc83bdb9988', 'request_id': 'req-1f61b8f6-f811-4557-b781-5fd8ef331ef1'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:20:13.233682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-1f61b8f6-f811-4557-b781-5fd8ef331ef1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e372b26dd6ca434d90dd9cc83bdb9988', 'request_id': 'req-1f61b8f6-f811-4557-b781-5fd8ef331ef1'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:20:13.247093 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-1f61b8f6-f811-4557-b781-5fd8ef331ef1 admin admin] The token cache is being invalidate because project e372b26dd6ca434d90dd9cc83bdb9988 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:20:13.247392 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-1f61b8f6-f811-4557-b781-5fd8ef331ef1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:20:13.248536 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-1f61b8f6-f811-4557-b781-5fd8ef331ef1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:20:13.250754 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1443/2843] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:20:12 2022] DELETE /identity/v3/projects/e372b26dd6ca434d90dd9cc83bdb9988 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:20:19.696700 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d8b2f-a588-4b14-9e19-4052a7f0b9a9 service neutron] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:20:19.698212 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-ee6d8b2f-a588-4b14-9e19-4052a7f0b9a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:20:19.710936 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d8b2f-a588-4b14-9e19-4052a7f0b9a9 service neutron] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:20:19.749431 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:19.768066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efce670-5b1f-497b-bbc7-83fbd4e046c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:20:19.768742 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efce670-5b1f-497b-bbc7-83fbd4e046c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:19.769023 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efce670-5b1f-497b-bbc7-83fbd4e046c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:19.769300 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efce670-5b1f-497b-bbc7-83fbd4e046c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:19.771358 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-5efce670-5b1f-497b-bbc7-83fbd4e046c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:20:19.861991 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efce670-5b1f-497b-bbc7-83fbd4e046c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:20:19.863450 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efce670-5b1f-497b-bbc7-83fbd4e046c4 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:20:19.876789 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1401/2844] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:20:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:20:23.360417 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:23.443081 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61b8f6-f811-4557-b781-5fd8ef331ef1 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:20:23.443873 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-1f61b8f6-f811-4557-b781-5fd8ef331ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:20:23.458118 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61b8f6-f811-4557-b781-5fd8ef331ef1 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:20:23.463837 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ec2e5-49e1-443a-8bb6-a3a196a07d91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:20:23.464797 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ec2e5-49e1-443a-8bb6-a3a196a07d91 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:23.465180 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ec2e5-49e1-443a-8bb6-a3a196a07d91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:23.465575 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ec2e5-49e1-443a-8bb6-a3a196a07d91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:23.467853 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-ae2ec2e5-49e1-443a-8bb6-a3a196a07d91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:20:23.490371 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ec2e5-49e1-443a-8bb6-a3a196a07d91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:20:23.498386 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ec2e5-49e1-443a-8bb6-a3a196a07d91 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:20:23.515972 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1444/2845] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:20:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:20:30.059352 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=38 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:33.510048 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=6 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:07.716770 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472b2a3-a181-4706-8901-280a7b4b5334 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:21:07.717469 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472b2a3-a181-4706-8901-280a7b4b5334 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:21:07.717469 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472b2a3-a181-4706-8901-280a7b4b5334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:21:07.737161 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-b472b2a3-a181-4706-8901-280a7b4b5334 None None] MFA Rules not processed for user `a6a74b4d273744a1bad7637f6c7c6e23`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:21:07.738379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-b472b2a3-a181-4706-8901-280a7b4b5334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:21:07.804678 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1402/2846] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:21:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:21:12.303854 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ec2e5-49e1-443a-8bb6-a3a196a07d91 service neutron] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:21:12.305331 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-ae2ec2e5-49e1-443a-8bb6-a3a196a07d91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:21:12.321766 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ec2e5-49e1-443a-8bb6-a3a196a07d91 service neutron] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:21:12.328250 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb485ef-61fe-4da2-9e8f-bda564154a70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:21:12.328904 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb485ef-61fe-4da2-9e8f-bda564154a70 service nova] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:21:12.329189 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb485ef-61fe-4da2-9e8f-bda564154a70 service nova] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:21:12.331912 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb485ef-61fe-4da2-9e8f-bda564154a70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:21:12.331912 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-aeb485ef-61fe-4da2-9e8f-bda564154a70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:21:12.347812 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb485ef-61fe-4da2-9e8f-bda564154a70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:21:12.349879 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb485ef-61fe-4da2-9e8f-bda564154a70 service nova] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:21:12.362731 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1445/2847] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:21:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:21:12.446320 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472b2a3-a181-4706-8901-280a7b4b5334 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:21:12.457311 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472b2a3-a181-4706-8901-280a7b4b5334 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:21:12.460920 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76b488-3e6e-46a9-8709-3277b44dc37e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:21:12.461612 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76b488-3e6e-46a9-8709-3277b44dc37e service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:21:12.461929 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76b488-3e6e-46a9-8709-3277b44dc37e service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:21:12.462355 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76b488-3e6e-46a9-8709-3277b44dc37e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:21:12.464102 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-ee76b488-3e6e-46a9-8709-3277b44dc37e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:21:12.475621 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76b488-3e6e-46a9-8709-3277b44dc37e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:21:12.477190 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76b488-3e6e-46a9-8709-3277b44dc37e service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:21:12.485981 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1403/2848] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:21:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:21:22.358276 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=6 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:22.482020 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=31 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:12.213825 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb485ef-61fe-4da2-9e8f-bda564154a70 service nova] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:12.215867 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-aeb485ef-61fe-4da2-9e8f-bda564154a70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:12.231197 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb485ef-61fe-4da2-9e8f-bda564154a70 service nova] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:12.237933 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467be75-1e6f-4ba6-b8de-124611b92a5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:12.238601 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467be75-1e6f-4ba6-b8de-124611b92a5b service nova] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:12.238851 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467be75-1e6f-4ba6-b8de-124611b92a5b service nova] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:12.239131 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467be75-1e6f-4ba6-b8de-124611b92a5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:12.241341 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-b467be75-1e6f-4ba6-b8de-124611b92a5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:12.279241 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b467be75-1e6f-4ba6-b8de-124611b92a5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:12.281290 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b467be75-1e6f-4ba6-b8de-124611b92a5b service nova] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:12.302377 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1446/2849] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:22:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:22:17.148151 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76b488-3e6e-46a9-8709-3277b44dc37e service neutron] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:17.150381 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-ee76b488-3e6e-46a9-8709-3277b44dc37e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:17.221891 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76b488-3e6e-46a9-8709-3277b44dc37e service neutron] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:17.226515 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6e6d1-beb8-4a3c-bc57-0d9dad995ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:17.231404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6e6d1-beb8-4a3c-bc57-0d9dad995ab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:17.231404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6e6d1-beb8-4a3c-bc57-0d9dad995ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:17.231404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6e6d1-beb8-4a3c-bc57-0d9dad995ab2 admin admin] PATH_INFO: `/v3/users/a6a74b4d273744a1bad7637f6c7c6e23` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:17.231404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6e6d1-beb8-4a3c-bc57-0d9dad995ab2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6a74b4d273744a1bad7637f6c7c6e23)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:17.231404 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6e6d1-beb8-4a3c-bc57-0d9dad995ab2 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:17.441876 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-b7d6e6d1-beb8-4a3c-bc57-0d9dad995ab2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6a74b4d273744a1bad7637f6c7c6e23'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:17.450281 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-b7d6e6d1-beb8-4a3c-bc57-0d9dad995ab2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6a74b4d273744a1bad7637f6c7c6e23'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:17.451020 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-b7d6e6d1-beb8-4a3c-bc57-0d9dad995ab2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6a74b4d273744a1bad7637f6c7c6e23'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:17.546848 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-b7d6e6d1-beb8-4a3c-bc57-0d9dad995ab2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6a74b4d273744a1bad7637f6c7c6e23'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:17.561361 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-b7d6e6d1-beb8-4a3c-bc57-0d9dad995ab2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6a74b4d273744a1bad7637f6c7c6e23'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:17.568089 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1404/2850] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:22:17 2022] DELETE /identity/v3/users/a6a74b4d273744a1bad7637f6c7c6e23 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:22:17.828366 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467be75-1e6f-4ba6-b8de-124611b92a5b service nova] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:17.840747 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467be75-1e6f-4ba6-b8de-124611b92a5b service nova] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:17.903047 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dba708-b894-4757-b478-e6a0eab7df4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:17.903665 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dba708-b894-4757-b478-e6a0eab7df4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:17.903965 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dba708-b894-4757-b478-e6a0eab7df4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:17.904274 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dba708-b894-4757-b478-e6a0eab7df4f admin admin] PATH_INFO: `/v3/projects/533a6226184d43a5b13c9da2c4a5d971` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:17.905789 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dba708-b894-4757-b478-e6a0eab7df4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=533a6226184d43a5b13c9da2c4a5d971)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:17.907776 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dba708-b894-4757-b478-e6a0eab7df4f admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:18.042964 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-87dba708-b894-4757-b478-e6a0eab7df4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '533a6226184d43a5b13c9da2c4a5d971', 'request_id': 'req-87dba708-b894-4757-b478-e6a0eab7df4f'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:18.135914 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-87dba708-b894-4757-b478-e6a0eab7df4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '533a6226184d43a5b13c9da2c4a5d971', 'request_id': 'req-87dba708-b894-4757-b478-e6a0eab7df4f'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:18.142320 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-87dba708-b894-4757-b478-e6a0eab7df4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '533a6226184d43a5b13c9da2c4a5d971', 'request_id': 'req-87dba708-b894-4757-b478-e6a0eab7df4f'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:18.154915 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-87dba708-b894-4757-b478-e6a0eab7df4f admin admin] The token cache is being invalidate because project 533a6226184d43a5b13c9da2c4a5d971 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:22:18.155150 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-87dba708-b894-4757-b478-e6a0eab7df4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:18.155770 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-87dba708-b894-4757-b478-e6a0eab7df4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:18.157409 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1447/2851] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:22:17 2022] DELETE /identity/v3/projects/533a6226184d43a5b13c9da2c4a5d971 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:22:18.162665 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac8e9e-ccf4-4999-a28e-a8eea34758a9 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:18.163313 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac8e9e-ccf4-4999-a28e-a8eea34758a9 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:18.163424 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac8e9e-ccf4-4999-a28e-a8eea34758a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:18.191815 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-9eac8e9e-ccf4-4999-a28e-a8eea34758a9 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:18.193096 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-9eac8e9e-ccf4-4999-a28e-a8eea34758a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:18.259104 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1405/2852] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:22:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:18.272309 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110a462-db78-48dc-930a-0c70197c1d83 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:18.272787 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110a462-db78-48dc-930a-0c70197c1d83 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:18.273081 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110a462-db78-48dc-930a-0c70197c1d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:18.297174 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-e110a462-db78-48dc-930a-0c70197c1d83 None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:18.298281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-e110a462-db78-48dc-930a-0c70197c1d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:18.307213 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1448/2853] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:22:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:18.311645 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac8e9e-ccf4-4999-a28e-a8eea34758a9 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:18.323588 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac8e9e-ccf4-4999-a28e-a8eea34758a9 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:18.329205 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb1cce-1bea-4ce9-8f3e-32027c44078c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:18.329840 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb1cce-1bea-4ce9-8f3e-32027c44078c admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:18.330118 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb1cce-1bea-4ce9-8f3e-32027c44078c admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:18.330392 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb1cce-1bea-4ce9-8f3e-32027c44078c admin admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:18.331150 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb1cce-1bea-4ce9-8f3e-32027c44078c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:22:18.331454 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb1cce-1bea-4ce9-8f3e-32027c44078c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:18.333138 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb1cce-1bea-4ce9-8f3e-32027c44078c admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:18.348885 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1406/2854] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:22:18.356539 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110a462-db78-48dc-930a-0c70197c1d83 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:18.366432 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110a462-db78-48dc-930a-0c70197c1d83 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:18.372192 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde294b6-9e56-49bc-99b6-0887c43f3842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:18.372844 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde294b6-9e56-49bc-99b6-0887c43f3842 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:18.373120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde294b6-9e56-49bc-99b6-0887c43f3842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:18.373395 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde294b6-9e56-49bc-99b6-0887c43f3842 admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:18.374077 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde294b6-9e56-49bc-99b6-0887c43f3842 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:18.375990 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde294b6-9e56-49bc-99b6-0887c43f3842 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:18.463548 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1449/2855] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:22:18 2022] POST /identity/v3/projects => generated 399 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:22:18.468012 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb1cce-1bea-4ce9-8f3e-32027c44078c admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:18.479661 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb1cce-1bea-4ce9-8f3e-32027c44078c admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:18.483513 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:18.542819 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154da6b4-ae89-45a0-b83e-f8888001ebdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:18.543453 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154da6b4-ae89-45a0-b83e-f8888001ebdd admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:18.543736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154da6b4-ae89-45a0-b83e-f8888001ebdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:18.544012 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154da6b4-ae89-45a0-b83e-f8888001ebdd admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:18.544736 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154da6b4-ae89-45a0-b83e-f8888001ebdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:18.546668 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154da6b4-ae89-45a0-b83e-f8888001ebdd admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:18.627162 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1407/2856] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:22:18 2022] POST /identity/v3/users => generated 300 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:22:18.631406 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde294b6-9e56-49bc-99b6-0887c43f3842 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:18.643004 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde294b6-9e56-49bc-99b6-0887c43f3842 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:18.647835 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f3cf3-9721-4020-9f13-406700190ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:18.648493 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f3cf3-9721-4020-9f13-406700190ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:18.648775 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f3cf3-9721-4020-9f13-406700190ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:18.649051 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f3cf3-9721-4020-9f13-406700190ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:18.649770 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f3cf3-9721-4020-9f13-406700190ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:18.651374 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f3cf3-9721-4020-9f13-406700190ea0 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:18.661637 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1450/2857] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:22:18.665975 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154da6b4-ae89-45a0-b83e-f8888001ebdd admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:18.676250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154da6b4-ae89-45a0-b83e-f8888001ebdd admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:18.681558 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d43ecb-f5ed-4713-a271-8f22e0fd0575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:18.682116 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d43ecb-f5ed-4713-a271-8f22e0fd0575 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:18.682396 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d43ecb-f5ed-4713-a271-8f22e0fd0575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:18.682669 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d43ecb-f5ed-4713-a271-8f22e0fd0575 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:18.683398 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d43ecb-f5ed-4713-a271-8f22e0fd0575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:18.685120 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d43ecb-f5ed-4713-a271-8f22e0fd0575 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:18.697327 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1408/2858] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:22:18.701781 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f3cf3-9721-4020-9f13-406700190ea0 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:18.715204 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f3cf3-9721-4020-9f13-406700190ea0 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:18.717972 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308b565-27c5-4b85-bf36-fb62760a75ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:18.718648 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308b565-27c5-4b85-bf36-fb62760a75ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:18.718934 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308b565-27c5-4b85-bf36-fb62760a75ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:18.719250 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308b565-27c5-4b85-bf36-fb62760a75ac admin admin] PATH_INFO: `/v3/projects/16c5122a1b4e42d3b80871c6d1b06f65/users/367dc964046f4a2cbda3ad4bce497ddb/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:18.738962 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308b565-27c5-4b85-bf36-fb62760a75ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=16c5122a1b4e42d3b80871c6d1b06f65, user_id=367dc964046f4a2cbda3ad4bce497ddb, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:18.741726 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308b565-27c5-4b85-bf36-fb62760a75ac admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:18.811003 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1451/2859] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:22:18 2022] PUT /identity/v3/projects/16c5122a1b4e42d3b80871c6d1b06f65/users/367dc964046f4a2cbda3ad4bce497ddb/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:22:18.821654 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d319f2-6972-4f32-b326-492dfaef6947 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:18.821990 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d319f2-6972-4f32-b326-492dfaef6947 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:18.822212 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d319f2-6972-4f32-b326-492dfaef6947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:18.853999 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-80d319f2-6972-4f32-b326-492dfaef6947 None None] MFA Rules not processed for user `367dc964046f4a2cbda3ad4bce497ddb`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:18.855313 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-80d319f2-6972-4f32-b326-492dfaef6947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:18.925763 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1409/2860] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:22:18 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:18.939840 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308b565-27c5-4b85-bf36-fb62760a75ac admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:18.960908 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-5308b565-27c5-4b85-bf36-fb62760a75ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:18.960908 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:19.004170 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308b565-27c5-4b85-bf36-fb62760a75ac admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:19.008012 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9b941-b007-428a-b083-c67d518f6e49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada53ed554844560843ab84198ac373c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:19.009344 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9b941-b007-428a-b083-c67d518f6e49 service cinder] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:19.009735 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9b941-b007-428a-b083-c67d518f6e49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:19.010014 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9b941-b007-428a-b083-c67d518f6e49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:19.018887 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9b941-b007-428a-b083-c67d518f6e49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:19.020361 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9b941-b007-428a-b083-c67d518f6e49 service cinder] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:19.030281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1452/2861] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:22:18 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:22:28.390941 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d319f2-6972-4f32-b326-492dfaef6947 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:28.462118 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d319f2-6972-4f32-b326-492dfaef6947 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:28.467788 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950fc600-1599-4ebf-ac41-a5537cdff0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:28.472439 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fc600-1599-4ebf-ac41-a5537cdff0aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:28.472439 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fc600-1599-4ebf-ac41-a5537cdff0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:28.472439 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fc600-1599-4ebf-ac41-a5537cdff0aa admin admin] PATH_INFO: `/v3/users/367dc964046f4a2cbda3ad4bce497ddb` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:28.472439 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950fc600-1599-4ebf-ac41-a5537cdff0aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=367dc964046f4a2cbda3ad4bce497ddb)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:28.472439 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950fc600-1599-4ebf-ac41-a5537cdff0aa admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:28.491379 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:28.665009 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-950fc600-1599-4ebf-ac41-a5537cdff0aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '367dc964046f4a2cbda3ad4bce497ddb'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:28.672045 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-950fc600-1599-4ebf-ac41-a5537cdff0aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '367dc964046f4a2cbda3ad4bce497ddb'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:28.672769 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-950fc600-1599-4ebf-ac41-a5537cdff0aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '367dc964046f4a2cbda3ad4bce497ddb'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:28.711879 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-950fc600-1599-4ebf-ac41-a5537cdff0aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '367dc964046f4a2cbda3ad4bce497ddb'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:28.727072 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-950fc600-1599-4ebf-ac41-a5537cdff0aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '367dc964046f4a2cbda3ad4bce497ddb'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:28.734561 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1410/2862] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:22:28 2022] DELETE /identity/v3/users/367dc964046f4a2cbda3ad4bce497ddb => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:22:28.738889 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173d303-6721-4e1e-b6a0-f51b078e0e9f None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:28.739514 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173d303-6721-4e1e-b6a0-f51b078e0e9f None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:28.739514 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173d303-6721-4e1e-b6a0-f51b078e0e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:28.759060 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-a173d303-6721-4e1e-b6a0-f51b078e0e9f None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:28.760579 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-a173d303-6721-4e1e-b6a0-f51b078e0e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:28.823211 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1453/2863] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:22:28.833480 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950fc600-1599-4ebf-ac41-a5537cdff0aa admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:28.835301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-950fc600-1599-4ebf-ac41-a5537cdff0aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:28.896925 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950fc600-1599-4ebf-ac41-a5537cdff0aa admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:28.901943 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb5612-514d-489f-93d6-e3b2e680a4a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:28.902587 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb5612-514d-489f-93d6-e3b2e680a4a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:28.902865 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb5612-514d-489f-93d6-e3b2e680a4a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:28.903139 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb5612-514d-489f-93d6-e3b2e680a4a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:28.913565 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb5612-514d-489f-93d6-e3b2e680a4a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:28.916229 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb5612-514d-489f-93d6-e3b2e680a4a9 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:28.927693 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1411/2864] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:22:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:22:29.422522 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173d303-6721-4e1e-b6a0-f51b078e0e9f None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:29.424120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-a173d303-6721-4e1e-b6a0-f51b078e0e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:29.436840 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173d303-6721-4e1e-b6a0-f51b078e0e9f None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:29.442845 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6175512-2099-4c33-aaf9-bbc62f2b5050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:29.443657 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6175512-2099-4c33-aaf9-bbc62f2b5050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:29.443946 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6175512-2099-4c33-aaf9-bbc62f2b5050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:29.444256 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6175512-2099-4c33-aaf9-bbc62f2b5050 admin admin] PATH_INFO: `/v3/projects/16c5122a1b4e42d3b80871c6d1b06f65` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:29.445444 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6175512-2099-4c33-aaf9-bbc62f2b5050 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16c5122a1b4e42d3b80871c6d1b06f65)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:29.448051 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6175512-2099-4c33-aaf9-bbc62f2b5050 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:29.567153 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-b6175512-2099-4c33-aaf9-bbc62f2b5050 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16c5122a1b4e42d3b80871c6d1b06f65', 'request_id': 'req-b6175512-2099-4c33-aaf9-bbc62f2b5050'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:29.648724 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-b6175512-2099-4c33-aaf9-bbc62f2b5050 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16c5122a1b4e42d3b80871c6d1b06f65', 'request_id': 'req-b6175512-2099-4c33-aaf9-bbc62f2b5050'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:29.655331 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-b6175512-2099-4c33-aaf9-bbc62f2b5050 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16c5122a1b4e42d3b80871c6d1b06f65', 'request_id': 'req-b6175512-2099-4c33-aaf9-bbc62f2b5050'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:29.666968 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-b6175512-2099-4c33-aaf9-bbc62f2b5050 admin admin] The token cache is being invalidate because project 16c5122a1b4e42d3b80871c6d1b06f65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:22:29.667184 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-b6175512-2099-4c33-aaf9-bbc62f2b5050 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:29.667924 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-b6175512-2099-4c33-aaf9-bbc62f2b5050 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:29.669687 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1454/2865] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:22:29 2022] DELETE /identity/v3/projects/16c5122a1b4e42d3b80871c6d1b06f65 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:22:29.674775 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e980f01-a2e9-42ca-a921-0db65eeb007f None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:29.675268 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e980f01-a2e9-42ca-a921-0db65eeb007f None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:29.675370 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e980f01-a2e9-42ca-a921-0db65eeb007f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:29.697457 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-7e980f01-a2e9-42ca-a921-0db65eeb007f None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:29.698960 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-7e980f01-a2e9-42ca-a921-0db65eeb007f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:29.772487 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1412/2866] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:29.781132 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbc040-9f45-447d-a6e0-6e2d276d792b None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:29.782087 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbc040-9f45-447d-a6e0-6e2d276d792b None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:29.782364 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbc040-9f45-447d-a6e0-6e2d276d792b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:29.803562 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-71bbc040-9f45-447d-a6e0-6e2d276d792b None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:29.804815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-71bbc040-9f45-447d-a6e0-6e2d276d792b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:29.814245 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1455/2867] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:29.818996 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e980f01-a2e9-42ca-a921-0db65eeb007f None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:29.830378 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e980f01-a2e9-42ca-a921-0db65eeb007f None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:29.835264 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4d1d6-d3da-4a19-ab40-014eb86610c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:29.835923 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4d1d6-d3da-4a19-ab40-014eb86610c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:29.836233 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4d1d6-d3da-4a19-ab40-014eb86610c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:29.836514 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4d1d6-d3da-4a19-ab40-014eb86610c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:29.837902 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4d1d6-d3da-4a19-ab40-014eb86610c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:22:29.838136 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4d1d6-d3da-4a19-ab40-014eb86610c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:29.839713 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4d1d6-d3da-4a19-ab40-014eb86610c1 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:29.853935 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1413/2868] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Aug 2 09:22:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:22:29.858689 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbc040-9f45-447d-a6e0-6e2d276d792b None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:29.871519 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbc040-9f45-447d-a6e0-6e2d276d792b None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:29.876281 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eeae60-d729-410b-b370-da94c81feb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:29.876913 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eeae60-d729-410b-b370-da94c81feb2a admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:29.877196 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eeae60-d729-410b-b370-da94c81feb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:29.877478 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eeae60-d729-410b-b370-da94c81feb2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:29.878134 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eeae60-d729-410b-b370-da94c81feb2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:29.880048 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eeae60-d729-410b-b370-da94c81feb2a admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:29.976962 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1456/2869] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:22:29 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:22:29.981780 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4d1d6-d3da-4a19-ab40-014eb86610c1 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:29.992152 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4d1d6-d3da-4a19-ab40-014eb86610c1 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:30.013834 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:30.051060 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef6381-40b1-4cfd-8727-2c4c43d9e3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:30.051806 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef6381-40b1-4cfd-8727-2c4c43d9e3ef admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:30.052085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef6381-40b1-4cfd-8727-2c4c43d9e3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:30.052383 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef6381-40b1-4cfd-8727-2c4c43d9e3ef admin admin] PATH_INFO: `/v3/users` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:30.053075 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef6381-40b1-4cfd-8727-2c4c43d9e3ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:30.054993 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef6381-40b1-4cfd-8727-2c4c43d9e3ef admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:30.136185 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1414/2870] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:22:29 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:22:30.140541 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eeae60-d729-410b-b370-da94c81feb2a admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:30.152250 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eeae60-d729-410b-b370-da94c81feb2a admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:30.157735 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e999e61-c4ec-46b1-8122-177650df909c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:30.158364 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e999e61-c4ec-46b1-8122-177650df909c admin admin] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:30.158649 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e999e61-c4ec-46b1-8122-177650df909c admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:30.158929 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e999e61-c4ec-46b1-8122-177650df909c admin admin] PATH_INFO: `/v3/roles` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:30.159633 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e999e61-c4ec-46b1-8122-177650df909c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:30.161282 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e999e61-c4ec-46b1-8122-177650df909c admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:30.167041 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:30.172149 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1457/2871] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:22:30.179903 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef6381-40b1-4cfd-8727-2c4c43d9e3ef admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:30.190892 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef6381-40b1-4cfd-8727-2c4c43d9e3ef admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:30.195518 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a6622-c412-4751-8367-cfb3f4b0f305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:30.196130 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a6622-c412-4751-8367-cfb3f4b0f305 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:30.196448 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a6622-c412-4751-8367-cfb3f4b0f305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:30.197228 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a6622-c412-4751-8367-cfb3f4b0f305 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:30.197919 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a6622-c412-4751-8367-cfb3f4b0f305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:30.199507 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a6622-c412-4751-8367-cfb3f4b0f305 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:30.210014 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1415/2872] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:22:30.215186 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e999e61-c4ec-46b1-8122-177650df909c admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:30.225177 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e999e61-c4ec-46b1-8122-177650df909c admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:30.230531 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20f1f5-da8e-4bcb-89ce-c11e718ab698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:30.231353 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20f1f5-da8e-4bcb-89ce-c11e718ab698 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:30.231817 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20f1f5-da8e-4bcb-89ce-c11e718ab698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:30.232649 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20f1f5-da8e-4bcb-89ce-c11e718ab698 admin admin] PATH_INFO: `/v3/projects/ed8821168eca41338809f59eda063b63/users/88bb10103dc8467793345f8fb164ecbb/roles/5fd593d076084fbaa9208dd505b58150` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:30.249185 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20f1f5-da8e-4bcb-89ce-c11e718ab698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed8821168eca41338809f59eda063b63, user_id=88bb10103dc8467793345f8fb164ecbb, role_id=5fd593d076084fbaa9208dd505b58150)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:30.252121 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20f1f5-da8e-4bcb-89ce-c11e718ab698 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:30.330056 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1458/2873] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:22:30 2022] PUT /identity/v3/projects/ed8821168eca41338809f59eda063b63/users/88bb10103dc8467793345f8fb164ecbb/roles/5fd593d076084fbaa9208dd505b58150 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:22:30.335295 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2aeaf-f7ee-4425-99f1-965e939dc8fc None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:30.335611 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2aeaf-f7ee-4425-99f1-965e939dc8fc None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:30.335859 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2aeaf-f7ee-4425-99f1-965e939dc8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:30.357249 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-85d2aeaf-f7ee-4425-99f1-965e939dc8fc None None] MFA Rules not processed for user `c124f3deb85b49f5a9becf0360ac8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:30.358466 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-85d2aeaf-f7ee-4425-99f1-965e939dc8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:30.435934 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1416/2874] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:30.442634 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20f1f5-da8e-4bcb-89ce-c11e718ab698 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:30.444691 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-6c20f1f5-da8e-4bcb-89ce-c11e718ab698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:30.512419 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20f1f5-da8e-4bcb-89ce-c11e718ab698 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:30.516864 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0838be3-6715-49af-aa3a-9fda57ffeadd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:30.517590 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0838be3-6715-49af-aa3a-9fda57ffeadd service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:30.517979 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0838be3-6715-49af-aa3a-9fda57ffeadd service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:30.518262 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0838be3-6715-49af-aa3a-9fda57ffeadd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:30.528603 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0838be3-6715-49af-aa3a-9fda57ffeadd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:30.530055 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0838be3-6715-49af-aa3a-9fda57ffeadd service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:30.540380 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1459/2875] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:22:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:22:30.854383 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2aeaf-f7ee-4425-99f1-965e939dc8fc None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:30.865765 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2aeaf-f7ee-4425-99f1-965e939dc8fc None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:30.872109 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8231fae-c10d-47e6-b303-d6fee93631d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:30.872884 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8231fae-c10d-47e6-b303-d6fee93631d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:30.873237 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8231fae-c10d-47e6-b303-d6fee93631d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:30.873587 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8231fae-c10d-47e6-b303-d6fee93631d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:30.876066 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-a8231fae-c10d-47e6-b303-d6fee93631d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:30.889849 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8231fae-c10d-47e6-b303-d6fee93631d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:30.891579 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8231fae-c10d-47e6-b303-d6fee93631d3 service neutron] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:30.903515 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1417/2876] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:22:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:22:37.542846 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da172ee-c83d-45de-b63a-12c2df345243 None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:37.543265 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da172ee-c83d-45de-b63a-12c2df345243 None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:37.543482 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da172ee-c83d-45de-b63a-12c2df345243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:37.591452 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-3da172ee-c83d-45de-b63a-12c2df345243 None None] MFA Rules not processed for user `88bb10103dc8467793345f8fb164ecbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:37.593571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-3da172ee-c83d-45de-b63a-12c2df345243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:37.718611 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1460/2877] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:22:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:37.722795 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8231fae-c10d-47e6-b303-d6fee93631d3 service neutron] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:37.760638 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8231fae-c10d-47e6-b303-d6fee93631d3 service neutron] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:37.769700 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c70579-1aec-4f87-9b33-f2c5e8367f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:37.770416 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c70579-1aec-4f87-9b33-f2c5e8367f1c admin admin] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:37.770749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c70579-1aec-4f87-9b33-f2c5e8367f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:37.771025 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c70579-1aec-4f87-9b33-f2c5e8367f1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:37.771805 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c70579-1aec-4f87-9b33-f2c5e8367f1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:37.781907 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c70579-1aec-4f87-9b33-f2c5e8367f1c admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:37.887178 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1418/2878] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Aug 2 09:22:37 2022] POST /identity/v3/projects => generated 383 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:22:37.891507 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da172ee-c83d-45de-b63a-12c2df345243 None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:37.904652 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da172ee-c83d-45de-b63a-12c2df345243 None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:37.987128 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad04b6-fd67-4414-b08f-41fa60ea81c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:37.987871 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad04b6-fd67-4414-b08f-41fa60ea81c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:37.988323 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad04b6-fd67-4414-b08f-41fa60ea81c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:37.988671 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad04b6-fd67-4414-b08f-41fa60ea81c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:37.989506 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad04b6-fd67-4414-b08f-41fa60ea81c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:37.992058 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad04b6-fd67-4414-b08f-41fa60ea81c2 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:38.100921 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:38.108209 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1461/2879] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Aug 2 09:22:37 2022] POST /identity/v3/users => generated 298 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:22:38.112374 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c70579-1aec-4f87-9b33-f2c5e8367f1c admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:38.127678 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c70579-1aec-4f87-9b33-f2c5e8367f1c admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:38.138830 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51460fa6-4251-47bb-b09b-2003277d3963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:38.139606 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51460fa6-4251-47bb-b09b-2003277d3963 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:38.145931 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51460fa6-4251-47bb-b09b-2003277d3963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:38.145931 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51460fa6-4251-47bb-b09b-2003277d3963 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:38.145931 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51460fa6-4251-47bb-b09b-2003277d3963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:38.145931 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51460fa6-4251-47bb-b09b-2003277d3963 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:38.160680 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1419/2880] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:22:38.166999 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad04b6-fd67-4414-b08f-41fa60ea81c2 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:38.180907 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad04b6-fd67-4414-b08f-41fa60ea81c2 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:38.187244 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfe84e-7fd5-4e14-9af0-10a24ea99ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:38.188539 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfe84e-7fd5-4e14-9af0-10a24ea99ec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:38.188828 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfe84e-7fd5-4e14-9af0-10a24ea99ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:38.189108 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfe84e-7fd5-4e14-9af0-10a24ea99ec6 admin admin] PATH_INFO: `/v3/projects/2cff2d205fee4bcd9549b0f4acc160ee/users/8c6a46ec7b9c421e9040264184dc125f/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:38.215248 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcfe84e-7fd5-4e14-9af0-10a24ea99ec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cff2d205fee4bcd9549b0f4acc160ee, user_id=8c6a46ec7b9c421e9040264184dc125f, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:38.222844 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcfe84e-7fd5-4e14-9af0-10a24ea99ec6 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:38.329787 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1462/2881] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:22:38 2022] PUT /identity/v3/projects/2cff2d205fee4bcd9549b0f4acc160ee/users/8c6a46ec7b9c421e9040264184dc125f/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:22:38.334062 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51460fa6-4251-47bb-b09b-2003277d3963 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:38.345304 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51460fa6-4251-47bb-b09b-2003277d3963 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:38.407776 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:38.414616 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49a072-1901-469a-a5ce-c20624ee43e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:38.414856 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49a072-1901-469a-a5ce-c20624ee43e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:38.415085 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49a072-1901-469a-a5ce-c20624ee43e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:38.417249 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49a072-1901-469a-a5ce-c20624ee43e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:38.417249 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce49a072-1901-469a-a5ce-c20624ee43e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:38.417915 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce49a072-1901-469a-a5ce-c20624ee43e8 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:38.428685 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1420/2882] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Aug 2 09:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:22:38.433222 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfe84e-7fd5-4e14-9af0-10a24ea99ec6 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:38.443994 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfe84e-7fd5-4e14-9af0-10a24ea99ec6 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:38.449662 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01936b9-394d-49f8-a444-71ea493ba0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:38.450414 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01936b9-394d-49f8-a444-71ea493ba0b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:38.450718 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01936b9-394d-49f8-a444-71ea493ba0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:38.451015 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01936b9-394d-49f8-a444-71ea493ba0b7 admin admin] PATH_INFO: `/v3/projects/2cff2d205fee4bcd9549b0f4acc160ee/users/8c6a46ec7b9c421e9040264184dc125f/roles/b5477d3c4e5a4514b64211ec2452d1d8` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:38.453177 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01936b9-394d-49f8-a444-71ea493ba0b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cff2d205fee4bcd9549b0f4acc160ee, user_id=8c6a46ec7b9c421e9040264184dc125f, role_id=b5477d3c4e5a4514b64211ec2452d1d8)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:38.455836 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01936b9-394d-49f8-a444-71ea493ba0b7 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:38.468552 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1463/2883] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Aug 2 09:22:38 2022] PUT /identity/v3/projects/2cff2d205fee4bcd9549b0f4acc160ee/users/8c6a46ec7b9c421e9040264184dc125f/roles/b5477d3c4e5a4514b64211ec2452d1d8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:22:40.149528 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49a072-1901-469a-a5ce-c20624ee43e8 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:40.152632 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-ce49a072-1901-469a-a5ce-c20624ee43e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:40.175548 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49a072-1901-469a-a5ce-c20624ee43e8 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:40.258060 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d946e-fb6f-464e-b2c9-d646fec7899d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:40.259480 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d946e-fb6f-464e-b2c9-d646fec7899d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:40.259866 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d946e-fb6f-464e-b2c9-d646fec7899d admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:40.260320 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d946e-fb6f-464e-b2c9-d646fec7899d admin admin] PATH_INFO: `/v3/users/c0a2b49114e0458f9625de698cc89861` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:40.261754 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d946e-fb6f-464e-b2c9-d646fec7899d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0a2b49114e0458f9625de698cc89861)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:40.263770 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d946e-fb6f-464e-b2c9-d646fec7899d admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:40.520315 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-7e5d946e-fb6f-464e-b2c9-d646fec7899d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0a2b49114e0458f9625de698cc89861'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:40.542134 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-7e5d946e-fb6f-464e-b2c9-d646fec7899d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0a2b49114e0458f9625de698cc89861'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:40.543168 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-7e5d946e-fb6f-464e-b2c9-d646fec7899d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0a2b49114e0458f9625de698cc89861'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:40.614593 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-7e5d946e-fb6f-464e-b2c9-d646fec7899d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0a2b49114e0458f9625de698cc89861'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:40.633451 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-7e5d946e-fb6f-464e-b2c9-d646fec7899d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0a2b49114e0458f9625de698cc89861'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:40.645319 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1421/2884] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:22:40 2022] DELETE /identity/v3/users/c0a2b49114e0458f9625de698cc89861 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:22:41.005577 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01936b9-394d-49f8-a444-71ea493ba0b7 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:41.007453 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-f01936b9-394d-49f8-a444-71ea493ba0b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:41.030054 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01936b9-394d-49f8-a444-71ea493ba0b7 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:41.110300 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8a8af-8beb-4f19-9f5a-2d9adb40b477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:41.110963 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8a8af-8beb-4f19-9f5a-2d9adb40b477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:41.111256 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8a8af-8beb-4f19-9f5a-2d9adb40b477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:41.111526 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8a8af-8beb-4f19-9f5a-2d9adb40b477 admin admin] PATH_INFO: `/v3/projects/8e8d4b340fc54e639758d911a5ab16a7` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:41.112815 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8a8af-8beb-4f19-9f5a-2d9adb40b477 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e8d4b340fc54e639758d911a5ab16a7)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:41.115094 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8a8af-8beb-4f19-9f5a-2d9adb40b477 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:41.304990 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-c8b8a8af-8beb-4f19-9f5a-2d9adb40b477 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e8d4b340fc54e639758d911a5ab16a7', 'request_id': 'req-c8b8a8af-8beb-4f19-9f5a-2d9adb40b477'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:41.420387 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-c8b8a8af-8beb-4f19-9f5a-2d9adb40b477 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e8d4b340fc54e639758d911a5ab16a7', 'request_id': 'req-c8b8a8af-8beb-4f19-9f5a-2d9adb40b477'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:41.429677 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-c8b8a8af-8beb-4f19-9f5a-2d9adb40b477 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e8d4b340fc54e639758d911a5ab16a7', 'request_id': 'req-c8b8a8af-8beb-4f19-9f5a-2d9adb40b477'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:41.453488 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-c8b8a8af-8beb-4f19-9f5a-2d9adb40b477 admin admin] The token cache is being invalidate because project 8e8d4b340fc54e639758d911a5ab16a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:22:41.454048 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-c8b8a8af-8beb-4f19-9f5a-2d9adb40b477 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:41.454915 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-c8b8a8af-8beb-4f19-9f5a-2d9adb40b477 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:41.456996 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1464/2885] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:22:41 2022] DELETE /identity/v3/projects/8e8d4b340fc54e639758d911a5ab16a7 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:22:41.461132 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d946e-fb6f-464e-b2c9-d646fec7899d admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:41.477229 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d946e-fb6f-464e-b2c9-d646fec7899d admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:41.561089 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bce553-d8cf-4552-8f5f-958bc5a94d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:41.562257 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bce553-d8cf-4552-8f5f-958bc5a94d95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:41.562257 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bce553-d8cf-4552-8f5f-958bc5a94d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:41.562507 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bce553-d8cf-4552-8f5f-958bc5a94d95 admin admin] PATH_INFO: `/v3/users/47ae81d900054622a22acf6db4ff094b` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:41.563799 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bce553-d8cf-4552-8f5f-958bc5a94d95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47ae81d900054622a22acf6db4ff094b)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:41.565780 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bce553-d8cf-4552-8f5f-958bc5a94d95 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:41.586795 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:41.759871 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-a0bce553-d8cf-4552-8f5f-958bc5a94d95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47ae81d900054622a22acf6db4ff094b'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:41.771832 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-a0bce553-d8cf-4552-8f5f-958bc5a94d95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47ae81d900054622a22acf6db4ff094b'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:41.773756 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-a0bce553-d8cf-4552-8f5f-958bc5a94d95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47ae81d900054622a22acf6db4ff094b'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:41.894360 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-a0bce553-d8cf-4552-8f5f-958bc5a94d95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47ae81d900054622a22acf6db4ff094b'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:41.913277 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-a0bce553-d8cf-4552-8f5f-958bc5a94d95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47ae81d900054622a22acf6db4ff094b'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:41.920602 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1422/2886] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:22:41 2022] DELETE /identity/v3/users/47ae81d900054622a22acf6db4ff094b => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:22:42.348860 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8a8af-8beb-4f19-9f5a-2d9adb40b477 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:42.351256 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-c8b8a8af-8beb-4f19-9f5a-2d9adb40b477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:42.389871 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8a8af-8beb-4f19-9f5a-2d9adb40b477 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:42.460220 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:42.473581 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48923e2-c426-4acd-8dd1-fc9bde05ab01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:42.474282 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48923e2-c426-4acd-8dd1-fc9bde05ab01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:42.474571 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48923e2-c426-4acd-8dd1-fc9bde05ab01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:42.474852 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48923e2-c426-4acd-8dd1-fc9bde05ab01 admin admin] PATH_INFO: `/v3/projects/c3310513afe54469b2a8d07a1ff6c6db` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:42.476061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48923e2-c426-4acd-8dd1-fc9bde05ab01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3310513afe54469b2a8d07a1ff6c6db)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:42.479742 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48923e2-c426-4acd-8dd1-fc9bde05ab01 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:42.597228 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d48923e2-c426-4acd-8dd1-fc9bde05ab01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3310513afe54469b2a8d07a1ff6c6db', 'request_id': 'req-d48923e2-c426-4acd-8dd1-fc9bde05ab01'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:42.689224 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d48923e2-c426-4acd-8dd1-fc9bde05ab01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3310513afe54469b2a8d07a1ff6c6db', 'request_id': 'req-d48923e2-c426-4acd-8dd1-fc9bde05ab01'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:42.695836 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d48923e2-c426-4acd-8dd1-fc9bde05ab01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3310513afe54469b2a8d07a1ff6c6db', 'request_id': 'req-d48923e2-c426-4acd-8dd1-fc9bde05ab01'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:42.709759 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d48923e2-c426-4acd-8dd1-fc9bde05ab01 admin admin] The token cache is being invalidate because project c3310513afe54469b2a8d07a1ff6c6db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:22:42.710152 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d48923e2-c426-4acd-8dd1-fc9bde05ab01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:42.710961 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-d48923e2-c426-4acd-8dd1-fc9bde05ab01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:42.724205 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1465/2887] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:22:42 2022] DELETE /identity/v3/projects/c3310513afe54469b2a8d07a1ff6c6db => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:22:45.205731 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71462f-7016-433a-aaf4-867f26ac9f60 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:45.206280 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71462f-7016-433a-aaf4-867f26ac9f60 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:45.206280 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71462f-7016-433a-aaf4-867f26ac9f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:45.248846 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-da71462f-7016-433a-aaf4-867f26ac9f60 None None] MFA Rules not processed for user `8c6a46ec7b9c421e9040264184dc125f`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:45.250087 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-da71462f-7016-433a-aaf4-867f26ac9f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:45.341282 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1423/2888] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:22:45 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:45.355288 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48923e2-c426-4acd-8dd1-fc9bde05ab01 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:45.357494 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-d48923e2-c426-4acd-8dd1-fc9bde05ab01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:45.455173 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48923e2-c426-4acd-8dd1-fc9bde05ab01 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:45.459592 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429d9ca-87ae-4d6f-b388-b3659a8b6e7f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca8afe2c10f4db58716aacfd373504b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:45.460270 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429d9ca-87ae-4d6f-b388-b3659a8b6e7f service glance] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:45.460554 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429d9ca-87ae-4d6f-b388-b3659a8b6e7f service glance] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:45.460832 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429d9ca-87ae-4d6f-b388-b3659a8b6e7f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:45.463612 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-0429d9ca-87ae-4d6f-b388-b3659a8b6e7f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:45.536070 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429d9ca-87ae-4d6f-b388-b3659a8b6e7f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:45.537873 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429d9ca-87ae-4d6f-b388-b3659a8b6e7f service glance] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:45.547450 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1466/2889] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:22:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:22:45.840228 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f45177-b505-4a12-b757-73001d51bc93 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:45.840607 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f45177-b505-4a12-b757-73001d51bc93 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:45.840894 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f45177-b505-4a12-b757-73001d51bc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:45.899804 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-53f45177-b505-4a12-b757-73001d51bc93 None None] MFA Rules not processed for user `eb640d92cb9b49019f42351a60efe258`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:45.901199 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-53f45177-b505-4a12-b757-73001d51bc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:45.955620 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:45.974533 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1424/2890] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Aug 2 09:22:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:46.094249 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429d9ca-87ae-4d6f-b388-b3659a8b6e7f service glance] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:46.095711 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-0429d9ca-87ae-4d6f-b388-b3659a8b6e7f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:46.114955 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:46.202781 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429d9ca-87ae-4d6f-b388-b3659a8b6e7f service glance] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:46.208134 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae4942-964e-4ab9-ac13-6d9aa0282b6d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f8e572550b4ab5955d7a94f1563441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:46.208885 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae4942-964e-4ab9-ac13-6d9aa0282b6d service swift] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:46.209165 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae4942-964e-4ab9-ac13-6d9aa0282b6d service swift] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:46.209474 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae4942-964e-4ab9-ac13-6d9aa0282b6d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:46.219377 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae4942-964e-4ab9-ac13-6d9aa0282b6d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:46.260178 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae4942-964e-4ab9-ac13-6d9aa0282b6d service swift] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:46.260178 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1467/2891] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Aug 2 09:22:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:22:56.037087 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=5 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:56.284929 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=34 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:56.939406 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30e98f-e577-4119-8b67-9b0b13ae06b5 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:56.939721 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30e98f-e577-4119-8b67-9b0b13ae06b5 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:56.940001 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30e98f-e577-4119-8b67-9b0b13ae06b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:56.959896 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-bf30e98f-e577-4119-8b67-9b0b13ae06b5 None None] MFA Rules not processed for user `88bb10103dc8467793345f8fb164ecbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:56.961685 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-bf30e98f-e577-4119-8b67-9b0b13ae06b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:56.968863 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1425/2892] 10.222.0.20 () {58 vars in 958 bytes} [Tue Aug 2 09:22:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:22:57.234972 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae4942-964e-4ab9-ac13-6d9aa0282b6d service swift] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:57.236439 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-a2ae4942-964e-4ab9-ac13-6d9aa0282b6d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:57.297831 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae4942-964e-4ab9-ac13-6d9aa0282b6d service swift] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:57.306036 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538b485-803b-45ab-8180-640575778aa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:57.306036 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538b485-803b-45ab-8180-640575778aa0 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:57.306036 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538b485-803b-45ab-8180-640575778aa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:57.306036 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538b485-803b-45ab-8180-640575778aa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:57.306546 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-f538b485-803b-45ab-8180-640575778aa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:57.315427 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538b485-803b-45ab-8180-640575778aa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:57.316932 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538b485-803b-45ab-8180-640575778aa0 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:57.326223 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1468/2893] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:22:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:22:57.773409 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30e98f-e577-4119-8b67-9b0b13ae06b5 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:57.778989 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-bf30e98f-e577-4119-8b67-9b0b13ae06b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:57.858733 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30e98f-e577-4119-8b67-9b0b13ae06b5 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:57.864218 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c49b6-3337-4adc-9043-126ab158b1f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cac76aa21415d8ab0a2524a7049d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:57.864863 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c49b6-3337-4adc-9043-126ab158b1f4 service placement] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:57.865145 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c49b6-3337-4adc-9043-126ab158b1f4 service placement] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:57.865421 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c49b6-3337-4adc-9043-126ab158b1f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:57.867563 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-f96c49b6-3337-4adc-9043-126ab158b1f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:57.880043 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c49b6-3337-4adc-9043-126ab158b1f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:57.881678 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c49b6-3337-4adc-9043-126ab158b1f4 service placement] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:57.892600 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1426/2894] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:22:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:00.490777 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75f21c-fd7b-4e1c-bc55-d580b213dc4c None None] REQUEST_METHOD: `POST` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:00.495848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75f21c-fd7b-4e1c-bc55-d580b213dc4c None None] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:00.495848 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75f21c-fd7b-4e1c-bc55-d580b213dc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:00.512359 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.auth.core [None req-3e75f21c-fd7b-4e1c-bc55-d580b213dc4c None None] MFA Rules not processed for user `eb640d92cb9b49019f42351a60efe258`. Rule list: `[]` (Enabled: `True`). {{(pid=80406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:00.513414 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-3e75f21c-fd7b-4e1c-bc55-d580b213dc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:00.521433 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1469/2895] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Aug 2 09:23:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:00.536418 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c49b6-3337-4adc-9043-126ab158b1f4 service placement] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:00.550868 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c49b6-3337-4adc-9043-126ab158b1f4 service placement] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:00.557242 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972130c4-9bb2-4137-b8e4-a3ff3bf37962 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f8e572550b4ab5955d7a94f1563441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:00.557874 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972130c4-9bb2-4137-b8e4-a3ff3bf37962 service swift] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:00.558177 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972130c4-9bb2-4137-b8e4-a3ff3bf37962 service swift] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:00.558441 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972130c4-9bb2-4137-b8e4-a3ff3bf37962 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:00.567483 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972130c4-9bb2-4137-b8e4-a3ff3bf37962 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:00.569116 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972130c4-9bb2-4137-b8e4-a3ff3bf37962 service swift] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:00.598021 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1427/2896] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Aug 2 09:23:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:23:10.506031 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=29 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:10.575501 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=41 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:15.950831 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75f21c-fd7b-4e1c-bc55-d580b213dc4c None None] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:15.952285 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-3e75f21c-fd7b-4e1c-bc55-d580b213dc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:16.030586 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75f21c-fd7b-4e1c-bc55-d580b213dc4c None None] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:16.036405 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafb4cd-a400-44f2-8edc-b0d95b517487 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bfcddefa71546d28078a38325c723a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:16.037043 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafb4cd-a400-44f2-8edc-b0d95b517487 service nova] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:16.037321 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafb4cd-a400-44f2-8edc-b0d95b517487 service nova] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:16.037595 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafb4cd-a400-44f2-8edc-b0d95b517487 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:16.039605 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-8bafb4cd-a400-44f2-8edc-b0d95b517487 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:16.053099 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bafb4cd-a400-44f2-8edc-b0d95b517487 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:16.054735 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bafb4cd-a400-44f2-8edc-b0d95b517487 service nova] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:16.067130 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1470/2897] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:26.062225 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=34 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:26.090437 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972130c4-9bb2-4137-b8e4-a3ff3bf37962 service swift] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:26.102047 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972130c4-9bb2-4137-b8e4-a3ff3bf37962 service swift] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:26.107500 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab440c-efc1-47fa-8ef4-1caa8460b52a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cac76aa21415d8ab0a2524a7049d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:26.108180 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab440c-efc1-47fa-8ef4-1caa8460b52a service placement] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:26.110994 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab440c-efc1-47fa-8ef4-1caa8460b52a service placement] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:26.110994 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab440c-efc1-47fa-8ef4-1caa8460b52a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:26.110994 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-59ab440c-efc1-47fa-8ef4-1caa8460b52a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:26.123982 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab440c-efc1-47fa-8ef4-1caa8460b52a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:26.125857 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab440c-efc1-47fa-8ef4-1caa8460b52a service placement] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:26.137749 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1428/2898] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:29.490990 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafb4cd-a400-44f2-8edc-b0d95b517487 service nova] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:29.500468 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafb4cd-a400-44f2-8edc-b0d95b517487 service nova] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:29.504346 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7146c-ca17-4713-850a-40abc8b03aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6128f07ffd5f4357968b0e2e300f2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:29.504730 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7146c-ca17-4713-850a-40abc8b03aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:29.505011 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7146c-ca17-4713-850a-40abc8b03aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:29.505285 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7146c-ca17-4713-850a-40abc8b03aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:29.515124 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7146c-ca17-4713-850a-40abc8b03aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:29.516616 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7146c-ca17-4713-850a-40abc8b03aa6 service neutron] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:29.526693 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1471/2899] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:29 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:36.132245 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=6 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:39.522255 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=6 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:52.015788 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009382f4-c396-4fa7-a5fa-3dcd324c6fd0 None None] REQUEST_METHOD: `POST` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:52.019619 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009382f4-c396-4fa7-a5fa-3dcd324c6fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:52.019619 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009382f4-c396-4fa7-a5fa-3dcd324c6fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:52.040250 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.auth.core [None req-009382f4-c396-4fa7-a5fa-3dcd324c6fd0 None None] MFA Rules not processed for user `eb640d92cb9b49019f42351a60efe258`. Rule list: `[]` (Enabled: `True`). {{(pid=80407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:52.042187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-009382f4-c396-4fa7-a5fa-3dcd324c6fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:52.055677 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1429/2900] 10.222.0.20 () {58 vars in 967 bytes} [Tue Aug 2 09:24:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:52.106005 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7146c-ca17-4713-850a-40abc8b03aa6 service neutron] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:52.122547 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7146c-ca17-4713-850a-40abc8b03aa6 service neutron] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:52.128576 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439c75b-d402-4c4c-abab-7abb10dd12f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f8e572550b4ab5955d7a94f1563441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:52.129145 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439c75b-d402-4c4c-abab-7abb10dd12f1 service swift] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:52.129429 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439c75b-d402-4c4c-abab-7abb10dd12f1 service swift] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:52.129710 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439c75b-d402-4c4c-abab-7abb10dd12f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:52.140081 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439c75b-d402-4c4c-abab-7abb10dd12f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:52.142527 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439c75b-d402-4c4c-abab-7abb10dd12f1 service swift] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:52.154427 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1472/2901] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Aug 2 09:24:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 02 09:24:56.782340 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009382f4-c396-4fa7-a5fa-3dcd324c6fd0 None None] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:56.783810 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-009382f4-c396-4fa7-a5fa-3dcd324c6fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:56.801301 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009382f4-c396-4fa7-a5fa-3dcd324c6fd0 None None] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:56.808832 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa2475-dc48-4ca0-a93b-74439839dd30 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cac76aa21415d8ab0a2524a7049d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:56.809593 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa2475-dc48-4ca0-a93b-74439839dd30 service placement] REQUEST_METHOD: `GET` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:56.810043 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa2475-dc48-4ca0-a93b-74439839dd30 service placement] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:56.810611 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa2475-dc48-4ca0-a93b-74439839dd30 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:56.812805 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-63aa2475-dc48-4ca0-a93b-74439839dd30 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:56.827492 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa2475-dc48-4ca0-a93b-74439839dd30 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:56.829112 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa2475-dc48-4ca0-a93b-74439839dd30 service placement] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:56.840995 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1430/2902] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:25:00.757293 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439c75b-d402-4c4c-abab-7abb10dd12f1 service swift] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:00.765610 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-5439c75b-d402-4c4c-abab-7abb10dd12f1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:00.835108 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439c75b-d402-4c4c-abab-7abb10dd12f1 service swift] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:00.841013 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67fab16-de80-44ff-8d0d-86dbde9a5242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:00.841682 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fab16-de80-44ff-8d0d-86dbde9a5242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:00.841968 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fab16-de80-44ff-8d0d-86dbde9a5242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:00.842250 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fab16-de80-44ff-8d0d-86dbde9a5242 admin admin] PATH_INFO: `/v3/users/88bb10103dc8467793345f8fb164ecbb` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:00.843620 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67fab16-de80-44ff-8d0d-86dbde9a5242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88bb10103dc8467793345f8fb164ecbb)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:00.845599 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67fab16-de80-44ff-8d0d-86dbde9a5242 admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:01.086080 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-b67fab16-de80-44ff-8d0d-86dbde9a5242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88bb10103dc8467793345f8fb164ecbb'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:01.168902 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-b67fab16-de80-44ff-8d0d-86dbde9a5242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88bb10103dc8467793345f8fb164ecbb'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:01.177023 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-b67fab16-de80-44ff-8d0d-86dbde9a5242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88bb10103dc8467793345f8fb164ecbb'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:01.177664 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-b67fab16-de80-44ff-8d0d-86dbde9a5242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88bb10103dc8467793345f8fb164ecbb'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:01.178429 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-b67fab16-de80-44ff-8d0d-86dbde9a5242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88bb10103dc8467793345f8fb164ecbb'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:01.199557 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1473/2903] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:25:00 2022] DELETE /identity/v3/users/88bb10103dc8467793345f8fb164ecbb => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:01.509984 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa2475-dc48-4ca0-a93b-74439839dd30 service placement] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:01.521960 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa2475-dc48-4ca0-a93b-74439839dd30 service placement] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:01.585378 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd83c46-0766-4aa5-bb3e-c8beeb73c104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:01.586073 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd83c46-0766-4aa5-bb3e-c8beeb73c104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:01.586358 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd83c46-0766-4aa5-bb3e-c8beeb73c104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:01.586638 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd83c46-0766-4aa5-bb3e-c8beeb73c104 admin admin] PATH_INFO: `/v3/projects/ed8821168eca41338809f59eda063b63` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:01.587809 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd83c46-0766-4aa5-bb3e-c8beeb73c104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed8821168eca41338809f59eda063b63)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:01.590456 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd83c46-0766-4aa5-bb3e-c8beeb73c104 admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:01.750580 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-1dd83c46-0766-4aa5-bb3e-c8beeb73c104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed8821168eca41338809f59eda063b63', 'request_id': 'req-1dd83c46-0766-4aa5-bb3e-c8beeb73c104'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:01.756292 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-1dd83c46-0766-4aa5-bb3e-c8beeb73c104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed8821168eca41338809f59eda063b63', 'request_id': 'req-1dd83c46-0766-4aa5-bb3e-c8beeb73c104'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:01.762830 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-1dd83c46-0766-4aa5-bb3e-c8beeb73c104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed8821168eca41338809f59eda063b63', 'request_id': 'req-1dd83c46-0766-4aa5-bb3e-c8beeb73c104'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:01.857000 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-1dd83c46-0766-4aa5-bb3e-c8beeb73c104 admin admin] The token cache is being invalidate because project ed8821168eca41338809f59eda063b63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:25:01.857296 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-1dd83c46-0766-4aa5-bb3e-c8beeb73c104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:01.857982 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-1dd83c46-0766-4aa5-bb3e-c8beeb73c104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:01.859788 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1431/2904] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:25:01 2022] DELETE /identity/v3/projects/ed8821168eca41338809f59eda063b63 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:01.863616 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67fab16-de80-44ff-8d0d-86dbde9a5242 admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:01.865207 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-b67fab16-de80-44ff-8d0d-86dbde9a5242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:01.879841 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67fab16-de80-44ff-8d0d-86dbde9a5242 admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:01.944346 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4ef3e-1fdd-4c48-a784-0e5f1b02ac3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:01.945061 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4ef3e-1fdd-4c48-a784-0e5f1b02ac3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:01.945403 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4ef3e-1fdd-4c48-a784-0e5f1b02ac3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:01.945721 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4ef3e-1fdd-4c48-a784-0e5f1b02ac3b admin admin] PATH_INFO: `/v3/users/8c6a46ec7b9c421e9040264184dc125f` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:01.946927 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a4ef3e-1fdd-4c48-a784-0e5f1b02ac3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c6a46ec7b9c421e9040264184dc125f)` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:01.949950 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a4ef3e-1fdd-4c48-a784-0e5f1b02ac3b admin admin] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:01.958279 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:02.194389 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-f1a4ef3e-1fdd-4c48-a784-0e5f1b02ac3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c6a46ec7b9c421e9040264184dc125f'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:02.268236 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-f1a4ef3e-1fdd-4c48-a784-0e5f1b02ac3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c6a46ec7b9c421e9040264184dc125f'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:02.276120 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-f1a4ef3e-1fdd-4c48-a784-0e5f1b02ac3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c6a46ec7b9c421e9040264184dc125f'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:02.277394 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-f1a4ef3e-1fdd-4c48-a784-0e5f1b02ac3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c6a46ec7b9c421e9040264184dc125f'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:02.278506 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.notifications [None req-f1a4ef3e-1fdd-4c48-a784-0e5f1b02ac3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c6a46ec7b9c421e9040264184dc125f'} {{(pid=80406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:02.297881 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1474/2905] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Aug 2 09:25:01 2022] DELETE /identity/v3/users/8c6a46ec7b9c421e9040264184dc125f => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:25:02.572746 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd83c46-0766-4aa5-bb3e-c8beeb73c104 admin admin] Authenticating user token {{(pid=80407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:02.574396 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.fernet_utils [None req-1dd83c46-0766-4aa5-bb3e-c8beeb73c104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:02.589715 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd83c46-0766-4aa5-bb3e-c8beeb73c104 admin admin] Validating token access rules against request {{(pid=80407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:02.651725 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55869cc0-2b8b-468f-a990-2b3c9564e4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c124f3deb85b49f5a9becf0360ac8d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075c06a81874f9ca4b42e16828b98cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:02.652582 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55869cc0-2b8b-468f-a990-2b3c9564e4ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:02.652908 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55869cc0-2b8b-468f-a990-2b3c9564e4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:02.653187 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55869cc0-2b8b-468f-a990-2b3c9564e4ee admin admin] PATH_INFO: `/v3/projects/2cff2d205fee4bcd9549b0f4acc160ee` {{(pid=80407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:02.654377 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55869cc0-2b8b-468f-a990-2b3c9564e4ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cff2d205fee4bcd9549b0f4acc160ee)` {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:02.656327 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55869cc0-2b8b-468f-a990-2b3c9564e4ee admin admin] RBAC: Authorization granted {{(pid=80407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:02.669230 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:02.786830 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-55869cc0-2b8b-468f-a990-2b3c9564e4ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cff2d205fee4bcd9549b0f4acc160ee', 'request_id': 'req-55869cc0-2b8b-468f-a990-2b3c9564e4ee'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:02.793065 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-55869cc0-2b8b-468f-a990-2b3c9564e4ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cff2d205fee4bcd9549b0f4acc160ee', 'request_id': 'req-55869cc0-2b8b-468f-a990-2b3c9564e4ee'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:02.799633 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-55869cc0-2b8b-468f-a990-2b3c9564e4ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cff2d205fee4bcd9549b0f4acc160ee', 'request_id': 'req-55869cc0-2b8b-468f-a990-2b3c9564e4ee'} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:02.918080 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-55869cc0-2b8b-468f-a990-2b3c9564e4ee admin admin] The token cache is being invalidate because project 2cff2d205fee4bcd9549b0f4acc160ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:25:02.918362 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-55869cc0-2b8b-468f-a990-2b3c9564e4ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:02.919023 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG keystone.notifications [None req-55869cc0-2b8b-468f-a990-2b3c9564e4ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:02.920623 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: [pid: 80407|app: 0|req: 1432/2906] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Aug 2 09:25:02 2022] DELETE /identity/v3/projects/2cff2d205fee4bcd9549b0f4acc160ee => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:12.293967 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:12.974087 dv-cinder-845990-6-iscsi devstack@keystone.service[80407]: DEBUG dbcounter [-] [80407] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:28:31.074487 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4ef3e-1fdd-4c48-a784-0e5f1b02ac3b admin admin] Authenticating user token {{(pid=80406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:28:31.075920 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-f1a4ef3e-1fdd-4c48-a784-0e5f1b02ac3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:28:31.220832 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4ef3e-1fdd-4c48-a784-0e5f1b02ac3b admin admin] Validating token access rules against request {{(pid=80406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:28:31.283482 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f6c38-1056-4493-ba85-4d0d32e6c7fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8cac76aa21415d8ab0a2524a7049d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6910e69702854607889bab124edd60c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:28:31.284128 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f6c38-1056-4493-ba85-4d0d32e6c7fd service placement] REQUEST_METHOD: `GET` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:28:31.284438 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f6c38-1056-4493-ba85-4d0d32e6c7fd service placement] SCRIPT_NAME: `/identity` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:28:31.284715 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f6c38-1056-4493-ba85-4d0d32e6c7fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:28:31.290668 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.fernet_utils [None req-3f2f6c38-1056-4493-ba85-4d0d32e6c7fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:28:31.303708 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2f6c38-1056-4493-ba85-4d0d32e6c7fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:28:31.305356 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2f6c38-1056-4493-ba85-4d0d32e6c7fd service placement] RBAC: Authorization granted {{(pid=80406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:28:31.316270 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: [pid: 80406|app: 0|req: 1475/2907] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Aug 2 09:28:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:28:41.311383 dv-cinder-845990-6-iscsi devstack@keystone.service[80406]: DEBUG dbcounter [-] [80406] Writing DB stats keystone:SELECT=89 {{(pid=80406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}